00010000:00080000:0.2F:1788875656.604767:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00080000:1.2F:1788875786.605797:0:0:0:(ldlm_lib.c:3056:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 70 seconds (1 clients connected) 00010000:00010000:1.0:1788876621.747833:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62a00/0xf5bf0f7e313acbcc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876621.747849:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dadc8dd5 reply state 00000000a4078c0b transno 68719477253 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f63a00/0xf5bf0f7e313acbd3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5be8e74d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.747860:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f63a00/0xf5bf0f7e313acbd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5be8e74d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.747867:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5be8e74d (ffff8a13f07a2300) 00010000:00010000:1.0:1788876621.747869:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876621.747872:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876621.747950:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+506:33371:x1875771511147648:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1031us (1222us total) trans 68719477253 rc 0/0 00000100:00100000:1.0:1788876621.747958:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2110 00000100:00100000:1.0:1788876621.751519:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.760957:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.773390:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.780784:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.788588:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.799437:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.814114:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.817871:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.826895:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.832007:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.841347:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.849094:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.855245:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.859927:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511150336 00000100:00100000:1.0:1788876621.859937:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511150336 00000100:00100000:1.0:1788876621.860002:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2124 00000100:00100000:1.0:1788876621.860013:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+513:33371:x1875771511150336:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876621.860192:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876621.860219:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ab8fc lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xd8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370480ec expref: 513 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860250:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xd8:0x0].0x0 (ffff8a13ff5bbe00) 00010000:00010000:1.0:1788876621.860266:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580da00/0xf5bf0f7e313acceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048473 expref: 512 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860277:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee8000) 00010000:00010000:1.0:1788876621.860282:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876621.860306:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860323:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860332:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860345:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fc400/0xf5bf0f7e313accf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x13399480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860352:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fc400/0xf5bf0f7e313accf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13399480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860359:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fc400/0xf5bf0f7e313accf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13399480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860447:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860457:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.860466:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876621.861232:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].43, 64 off10944 00010000:00010000:1.0:1788876621.861292:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861304:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861313:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861321:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861328:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861334:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd07 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xd8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861389:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876621.861408:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861415:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861427:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861433:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb3fca00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.861437:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861445:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861454:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xd8:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:1.0:1788876621.861457:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876621.861460:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861467:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd00 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xd8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861483:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861490:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861496:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861502:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb3fde00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.861504:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861514:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861521:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f07a2600) 00010000:00010000:1.0:1788876621.861523:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876621.861526:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861531:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313accf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876621.861545:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d8400a9 reply state 000000009b66ac10 transno 68719477260 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fc400/0xf5bf0f7e313accf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13399480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861555:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fc400/0xf5bf0f7e313accf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13399480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.861562:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x13399480 (ffff8a13f07a2900) 00010000:00010000:1.0:1788876621.861564:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876621.861567:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876621.861678:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+513:33371:x1875771511150336:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1663us (2442us total) trans 68719477260 rc 0/0 00000100:00100000:1.0:1788876621.861686:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2124 00000100:00100000:1.0:1788876621.870242:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876621.889508:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511150720 00000100:00100000:1.0:1788876621.889519:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511150720 00000100:00100000:1.0:1788876621.889580:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2126 00000100:00100000:1.0:1788876621.889590:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+514:33371:x1875771511150720:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876621.889676:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876621.889702:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cff5a600/0xf5bf0f7e313ab91f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370480f3 expref: 514 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889720:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xd9:0x0].0x0 (ffff8a13eb120800) 00010000:00010000:1.0:1788876621.889735:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313acd15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704847a expref: 513 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889745:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe54f00) 00010000:00010000:1.0:1788876621.889752:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876621.889777:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889791:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889800:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889812:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x270927d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889818:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x270927d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889824:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x270927d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889921:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889930:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.889938:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876621.890173:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].44, 64 off11008 00000004:00080000:1.0:1788876621.890181:0:6541:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1609785578680ns, next at 1610785576378ns, rc = 0 00010000:00010000:1.0:1788876621.890221:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890230:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890250:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890257:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890264:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890270:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313acd31 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xd9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890710:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876621.890728:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890735:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890741:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890748:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb3fd600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.890753:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890762:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890778:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xd9:0x0].0x0 (ffff8a13eb147800) 00010000:00010000:1.0:1788876621.890782:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876621.890851:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890859:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd2a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xd9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890875:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890881:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890887:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890892:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb3fde00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.890895:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890900:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890912:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147a00) 00010000:00010000:1.0:1788876621.890914:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876621.890917:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890923:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876621.890935:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000950fe52f reply state 00000000050d4255 transno 68719477261 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x270927d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.890995:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fca00/0xf5bf0f7e313acd23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x270927d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.891003:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x270927d9 (ffff8a13eb147f00) 00010000:00010000:1.0:1788876621.891006:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876621.891008:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876621.891144:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+514:33371:x1875771511150720:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1552us (1745us total) trans 68719477261 rc 0/0 00000100:00100000:1.0:1788876621.891152:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2126 00000100:00100000:1.0:1788876621.897161:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511150848 00000100:00100000:1.0:1788876621.897171:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511150848 00000100:00100000:1.0:1788876621.897230:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2127 00000100:00100000:1.0:1788876621.897252:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+514:33371:x1875771511150848:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876621.897286:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876621.897306:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62a00/0xf5bf0f7e313acd38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048481 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897369:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897383:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897394:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876621.897438:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876621.897442:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876621.897460:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897484:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62a00/0xf5bf0f7e313acd38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048481 expref: 516 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897499:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048481 expref: 515 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.897506:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:1.0:1788876621.897509:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876621.897511:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa4c2200, rc 0) 00000100:00100000:1.0:1788876621.897572:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+515:33371:x1875771511150848:12345-192.168.203.11@tcp:101:rm.0 Request processed in 323us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876621.897579:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2127 00000100:00100000:1.0:1788876621.921245:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511151232 00000100:00100000:1.0:1788876621.921258:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511151232 00000100:00100000:1.0:1788876621.921344:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2129 00000100:00100000:1.0:1788876621.921355:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+515:33371:x1875771511151232:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876621.921379:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876621.921403:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acd62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048488 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921466:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921481:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921493:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876621.921536:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876621.921540:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876621.921557:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921581:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acd62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048488 expref: 517 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921692:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048488 expref: 516 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.921704:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147a00) 00010000:00010000:1.0:1788876621.921707:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876621.921710:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa4c2200, rc 0) 00000100:00100000:1.0:1788876621.921773:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+516:33371:x1875771511151232:12345-192.168.203.11@tcp:101:rm.0 Request processed in 420us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876621.921780:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2129 00000100:00100000:1.0:1788876621.928254:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511151488 00000100:00100000:1.0:1788876621.928265:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511151488 00000100:00100000:1.0:1788876621.928331:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2130 00000100:00100000:1.0:1788876621.928341:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+516:33371:x1875771511151488:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876621.928399:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876621.928427:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313ab965 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048101 expref: 516 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928447:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xdb:0x0].0x0 (ffff8a13eee3d200) 00010000:00010000:1.0:1788876621.928464:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acd69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048488 expref: 515 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928473:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147a00) 00010000:00010000:1.0:1788876621.928479:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876621.928504:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928516:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928525:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928537:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7d048726 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928544:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d048726 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928550:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d048726 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928709:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928717:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.928723:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876621.928919:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].45, 64 off11072 00010000:00010000:1.0:1788876621.929208:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929218:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929226:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929244:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929251:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929257:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acd85 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xdb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929269:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876621.929285:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929295:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929301:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929306:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.929311:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929319:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929327:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xdb:0x0].0x0 (ffff8a13f07a2600) 00010000:00010000:1.0:1788876621.929330:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876621.929333:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929339:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acd7e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xdb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929352:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929357:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929363:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929368:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb3fde00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.929372:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929378:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929387:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:1.0:1788876621.929391:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876621.929395:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929415:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acd70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876621.929430:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5334e21 reply state 00000000ec752d99 transno 68719477263 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d048726 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929451:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fd600/0xf5bf0f7e313acd77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d048726 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.929460:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7d048726 (ffff8a13eb147800) 00010000:00010000:1.0:1788876621.929466:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876621.929469:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876621.929814:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+516:33371:x1875771511151488:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1472us (1765us total) trans 68719477263 rc 0/0 00000100:00100000:1.0:1788876621.929823:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2130 00000100:00100000:1.0:1788876621.936376:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511151616 00000100:00100000:1.0:1788876621.936386:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511151616 00000100:00100000:1.0:1788876621.936441:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2131 00000100:00100000:1.0:1788876621.936450:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+516:33371:x1875771511151616:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876621.936473:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876621.936499:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704848f expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936562:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936576:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936588:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876621.936667:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876621.936672:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876621.936691:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936714:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704848f expref: 518 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936731:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704848f expref: 517 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.936739:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d3620600) 00010000:00010000:1.0:1788876621.936742:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876621.936745:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486a00, rc 0) 00000100:00100000:1.0:1788876621.936799:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+517:33371:x1875771511151616:12345-192.168.203.11@tcp:101:rm.0 Request processed in 349us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876621.936806:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2131 00000100:00100000:1.0:1788876621.949854:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511151872 00000100:00100000:1.0:1788876621.949864:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511151872 00000100:00100000:1.0:1788876621.949922:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2132 00000100:00100000:1.0:1788876621.949932:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+517:33371:x1875771511151872:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876621.949998:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876621.950028:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ab988 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048108 expref: 517 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950049:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xdc:0x0].0x0 (ffff8a13eee3d400) 00010000:00010000:1.0:1788876621.950068:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acd93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704848f expref: 516 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950079:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d3620600) 00010000:00010000:1.0:1788876621.950085:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876621.950110:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950123:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950134:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950146:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313acda1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4954953c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950154:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313acda1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4954953c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950161:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313acda1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4954953c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950278:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950287:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950295:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876621.950507:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].45, 64 off11072 00010000:00010000:1.0:1788876621.950554:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950563:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950571:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950578:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950585:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950592:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313acdaf lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xdc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950670:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876621.950688:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950698:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950704:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950709:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.950714:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950721:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950729:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xdc:0x0].0x0 (ffff8a13fa77aa00) 00010000:00010000:1.0:1788876621.950732:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876621.950735:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950741:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acda8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xdc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950755:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950761:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950767:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950771:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876621.950775:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950780:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950786:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:1.0:1788876621.950789:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876621.950791:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950796:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acd9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876621.950807:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e044045 reply state 00000000f5128525 transno 68719477264 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313acda1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4954953c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950817:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313acda1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4954953c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.950823:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4954953c (ffff8a13eb147a00) 00010000:00010000:1.0:1788876621.950825:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876621.950827:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876621.950896:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+517:33371:x1875771511151872:12345-192.168.203.11@tcp:36:rm.0 Request processed in 964us (1157us total) trans 68719477264 rc 0/0 00000100:00100000:1.0:1788876621.950904:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2132 00000100:00100000:1.0:1788876621.953881:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511152000 00000100:00100000:1.0:1788876621.953890:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511152000 00000100:00100000:1.0:1788876621.953951:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2133 00000100:00100000:1.0:1788876621.953961:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+517:33371:x1875771511152000:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876621.953981:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876621.954005:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acdb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048496 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954071:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acdbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954085:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acdbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954095:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acdbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876621.954136:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876621.954140:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876621.954158:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acdbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954182:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acdb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048496 expref: 519 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954198:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acdbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048496 expref: 518 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876621.954207:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a800) 00010000:00010000:1.0:1788876621.954209:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876621.954213:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52600, rc 0) 00000100:00100000:1.0:1788876621.954290:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+518:33371:x1875771511152000:12345-192.168.203.11@tcp:101:rm.0 Request processed in 331us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876621.954297:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2133 00000100:00100000:1.0:1788876622.002260:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00080000:1.0:1788876622.002412:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876622.029912:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.036837:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.036845:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313aceab lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xe1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.037719:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c580c600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.037725:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313aceab lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xe1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.037736:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313aceab lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xe1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.037748:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe1:0x0].0x0 (ffff8a13f07a2600) 00010000:00010000:1.0:1788876622.037751:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.037755:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313aceab lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xe1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.037761:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313aceab lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xe1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.037774:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.037777:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.037779:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.063557:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.085422:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511154944 00000100:00100000:1.0:1788876622.085434:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511154944 00000100:00100000:1.0:1788876622.085501:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2148 00000100:00100000:1.0:1788876622.085512:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+525:33371:x1875771511154944:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.085574:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.085637:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313aba7d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048139 expref: 525 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085658:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe3:0x0].0x0 (ffff8a13eb32ed00) 00010000:00010000:1.0:1788876622.085675:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313acee3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370484c7 expref: 524 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085685:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f07a2600) 00010000:00010000:1.0:1788876622.085690:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.085712:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085724:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085734:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085747:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acef1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf22487e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085754:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acef1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf22487e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085762:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acef1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf22487e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085864:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085873:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.085885:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.086093:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].49, 64 off11328 00010000:00010000:1.0:1788876622.086140:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086149:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086158:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086167:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086175:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086182:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313aceff lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xe3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086195:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.086212:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086219:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086227:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086247:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.086252:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086259:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086268:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe3:0x0].0x0 (ffff8a13fa77a500) 00010000:00010000:1.0:1788876622.086271:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.086275:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086281:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acef8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xe3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086297:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086304:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086310:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086315:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.086319:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086325:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086336:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.086338:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.086341:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086347:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aceea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.086358:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000165ff3d2 reply state 000000000687c9d1 transno 68719477272 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acef1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf22487e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086369:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313acef1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf22487e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.086374:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf22487e (ffff8a13fa77af00) 00010000:00010000:1.0:1788876622.086376:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.086378:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.086456:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+525:33371:x1875771511154944:12345-192.168.203.11@tcp:36:rm.0 Request processed in 945us (1140us total) trans 68719477272 rc 0/0 00000100:00100000:1.0:1788876622.086464:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2148 00000100:00100000:1.0:1788876622.089474:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.110242:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.129287:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511156096 00000100:00100000:1.0:1788876622.129298:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511156096 00000100:00100000:1.0:1788876622.129362:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2154 00000100:00100000:1.0:1788876622.129373:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+528:33371:x1875771511156096:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.129429:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.129455:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313abae6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704814e expref: 528 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129475:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe6:0x0].0x0 (ffff8a13eb32e200) 00010000:00010000:1.0:1788876622.129492:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313acf61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370484dc expref: 527 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129505:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d0bd4c00) 00010000:00010000:1.0:1788876622.129511:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.129534:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129546:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129555:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129568:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2b60594b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129576:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129583:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129722:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129732:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.129744:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.129950:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].51, 64 off11456 00010000:00010000:1.0:1788876622.129994:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130005:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130012:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130020:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130026:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130033:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313acf7d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xe6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130054:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.130070:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130076:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130082:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130090:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.130094:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130101:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130109:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe6:0x0].0x0 (ffff8a13fa77ab00) 00010000:00010000:1.0:1788876622.130111:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.130115:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130121:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acf76 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xe6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130135:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130140:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130146:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130152:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.130155:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130160:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130170:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.130172:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.130175:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130181:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acf68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.130193:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c433b5af reply state 00000000fa79f651 transno 68719477275 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130204:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.130210:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2b60594b (ffff8a13fa77a900) 00010000:00010000:1.0:1788876622.130212:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.130214:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.130297:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+528:33371:x1875771511156096:12345-192.168.203.11@tcp:36:rm.0 Request processed in 926us (1423us total) trans 68719477275 rc 0/0 00000100:00100000:1.0:1788876622.130305:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2154 00000100:00100000:1.0:1788876622.136913:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.153940:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.163918:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.167991:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.167994:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.167996:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.178400:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511157248 00000100:00100000:1.0:1788876622.178413:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511157248 00000100:00100000:1.0:1788876622.178528:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2160 00000100:00100000:1.0:1788876622.178550:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+531:33371:x1875771511157248:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.178636:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.178664:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313abb2c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704815c expref: 531 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178685:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe8:0x0].0x0 (ffff8a13cfe8fc00) 00010000:00010000:1.0:1788876622.178702:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313acfdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370484f1 expref: 530 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178711:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe54000) 00010000:00010000:1.0:1788876622.178717:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.178745:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178758:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178767:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178780:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178787:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178793:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178886:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178898:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.178906:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.179107:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].52, 64 off11520 00010000:00010000:1.0:1788876622.179155:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.179164:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.179173:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.179181:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.179187:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180685:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313acffb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xe8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180719:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.180748:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180755:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180765:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180771:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.180775:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180783:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180797:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xe8:0x0].0x0 (ffff8a13fa77ac00) 00010000:00010000:1.0:1788876622.180801:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.180805:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180812:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313acff4 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xe8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180835:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180842:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180847:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180852:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa4c2200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.180855:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180865:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180872:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.180874:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.180877:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180882:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2200/0xf5bf0f7e313acfe6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.180896:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000681ac1b4 reply state 0000000075aa6864 transno 68719477278 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180908:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.180916:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc97c73b6 (ffff8a13fa77a400) 00010000:00010000:1.0:1788876622.180918:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.180921:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.181008:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+531:33371:x1875771511157248:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2469us (3724us total) trans 68719477278 rc 0/0 00000100:00100000:1.0:1788876622.181017:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2160 00000100:00100000:1.0:1788876622.183967:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.210731:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.219786:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.221924:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.221932:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0800/0xf5bf0f7e313ad04f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.221943:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.222027:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0800/0xf5bf0f7e313ad04f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.222035:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0800/0xf5bf0f7e313ad04f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.222046:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xea:0x0].0x0 (ffff8a13d0bd4300) 00010000:00010000:1.0:1788876622.222048:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.222051:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0800/0xf5bf0f7e313ad04f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.222057:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0800/0xf5bf0f7e313ad04f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xea:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.222147:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.222150:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.222152:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.240240:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.244440:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.244446:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.244449:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.244982:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb240000, rc 0) 00000100:00100000:0.0:1788876622.245034:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+535:33371:x1875771511158528:12345-192.168.203.11@tcp:101:rm.0 Request processed in 325us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.245042:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2167 00000100:00100000:0.0:1788876622.252898:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511158912 00000100:00100000:0.0:1788876622.252908:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511158912 00000100:00100000:0.0:1788876622.252970:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2169 00000100:00100000:0.0:1788876622.252981:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+535:33371:x1875771511158912:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.253003:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.253026:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad0aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048514 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253098:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253109:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253119:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.253163:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.253167:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.253185:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253207:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad0aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048514 expref: 537 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253223:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048514 expref: 536 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.253246:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4157800) 00010000:00010000:0.0:1788876622.253248:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.253250:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb3fde00, rc 0) 00000100:00100000:0.0:1788876622.253315:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+536:33371:x1875771511158912:12345-192.168.203.11@tcp:101:rm.0 Request processed in 335us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.253323:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2169 00000100:00100000:1.0:1788876622.257291:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511159168 00000100:00100000:1.0:1788876622.257301:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511159168 00000100:00100000:1.0:1788876622.257395:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2170 00000100:00100000:1.0:1788876622.257406:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+536:33371:x1875771511159168:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.257462:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.257490:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313abbdb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704817f expref: 536 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257511:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xed:0x0].0x0 (ffff8a12c1a55800) 00010000:00010000:1.0:1788876622.257529:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb3fde00/0xf5bf0f7e313ad0b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048514 expref: 535 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257538:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4157800) 00010000:00010000:1.0:1788876622.257544:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.257568:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257582:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257592:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257748:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257757:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257764:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257860:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257870:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.257882:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.258247:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].55, 64 off11712 00010000:00010000:1.0:1788876622.258296:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258307:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258316:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258324:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258331:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258338:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad0cd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258403:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.258423:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258430:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258437:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258447:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.258452:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258460:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258470:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xed:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:1.0:1788876622.258473:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.258477:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258484:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad0c6 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xed:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258501:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258507:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258513:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258518:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.258521:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258527:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258538:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.258540:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.258543:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258549:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad0b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.258561:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d58a325c reply state 000000009ea9fdf8 transno 68719477283 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258572:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.258579:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e086f0c (ffff8a13fa77a600) 00010000:00010000:1.0:1788876622.258581:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.258584:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.258697:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+536:33371:x1875771511159168:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1293us (1767us total) trans 68719477283 rc 0/0 00000100:00100000:1.0:1788876622.258706:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2170 00000100:00100000:0.0:1788876622.261174:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511159296 00000100:00100000:0.0:1788876622.261182:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511159296 00000100:00100000:0.0:1788876622.261242:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2171 00000100:00100000:0.0:1788876622.261251:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+536:33371:x1875771511159296:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.261272:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.261296:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad0d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704851b expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261358:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261371:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261381:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.261421:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.261424:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.261439:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261463:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad0d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704851b expref: 538 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261478:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704851b expref: 537 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.261487:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4157500) 00010000:00010000:0.0:1788876622.261490:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.261493:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0400, rc 0) 00000100:00100000:0.0:1788876622.261533:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+537:33371:x1875771511159296:12345-192.168.203.11@tcp:101:rm.0 Request processed in 284us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.261539:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2171 00000100:00100000:0.0:1788876622.264429:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511159552 00000100:00100000:0.0:1788876622.264439:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511159552 00000100:00100000:0.0:1788876622.264497:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2172 00000100:00100000:0.0:1788876622.264507:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+537:33371:x1875771511159552:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.264558:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.264586:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313abbfe lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048186 expref: 537 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264651:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xee:0x0].0x0 (ffff8a12c1a55b00) 00010000:00010000:0.0:1788876622.264672:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad0db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704851b expref: 536 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264682:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4157500) 00010000:00010000:0.0:1788876622.264688:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.264714:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264726:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264735:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264748:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28685129 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264755:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264762:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264859:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264867:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.264874:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.265080:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].55, 64 off11712 00010000:00010000:0.0:1788876622.265121:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.265130:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.265141:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.265147:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.265153:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.265158:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266092:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876622.266098:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad0f7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266125:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266132:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266139:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266145:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.266149:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266155:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266170:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xee:0x0].0x0 (ffff8a13c12abe00) 00010000:00010000:0.0:1788876622.266172:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.266176:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266182:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad0f0 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266200:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266206:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266213:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266218:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.266221:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266227:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266246:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee8100) 00010000:00010000:0.0:1788876622.266249:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.266251:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266258:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad0e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.266274:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5541cda reply state 0000000076fb1262 transno 68719477284 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266284:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.266291:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28685129 (ffff8a13d9f51000) 00010000:00010000:0.0:1788876622.266293:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.266296:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.266373:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+537:33371:x1875771511159552:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1865us (2028us total) trans 68719477284 rc 0/0 00000100:00100000:0.0:1788876622.266381:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2172 00000100:00100000:0.0:1788876622.269286:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511159680 00000100:00100000:0.0:1788876622.269297:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511159680 00000100:00100000:0.0:1788876622.269361:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2173 00000100:00100000:0.0:1788876622.269372:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+537:33371:x1875771511159680:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.269396:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.269416:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11e00/0xf5bf0f7e313ad0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048522 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269489:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269502:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269515:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.269562:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.269566:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.269585:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269681:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11e00/0xf5bf0f7e313ad0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048522 expref: 539 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269699:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048522 expref: 538 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.269707:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c12ab100) 00010000:00010000:0.0:1788876622.269710:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.269712:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b10000, rc 0) 00000100:00100000:0.0:1788876622.269848:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+538:33371:x1875771511159680:12345-192.168.203.11@tcp:101:rm.0 Request processed in 477us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.269856:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2173 00010000:00010000:1.0:1788876622.269988:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.273292:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.282310:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511160064 00000100:00100000:0.0:1788876622.282319:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511160064 00000100:00100000:0.0:1788876622.282412:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2175 00000100:00100000:0.0:1788876622.282424:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+538:33371:x1875771511160064:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.282449:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.282471:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11e00/0xf5bf0f7e313ad128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048529 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282535:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282549:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282561:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.282642:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.282647:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.282667:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282692:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11e00/0xf5bf0f7e313ad128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048529 expref: 540 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282710:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048529 expref: 539 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.282719:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c12abe00) 00010000:00010000:0.0:1788876622.282722:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.282726:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b10e00, rc 0) 00000100:00100000:0.0:1788876622.282840:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+539:33371:x1875771511160064:12345-192.168.203.11@tcp:101:rm.0 Request processed in 419us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.282847:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2175 00000100:00100000:0.0:1788876622.286802:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511160320 00000100:00100000:0.0:1788876622.286812:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511160320 00000100:00100000:0.0:1788876622.286907:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2176 00000100:00100000:0.0:1788876622.286918:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+539:33371:x1875771511160320:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.286983:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.287012:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313abc44 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048194 expref: 539 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287031:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf0:0x0].0x0 (ffff8a13cfe8f900) 00010000:00010000:0.0:1788876622.287047:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10e00/0xf5bf0f7e313ad12f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048529 expref: 538 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287056:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c12abe00) 00010000:00010000:0.0:1788876622.287062:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.287097:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287111:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287121:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287135:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287143:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287150:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287270:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287279:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287287:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.287510:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].56, 64 off11776 00010000:00010000:0.0:1788876622.287558:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287568:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287577:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287585:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287592:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287598:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ad14b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287662:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.287681:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287688:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287695:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287705:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.287710:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287718:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287728:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf0:0x0].0x0 (ffff8a13fa4ad900) 00010000:00010000:0.0:1788876622.287731:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.287734:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287741:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10200/0xf5bf0f7e313ad144 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287756:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287763:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287770:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287775:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.287778:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287785:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287796:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c12ab100) 00010000:00010000:0.0:1788876622.287798:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.287801:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287807:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11400/0xf5bf0f7e313ad136 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.287819:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f53d4829 reply state 00000000ca77415d transno 68719477286 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287829:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.287835:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9da35f0f (ffff8a13cfee8100) 00010000:00010000:0.0:1788876622.287837:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.287840:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.287910:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+539:33371:x1875771511160320:12345-192.168.203.11@tcp:36:rm.0 Request processed in 993us (1389us total) trans 68719477286 rc 0/0 00000100:00100000:0.0:1788876622.287918:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2176 00000100:00100000:1.0:1788876622.291030:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511160448 00000100:00100000:1.0:1788876622.291039:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511160448 00000100:00100000:1.0:1788876622.291173:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2177 00000100:00100000:1.0:1788876622.291184:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+539:33371:x1875771511160448:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876622.291206:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876622.291228:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048530 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291312:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291326:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291338:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876622.291380:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876622.291383:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876622.291400:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291424:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048530 expref: 541 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291441:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048530 expref: 540 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.291449:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.291452:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876622.291455:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8a00, rc 0) 00000100:00100000:1.0:1788876622.291512:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+540:33371:x1875771511160448:12345-192.168.203.11@tcp:101:rm.0 Request processed in 331us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.291519:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2177 00000100:00100000:0.0:1788876622.297576:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511160704 00000100:00100000:0.0:1788876622.297586:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511160704 00000100:00100000:0.0:1788876622.297865:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2178 00000100:00100000:0.0:1788876622.297875:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+540:33371:x1875771511160704:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.297936:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.298131:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313abc67 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704819b expref: 540 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298159:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf1:0x0].0x0 (ffff8a13cfe8f200) 00010000:00010000:0.0:1788876622.298179:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad159 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048530 expref: 539 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298189:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:0.0:1788876622.298195:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.298219:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298243:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298253:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298266:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298273:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298279:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298373:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298382:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.298393:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.298587:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].57, 64 off11840 00010000:00010000:0.0:1788876622.298935:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299004:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299015:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299023:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299030:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299036:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299152:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.299175:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299182:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299189:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299200:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.299205:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299213:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299223:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf1:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:0.0:1788876622.299226:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.299230:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299247:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52e00/0xf5bf0f7e313ad16e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299263:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299269:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299275:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299279:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.299282:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299288:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299299:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:0.0:1788876622.299301:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.299304:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299310:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ad160 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.299323:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017fd1ab2 reply state 00000000e87884b1 transno 68719477287 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299333:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.299339:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf6c27508 (ffff8a13fa4ad100) 00010000:00010000:0.0:1788876622.299341:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.299343:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.299419:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+540:33371:x1875771511160704:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1544us (1945us total) trans 68719477287 rc 0/0 00000100:00100000:0.0:1788876622.299426:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2178 00000100:00100000:0.0:1788876622.305374:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511161088 00000100:00100000:0.0:1788876622.305384:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511161088 00000100:00100000:0.0:1788876622.305444:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2180 00000100:00100000:0.0:1788876622.305454:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+541:33371:x1875771511161088:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.305503:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.305529:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aa098 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c00 expref: 541 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305558:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2c:0x0].0x0 (ffff8a13d9f5b400) 00010000:00010000:0.0:1788876622.305574:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313ad183 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048537 expref: 540 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305584:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb32eb00) 00010000:00010000:0.0:1788876622.305590:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.305654:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305667:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305677:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305691:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305698:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305705:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305801:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305809:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.305820:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.306033:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].57, 64 off11840 00010000:00010000:0.0:1788876622.306159:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.306169:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.306177:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.306185:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.306192:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.306199:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306586:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.306595:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306787:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c580c600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.306793:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306801:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306811:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf1:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:1.0:1788876622.306813:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.306817:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306823:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad175 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xf1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306839:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.306843:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306848:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1ce00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.306851:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306857:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 5/0,0 mode: PW/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306863:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2c:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:1.0:1788876622.306866:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.306869:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 3/0,0 mode: --/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.306878:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.306880:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.306882:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.306974:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876622.306980:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad19f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307005:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307011:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307019:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307023:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.307027:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307033:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307041:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2c:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:0.0:1788876622.307043:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.307046:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307051:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbc00/0xf5bf0f7e313ad198 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307067:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307173:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307179:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307184:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eff0fe00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.307187:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307196:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307204:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.307206:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.307209:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307215:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fe00/0xf5bf0f7e313ad18a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.307228:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008405affc reply state 00000000e3c960ba transno 68719477288 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307248:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.307254:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fefa0a6 (ffff8a13fa4ad300) 00010000:00010000:0.0:1788876622.307256:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.307259:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.307337:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+541:33371:x1875771511161088:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1883us (2051us total) trans 68719477288 rc 0/0 00000100:00100000:0.0:1788876622.307345:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2180 00000100:00100000:0.0:1788876622.309476:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511161216 00000100:00100000:0.0:1788876622.309485:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511161216 00000100:00100000:0.0:1788876622.309537:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2181 00000100:00100000:0.0:1788876622.309547:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+541:33371:x1875771511161216:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.309567:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.309589:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad1a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704853e expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309679:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309691:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309702:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.309741:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.309744:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.309762:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309784:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad1a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704853e expref: 543 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309800:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704853e expref: 542 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.309808:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876622.309810:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.309813:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1ca00, rc 0) 00000100:00100000:0.0:1788876622.309861:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+542:33371:x1875771511161216:12345-192.168.203.11@tcp:101:rm.0 Request processed in 315us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.309867:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2181 00000100:00100000:0.0:1788876622.312645:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.312749:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511161472 00000100:00100000:1.0:1788876622.312759:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511161472 00000100:00100000:1.0:1788876622.312810:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2182 00000100:00100000:1.0:1788876622.312819:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+542:33371:x1875771511161472:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.312869:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.312893:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313aa3ee lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047cb6 expref: 542 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.312912:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3e:0x0].0x0 (ffff8a13fa64b300) 00010000:00010000:1.0:1788876622.312929:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad1ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704853e expref: 541 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.312938:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:1.0:1788876622.312957:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.312982:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.312995:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313005:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313017:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313028:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313035:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313247:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313257:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313265:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.313480:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].58, 64 off11904 00010000:00010000:1.0:1788876622.313526:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313536:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313545:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313552:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313560:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.313567:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.314107:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876622.314113:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad1c9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314195:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314203:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314209:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314215:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.314219:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314225:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314243:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3e:0x0].0x0 (ffff8a13fa77ab00) 00010000:00010000:0.0:1788876622.314246:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.314249:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314254:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad1c2 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314275:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314281:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314287:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314293:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.314296:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314303:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314311:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:0.0:1788876622.314314:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.314317:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314323:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad1b4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.314335:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d717e9ae reply state 0000000097d7a1a8 transno 68719477289 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314346:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.314353:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a5239e9 (ffff8a13fa77ac00) 00010000:00010000:0.0:1788876622.314356:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.314358:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.314436:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+542:33371:x1875771511161472:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1616us (1838us total) trans 68719477289 rc 0/0 00000100:00100000:0.0:1788876622.314445:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2182 00000100:00100000:1.0:1788876622.317054:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.317398:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511161600 00000100:00100000:0.0:1788876622.317408:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511161600 00000100:00100000:0.0:1788876622.317497:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2183 00000100:00100000:0.0:1788876622.317507:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+542:33371:x1875771511161600:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.317527:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.317547:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad1d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048545 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317645:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317659:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317670:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.317713:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.317716:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.317734:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317758:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad1d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048545 expref: 544 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317774:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048545 expref: 543 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.317783:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:0.0:1788876622.317786:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.317789:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1c600, rc 0) 00000100:00100000:0.0:1788876622.317840:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+543:33371:x1875771511161600:12345-192.168.203.11@tcp:101:rm.0 Request processed in 334us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.317847:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2183 00000100:00100000:1.0:1788876622.321281:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511161856 00000100:00100000:1.0:1788876622.321292:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511161856 00000100:00100000:1.0:1788876622.321358:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2184 00000100:00100000:1.0:1788876622.321369:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+543:33371:x1875771511161856:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.321431:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.321459:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52400/0xf5bf0f7e313abc8a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370481a2 expref: 543 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321482:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf2:0x0].0x0 (ffff8a12c1a55300) 00010000:00010000:1.0:1788876622.321498:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad1d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048545 expref: 542 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321507:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:1.0:1788876622.321515:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.321538:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321550:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321559:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321574:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd765e03c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321583:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321589:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321802:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321812:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.321819:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.322288:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].59, 64 off11968 00010000:00010000:1.0:1788876622.322336:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322346:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322355:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322362:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322370:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322377:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad1f3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322473:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.322493:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322499:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322506:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322511:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.322516:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322523:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322532:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf2:0x0].0x0 (ffff8a13fa77aa00) 00010000:00010000:1.0:1788876622.322535:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.322539:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322544:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad1ec lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322561:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322567:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322573:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322579:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.322582:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322588:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322596:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a500) 00010000:00010000:1.0:1788876622.322599:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.322633:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322639:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad1de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.322654:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de2c523 reply state 000000002a42d0c3 transno 68719477290 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322665:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.322672:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd765e03c (ffff8a13fa77a800) 00010000:00010000:1.0:1788876622.322674:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.322677:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.322749:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+543:33371:x1875771511161856:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1380us (1944us total) trans 68719477290 rc 0/0 00000100:00100000:1.0:1788876622.322756:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2184 00000100:00100000:1.0:1788876622.325764:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.329475:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.331497:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.331501:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.331503:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.336177:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.340453:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.344898:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.344983:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511162752 00000100:00100000:0.0:1788876622.344992:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511162752 00000100:00100000:0.0:1788876622.345047:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2189 00000100:00100000:0.0:1788876622.345056:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+545:33371:x1875771511162752:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.345087:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.345109:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad24e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704855a expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345171:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345184:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345195:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.345247:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.345250:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.345269:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345294:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad24e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704855a expref: 547 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345310:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704855a expref: 546 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.345319:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.345322:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.345326:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1c800, rc 0) 00000100:00100000:0.0:1788876622.345384:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+546:33371:x1875771511162752:12345-192.168.203.11@tcp:101:rm.0 Request processed in 329us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.345392:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2189 00000100:00100000:1.0:1788876622.349532:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.349626:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511163008 00000100:00100000:0.0:1788876622.349638:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511163008 00000100:00100000:0.0:1788876622.349698:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2190 00000100:00100000:0.0:1788876622.349709:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+546:33371:x1875771511163008:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.349763:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.349789:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cff5ae00/0xf5bf0f7e313abcf3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370481b7 expref: 546 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349809:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf5:0x0].0x0 (ffff8a13cfee7d00) 00010000:00010000:0.0:1788876622.349825:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad255 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704855a expref: 545 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349833:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.349840:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.349863:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349875:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349886:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349898:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28fce2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349905:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.349912:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350142:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350152:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350160:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.350379:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].59, 64 off11968 00010000:00010000:0.0:1788876622.350428:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350438:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350447:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350455:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350463:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350470:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad271 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350488:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.350505:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350512:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350519:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350525:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.350529:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350537:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350545:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf5:0x0].0x0 (ffff8a13fa4ad500) 00010000:00010000:0.0:1788876622.350548:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.350552:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350558:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad26a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350571:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350578:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350588:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350593:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1ce00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.350597:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350754:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350764:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:0.0:1788876622.350766:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.350770:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350776:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad25c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.350789:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb9345f3 reply state 000000005c792ede transno 68719477293 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350800:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.350807:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fce2 (ffff8a13fa4adf00) 00010000:00010000:0.0:1788876622.350810:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.350812:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.351471:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+546:33371:x1875771511163008:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1760us (1947us total) trans 68719477293 rc 0/0 00000100:00100000:1.0:1788876622.351481:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2190 00000100:00100000:1.0:1788876622.354259:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.354341:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511163136 00000100:00100000:0.0:1788876622.354351:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511163136 00000100:00100000:0.0:1788876622.354445:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2191 00000100:00100000:0.0:1788876622.354455:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+546:33371:x1875771511163136:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.354478:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.354501:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048561 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354560:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad27f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354574:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354585:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.354812:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.354816:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.354837:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354862:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048561 expref: 548 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354879:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad27f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048561 expref: 547 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.354888:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876622.354890:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.354893:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1c600, rc 0) 00000100:00100000:0.0:1788876622.354955:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+547:33371:x1875771511163136:12345-192.168.203.11@tcp:101:rm.0 Request processed in 489us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.354962:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2191 00010000:00010000:1.0:1788876622.359428:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.359435:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad29b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.359441:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.359444:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad29b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.359451:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad29b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.359459:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf6:0x0].0x0 (ffff8a13d0bd4800) 00010000:00010000:1.0:1788876622.359461:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.359465:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad29b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xf6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.359469:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad29b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xf6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.359483:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.359485:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.359487:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.374357:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.374368:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62c00/0xf5bf0f7e313ad2c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.374378:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e1f62c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.374381:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62c00/0xf5bf0f7e313ad2c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.374390:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62c00/0xf5bf0f7e313ad2c5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.374407:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf7:0x0].0x0 (ffff8a13f4157500) 00010000:00010000:1.0:1788876622.374410:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.374415:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62c00/0xf5bf0f7e313ad2c5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.374421:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62c00/0xf5bf0f7e313ad2c5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xf7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.374437:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.374439:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.374440:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.374912:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.375062:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511163904 00000100:00100000:0.0:1788876622.375132:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511163904 00000100:00100000:0.0:1788876622.375217:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2195 00000100:00100000:0.0:1788876622.375227:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+548:33371:x1875771511163904:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.375257:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.375275:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704856f expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375335:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375348:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375358:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.375399:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.375402:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.375419:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375442:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704856f expref: 550 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375456:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704856f expref: 549 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.375464:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:0.0:1788876622.375466:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.375469:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1ce00, rc 0) 00000100:00100000:0.0:1788876622.375562:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+549:33371:x1875771511163904:12345-192.168.203.11@tcp:101:rm.0 Request processed in 336us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.375570:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2195 00000100:00100000:0.0:1788876622.380144:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.380228:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511164160 00000100:00100000:1.0:1788876622.380247:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511164160 00000100:00100000:1.0:1788876622.380339:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2196 00000100:00100000:1.0:1788876622.380351:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+549:33371:x1875771511164160:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.380401:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.380426:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53a00/0xf5bf0f7e313abd5c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370481cc expref: 549 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380448:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf8:0x0].0x0 (ffff8a12c1a55900) 00010000:00010000:1.0:1788876622.380466:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad2d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704856f expref: 548 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380475:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:1.0:1788876622.380481:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.380505:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380516:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380525:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380538:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380544:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380551:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380910:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380920:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.380932:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.381150:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].62, 64 off12160 00010000:00010000:1.0:1788876622.381219:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381229:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381248:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381256:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381263:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381269:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381331:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.381349:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381356:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381363:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381374:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.381378:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381386:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381395:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf8:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:1.0:1788876622.381398:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.381402:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381408:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad2e8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381423:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381429:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381435:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381440:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.381443:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381449:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381460:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a500) 00010000:00010000:1.0:1788876622.381463:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.381466:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381471:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad2da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.381483:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a837bfbc reply state 00000000c3820dee transno 68719477296 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381493:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.381500:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4023c2e5 (ffff8a13fa77aa00) 00010000:00010000:1.0:1788876622.381503:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.381505:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.381572:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+549:33371:x1875771511164160:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1223us (1505us total) trans 68719477296 rc 0/0 00000100:00100000:1.0:1788876622.381581:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2196 00010000:00010000:0.0:1788876622.387672:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.387686:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.387697:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.387702:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.387710:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.387727:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf8:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:0.0:1788876622.387730:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.387736:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.387743:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad2ef lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xf8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.387768:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.387770:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.387772:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.388429:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.388514:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511164544 00000100:00100000:0.0:1788876622.388523:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511164544 00000100:00100000:0.0:1788876622.388639:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2198 00000100:00100000:0.0:1788876622.388650:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+550:33371:x1875771511164544:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.388715:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.388737:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3c7ae00/0xf5bf0f7e313abd7f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xf9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370481d3 expref: 550 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388752:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf9:0x0].0x0 (ffff8a13fa569600) 00010000:00010000:0.0:1788876622.388767:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e1f62800/0xf5bf0f7e313ad2fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048576 expref: 549 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388776:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4157800) 00010000:00010000:0.0:1788876622.388783:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.388810:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388822:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388832:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388846:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa05052df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388853:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388860:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388974:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388986:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.388994:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.389245:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].61, 64 off12096 00010000:00010000:0.0:1788876622.389291:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389299:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389307:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389314:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389320:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389326:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389345:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.389361:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389367:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389377:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389383:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.389387:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389394:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389401:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf9:0x0].0x0 (ffff8a13fa4ad700) 00010000:00010000:0.0:1788876622.389404:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.389407:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389413:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad312 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xf9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389428:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389434:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389438:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389443:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1da00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.389445:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389455:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389461:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.389464:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.389466:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389471:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1da00/0xf5bf0f7e313ad304 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.389483:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e925949d reply state 00000000c6db20f1 transno 68719477297 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389494:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.389501:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa05052df (ffff8a13fa4ada00) 00010000:00010000:0.0:1788876622.389504:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.389506:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.389585:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+550:33371:x1875771511164544:12345-192.168.203.11@tcp:36:rm.0 Request processed in 935us (1159us total) trans 68719477297 rc 0/0 00000100:00100000:0.0:1788876622.389593:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2198 00010000:00010000:1.0:1788876622.391797:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.391809:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.391820:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.391825:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.391834:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.391853:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xf9:0x0].0x0 (ffff8a13fa4ad700) 00010000:00010000:1.0:1788876622.391856:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.391861:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.391867:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad319 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xf9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.391893:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.391895:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.391897:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.396262:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.407819:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.407906:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511165312 00000100:00100000:1.0:1788876622.407918:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511165312 00000100:00100000:1.0:1788876622.408036:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2202 00000100:00100000:1.0:1788876622.408047:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+552:33371:x1875771511165312:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.408112:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.408143:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cff5bc00/0xf5bf0f7e313abdc5 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0xfb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370481e1 expref: 552 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408163:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfb:0x0].0x0 (ffff8a13e798cf00) 00010000:00010000:1.0:1788876622.408180:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048584 expref: 551 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408197:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d0bd4200) 00010000:00010000:1.0:1788876622.408204:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.408229:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408250:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408260:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408273:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79af08ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408280:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408285:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408386:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408394:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.408402:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.408885:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].62, 64 off12160 00010000:00010000:1.0:1788876622.408939:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409017:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409028:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409036:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409041:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409047:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409109:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.409130:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409137:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409144:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409149:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.409153:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409161:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409172:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfb:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.409175:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.409179:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409189:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad366 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xfb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409204:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409210:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409214:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409218:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.409221:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409226:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409242:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a500) 00010000:00010000:1.0:1788876622.409244:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.409247:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409252:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad358 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.409265:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2eb5fe2 reply state 0000000076ba645f transno 68719477299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409275:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.409281:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79af08ee (ffff8a13fa77ab00) 00010000:00010000:1.0:1788876622.409283:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.409285:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.409374:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+552:33371:x1875771511165312:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1324us (1562us total) trans 68719477299 rc 0/0 00000100:00100000:1.0:1788876622.409382:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2202 00010000:00010000:0.0:1788876622.413154:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.413170:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.413182:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.413187:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.413197:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.413216:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfb:0x0].0x0 (ffff8a13fa77a000) 00010000:00010000:0.0:1788876622.413220:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.413225:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.413242:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad36d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xfb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.413268:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.413270:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.413272:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.414111:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.425462:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.425469:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad397 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.425483:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1402044a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.425487:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad397 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.425494:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad397 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.425503:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3f:0x0].0x0 (ffff8a12c1a55300) 00010000:00010000:0.0:1788876622.425505:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.425508:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad397 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.425513:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad397 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.425527:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.425529:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.425530:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.429473:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.432957:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.434633:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.434640:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3c1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.434646:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.434650:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3c1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.434657:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3c1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xfc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.434667:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfc:0x0].0x0 (ffff8a12c1a55800) 00010000:00010000:1.0:1788876622.434669:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.434672:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3c1 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xfc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.434677:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3c1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xfc:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.434691:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.434693:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.434695:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.436800:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.445106:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000040:00080000:0.0:1788876622.445935:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].64, 64 off12288 00010000:00010000:0.0:1788876622.445992:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446001:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446010:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446017:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446023:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446029:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad3eb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xfd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446051:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.446069:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446075:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446081:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446087:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1402044200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.446091:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446098:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446107:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfd:0x0].0x0 (ffff8a12c1a55100) 00010000:00010000:0.0:1788876622.446110:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.446114:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446120:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044200/0xf5bf0f7e313ad3e4 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0xfd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446135:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446140:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446145:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446150:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.446152:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446158:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446169:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55c00) 00010000:00010000:0.0:1788876622.446171:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.446174:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446180:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ad3d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.446193:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000799e0533 reply state 00000000e18ecabf transno 68719477302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446204:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.446210:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2faaf6c3 (ffff8a12c1a55a00) 00010000:00010000:0.0:1788876622.446212:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.446214:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.446343:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+555:33371:x1875771511166464:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1019us (1245us total) trans 68719477302 rc 0/0 00000100:00100000:0.0:1788876622.446350:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2208 00000100:00100000:0.0:1788876622.462174:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.471312:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.473447:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.473455:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad415 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.473462:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.473465:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad415 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xfe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.473473:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad415 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xfe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.473485:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xfe:0x0].0x0 (ffff8a13d0bd4300) 00010000:00010000:0.0:1788876622.473487:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.473491:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad415 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xfe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.473498:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad415 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xfe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.473514:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.473515:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.473517:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.477185:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.481551:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.484055:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.484063:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad43f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.484147:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.484151:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad43f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0xff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.484160:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad43f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0xff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.484170:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0xff:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:1.0:1788876622.484173:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.484177:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad43f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0xff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.484183:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1600/0xf5bf0f7e313ad43f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0xff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.484265:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.484268:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.484269:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.492723:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.492847:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511167616 00000100:00100000:1.0:1788876622.492857:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511167616 00000100:00100000:1.0:1788876622.492918:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2214 00000100:00100000:1.0:1788876622.492929:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+558:33371:x1875771511167616:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.493000:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.493030:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cff5be00/0xf5bf0f7e313abe74 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x100:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048204 expref: 558 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493051:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x100:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:1.0:1788876622.493065:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1200/0xf5bf0f7e313ad44d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485ae expref: 557 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493078:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d0bd4300) 00010000:00010000:1.0:1788876622.493084:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.493109:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493122:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493132:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493143:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6343e426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493150:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493156:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493365:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493375:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.493388:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.493583:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].66, 64 off12416 00010000:00010000:1.0:1788876622.495356:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495376:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495387:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495397:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495405:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495412:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495430:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.495449:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495456:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495463:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495474:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.495479:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495486:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495497:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x100:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:1.0:1788876622.495499:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.495504:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495509:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad462 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x100:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495529:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495535:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495541:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495546:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.495549:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495556:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495568:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77a500) 00010000:00010000:1.0:1788876622.495571:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.495574:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495581:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad454 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.495596:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038c39104 reply state 00000000cdc971d3 transno 68719477305 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495965:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.495971:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6343e426 (ffff8a13fa77a000) 00010000:00010000:1.0:1788876622.495973:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.495977:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.496073:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+558:33371:x1875771511167616:12345-192.168.203.11@tcp:36:rm.0 Request processed in 3142us (3358us total) trans 68719477305 rc 0/0 00000100:00100000:1.0:1788876622.496082:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2214 00010000:00010000:0.0:1788876622.496176:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.496183:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.496190:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.496193:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.496213:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.496224:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x100:0x0].0x0 (ffff8a13fa77a200) 00010000:00010000:0.0:1788876622.496226:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.496238:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.496245:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad469 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x100:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.496260:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.496262:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.496264:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.500059:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.504525:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511168000 00000100:00100000:0.0:1788876622.504534:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511168000 00000100:00100000:0.0:1788876622.504591:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2216 00000100:00100000:0.0:1788876622.504631:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+559:33371:x1875771511168000:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.504687:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.504712:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313abe97 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x101:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704820b expref: 559 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504731:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x101:0x0].0x0 (ffff8a12c1a55200) 00010000:00010000:0.0:1788876622.504747:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0000/0xf5bf0f7e313ad477 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485b5 expref: 558 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504762:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d0bd4800) 00010000:00010000:0.0:1788876622.504769:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.504792:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504804:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504813:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504824:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4f838975 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504836:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504843:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504929:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504938:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.504958:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.505160:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].66, 64 off12416 00010000:00010000:0.0:1788876622.505206:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505215:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505223:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505240:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505247:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505253:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505272:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.505288:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505295:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505302:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505307:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.505311:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505319:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505326:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x101:0x0].0x0 (ffff8a13fa4ad700) 00010000:00010000:0.0:1788876622.505329:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.505332:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505338:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad48c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x101:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505352:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505358:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505369:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505373:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.505376:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505382:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505388:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.505391:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.505393:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505399:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad47e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.505411:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d95fd1b reply state 00000000a17a9b47 transno 68719477306 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505422:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.505427:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f838975 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876622.505430:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.505432:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.505499:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+559:33371:x1875771511168000:12345-192.168.203.11@tcp:36:rm.0 Request processed in 898us (1059us total) trans 68719477306 rc 0/0 00000100:00100000:0.0:1788876622.505506:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2216 00010000:00010000:1.0:1788876622.505784:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.505791:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.505797:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.505801:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.505807:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.505818:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x101:0x0].0x0 (ffff8a13fa4ad700) 00010000:00010000:1.0:1788876622.505820:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.505823:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.505830:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad493 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x101:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.505843:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.505845:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.505847:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.508594:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.508923:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511168128 00000100:00100000:1.0:1788876622.508932:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511168128 00000100:00100000:1.0:1788876622.508993:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2217 00000100:00100000:1.0:1788876622.509004:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0b03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+559:33371:x1875771511168128:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876622.509026:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876622.509048:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad49a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370485bc expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509121:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509133:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509144:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876622.509184:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876622.509189:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876622.509208:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509242:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ad49a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485bc expref: 561 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509260:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485bc expref: 560 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.509268:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:1.0:1788876622.509271:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876622.509274:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:1.0:1788876622.509320:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0b03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+560:33371:x1875771511168128:12345-192.168.203.11@tcp:101:rm.0 Request processed in 318us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.509326:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2217 00000100:00100000:1.0:1788876622.514215:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511168384 00000100:00100000:1.0:1788876622.514225:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511168384 00000100:00100000:1.0:1788876622.514293:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2218 00000100:00100000:1.0:1788876622.514305:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+560:33371:x1875771511168384:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.514367:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.514396:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cff5b400/0xf5bf0f7e313abeba lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x102:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048212 expref: 560 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514414:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x102:0x0].0x0 (ffff8a13e798c400) 00010000:00010000:1.0:1788876622.514429:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad4a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485bc expref: 559 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514444:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:1.0:1788876622.514449:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.514473:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514486:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514494:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514506:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514512:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514519:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514667:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514675:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514682:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.514871:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].67, 64 off12480 00010000:00010000:1.0:1788876622.514915:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514926:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514934:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514941:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514947:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514953:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad4bd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x102:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.514977:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.514993:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515000:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515007:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515013:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.515017:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515025:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515037:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x102:0x0].0x0 (ffff8a13e798cf00) 00010000:00010000:1.0:1788876622.515040:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.515044:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515049:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad4b6 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x102:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515064:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515070:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515075:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515080:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.515083:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515088:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515095:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:1.0:1788876622.515097:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.515099:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515104:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad4a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.515119:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c456d441 reply state 00000000449f25db transno 68719477307 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515127:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.515133:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ceb4373 (ffff8a13e798c900) 00010000:00010000:1.0:1788876622.515135:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.515137:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.515202:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+560:33371:x1875771511168384:12345-192.168.203.11@tcp:36:rm.0 Request processed in 898us (1079us total) trans 68719477307 rc 0/0 00000100:00100000:1.0:1788876622.515210:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2218 00000100:00100000:0.0:1788876622.523832:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.529781:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.529796:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad4e7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x103:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.529808:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.529812:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad4e7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x103:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.529822:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad4e7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x103:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.529841:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x103:0x0].0x0 (ffff8a13d0bd4300) 00010000:00010000:1.0:1788876622.529844:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.529849:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad4e7 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x103:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.529854:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad4e7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x103:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.530025:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.530028:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.530030:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.532043:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.541168:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511169152 00000100:00100000:1.0:1788876622.541178:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511169152 00000100:00100000:1.0:1788876622.541247:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2222 00000100:00100000:1.0:1788876622.541258:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+562:33371:x1875771511169152:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.541311:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.541340:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52200/0xf5bf0f7e313abf00 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x104:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048220 expref: 562 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541360:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x104:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:1.0:1788876622.541374:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1200/0xf5bf0f7e313ad4f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485ca expref: 561 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541387:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae15900) 00010000:00010000:1.0:1788876622.541393:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.541416:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541429:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541439:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541559:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541569:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541582:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541716:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541725:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541733:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.541930:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].68, 64 off12544 00010000:00010000:1.0:1788876622.541979:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541988:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.541997:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542004:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542010:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542016:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542030:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.542045:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542052:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542059:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542065:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.542069:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542077:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542086:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x104:0x0].0x0 (ffff8a13e798cf00) 00010000:00010000:1.0:1788876622.542088:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.542092:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542098:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad50a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x104:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542115:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542121:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542127:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542137:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f415e400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.542140:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542147:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542153:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:1.0:1788876622.542155:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.542158:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542164:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad4fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.542174:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000778a8ffd reply state 000000008b547cd5 transno 68719477309 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542185:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.542191:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa275fc18 (ffff8a13e798c400) 00010000:00010000:1.0:1788876622.542193:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.542196:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.542271:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+562:33371:x1875771511169152:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1014us (1219us total) trans 68719477309 rc 0/0 00000100:00100000:1.0:1788876622.542279:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2222 00010000:00010000:0.0:1788876622.542520:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.542528:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.542535:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.542538:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.542555:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.542565:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x104:0x0].0x0 (ffff8a13e798cf00) 00010000:00010000:0.0:1788876622.542568:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.542571:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.542578:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad511 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x104:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.542591:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.542593:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.542595:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.545410:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.559300:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.560490:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.560499:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fea00/0xf5bf0f7e313ad53b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x105:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.560507:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5fea00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.560511:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fea00/0xf5bf0f7e313ad53b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x105:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.560519:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fea00/0xf5bf0f7e313ad53b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x105:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.560528:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x105:0x0].0x0 (ffff8a12c1a55c00) 00010000:00010000:0.0:1788876622.560531:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.560535:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fea00/0xf5bf0f7e313ad53b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x105:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.560540:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fea00/0xf5bf0f7e313ad53b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x105:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.560553:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.560555:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.560557:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.571242:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511169664 00000100:00100000:1.0:1788876622.571252:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511169664 00000100:00100000:1.0:1788876622.571315:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2225 00000100:00100000:1.0:1788876622.571326:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+563:33371:x1875771511169664:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876622.571349:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876622.571370:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370485d8 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571436:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571452:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571465:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876622.571510:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876622.571514:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876622.571532:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571556:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ad542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485d8 expref: 565 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571574:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485d8 expref: 564 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.571583:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:1.0:1788876622.571586:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876622.571589:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:0.0:1788876622.572143:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+564:33371:x1875771511169664:12345-192.168.203.11@tcp:101:rm.0 Request processed in 816us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.572151:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2225 00000100:00100000:0.0:1788876622.580144:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511169920 00000100:00100000:0.0:1788876622.580155:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511169920 00000100:00100000:0.0:1788876622.580215:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2226 00000100:00100000:0.0:1788876622.580224:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+564:33371:x1875771511169920:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.580283:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.580310:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa786000/0xf5bf0f7e313aa434 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047cc4 expref: 564 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580332:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x40:0x0].0x0 (ffff8a13f5612e00) 00010000:00010000:0.0:1788876622.580347:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ad549 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485d8 expref: 563 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580357:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:0.0:1788876622.580362:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.580387:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580399:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580409:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580419:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580426:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580432:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580530:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580539:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.580550:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.582015:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].69, 64 off12608 00010000:00010000:0.0:1788876622.582092:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582109:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582120:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582129:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582136:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582143:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582240:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.582269:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582274:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582280:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582288:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.582292:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582299:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582310:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x40:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876622.582313:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.582317:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582322:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad55e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582338:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582344:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582350:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582355:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.582357:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582362:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582372:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.582375:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.582377:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582382:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad550 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.582397:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d246005d reply state 0000000051610b2d transno 68719477311 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582408:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.582414:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1613f0e7 (ffff8a13fa4ad200) 00010000:00010000:0.0:1788876622.582415:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.582418:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.582509:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+564:33371:x1875771511169920:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2279us (2620us total) trans 68719477311 rc 0/0 00000100:00100000:0.0:1788876622.582519:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2226 00010000:00010000:1.0:1788876622.583825:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.583833:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.583844:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.583849:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.583856:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.583868:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x40:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:1.0:1788876622.583870:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.583874:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.583880:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d600/0xf5bf0f7e313ad565 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.583961:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.583964:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.583965:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.596843:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511170304 00000100:00100000:0.0:1788876622.596854:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511170304 00000100:00100000:0.0:1788876622.596922:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2228 00000100:00100000:0.0:1788876622.596932:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+565:33371:x1875771511170304:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.596987:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.597013:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313abf46 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x106:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704822e expref: 565 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597032:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x106:0x0].0x0 (ffff8a13eb147c00) 00010000:00010000:0.0:1788876622.597048:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad573 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485df expref: 564 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597057:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:0.0:1788876622.597065:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.597089:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597102:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597112:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597123:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597131:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597137:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597226:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597246:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597258:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.597455:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].70, 64 off12672 00010000:00010000:0.0:1788876622.597517:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597527:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597535:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597542:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597548:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.597553:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ca00/0xf5bf0f7e313ad58f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x106:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599527:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.599558:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599568:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599575:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599585:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.599590:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599598:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599639:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x106:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:0.0:1788876622.599642:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.599647:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599653:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad588 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x106:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599673:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599678:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599684:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599688:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.599691:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599697:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599709:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.599711:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.599714:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599721:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad57a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.599738:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a3315c3 reply state 000000009bb2e78e transno 68719477312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599749:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.599757:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a18c73a (ffff8a13fa4ad500) 00010000:00010000:0.0:1788876622.599759:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.599762:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.599851:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+565:33371:x1875771511170304:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2917us (3132us total) trans 68719477312 rc 0/0 00000100:00100000:0.0:1788876622.599860:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2228 00000100:00100000:0.0:1788876622.602415:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.617295:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.617309:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1000/0xf5bf0f7e313ad5b9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.617319:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.617323:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1000/0xf5bf0f7e313ad5b9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.617333:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1000/0xf5bf0f7e313ad5b9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.617352:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x41:0x0].0x0 (ffff8a13d0bd4c00) 00010000:00010000:0.0:1788876622.617355:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.617360:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1000/0xf5bf0f7e313ad5b9 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.617365:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1000/0xf5bf0f7e313ad5b9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.617388:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.617390:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.617392:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.618153:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.618455:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511170816 00000100:00100000:0.0:1788876622.618464:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511170816 00000100:00100000:0.0:1788876622.618523:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2231 00000100:00100000:0.0:1788876622.618532:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+566:33371:x1875771511170816:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.618565:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.618586:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370485ed expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.618830:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad5c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.618846:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.618857:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.618906:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.618911:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.618929:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.618963:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c800/0xf5bf0f7e313ad5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485ed expref: 568 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.619050:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c400/0xf5bf0f7e313ad5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485ed expref: 567 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.619059:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876622.619062:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.619065:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fbd1c400, rc 0) 00000100:00100000:0.0:1788876622.619285:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+567:33371:x1875771511170816:12345-192.168.203.11@tcp:101:rm.0 Request processed in 751us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.619292:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2231 00000100:00100000:1.0:1788876622.627575:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.636771:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.636780:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad5e3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.636787:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.636791:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad5e3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.636800:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad5e3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.636813:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x42:0x0].0x0 (ffff8a13fae15300) 00010000:00010000:0.0:1788876622.636816:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876622.636820:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad5e3 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.636827:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0200/0xf5bf0f7e313ad5e3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788876622.637314:0:43289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477314 is committed 00000004:00080000:1.0:1788876622.637412:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788876622.637464:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788876622.637617:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788876622.647884:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788876622.648207:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1788876622.648225:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3664:x1875771532226816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.648264:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:505 count 1 00010000:00010000:1.0:1788876622.648287:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313ad5ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648307:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313a6d06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472de expref: 120 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648316:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f9:0x0].0x0 since=62s v=(0 0) 00010000:00010000:1.0:1788876622.648321:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.648326:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313ad5ff lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648356:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313a6d06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472de expref: 120 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648370:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313a6d06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472de expref: 120 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.648385:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532227584:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.648457:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.648475:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1788876622.648483:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3664:x1875771532225920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.648496:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:450 count 1 00010000:00010000:1.0:1788876622.648507:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313ad606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648519:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000485a3f85/0xf5bf0f7e313a54f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469d8 expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648527:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c2:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876622.648530:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.648535:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313ad606 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648553:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000485a3f85/0xf5bf0f7e313a54f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469d8 expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.648562:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000485a3f85/0xf5bf0f7e313a54f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469d8 expref: 120 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.648573:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532227712:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.648595:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788876622.648631:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876622.651287:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788876622.651298:0:8455:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:1.0:1788876622.651332:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532227200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.651360:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.651375:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876622.651380:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532227328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.651398:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.651912:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532227456 00000100:00100000:1.0:1788876622.651920:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532227456 00000100:00100000:1.0:1788876622.652087:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788876622.652094:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532227072 00000100:00100000:1.0:1788876622.652097:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532227072 00000100:00100000:1.0:1788876622.652108:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788876622.652112:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532227200 00000100:00100000:1.0:1788876622.652114:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532227200 00000100:00100000:1.0:1788876622.652122:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788876622.652126:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532227328 00000100:00100000:1.0:1788876622.652129:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532227328 00000100:00080000:1.0:1788876622.652144:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876622.652227:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1788876622.652249:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3664:x1875771532226432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.652276:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:503 count 1 00010000:00010000:1.0:1788876622.652296:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.652313:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c765f3fc/0xf5bf0f7e313a6c26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704728a expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.652322:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f7:0x0].0x0 since=62s v=(0 0) 00010000:00010000:1.0:1788876622.652326:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.652331:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.652361:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c765f3fc/0xf5bf0f7e313a6c26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704728a expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.652374:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c765f3fc/0xf5bf0f7e313a6c26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704728a expref: 120 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.652387:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532227840:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.652443:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.657021:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511171456 00000100:00100000:1.0:1788876622.657038:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511171456 00000100:00100000:1.0:1788876622.657114:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2234 00000100:00100000:1.0:1788876622.657124:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511171456:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.657176:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876622.657202:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415f600/0xf5bf0f7e313aa49d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047cd9 expref: 137 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657224:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x43:0x0].0x0 (ffff8a13fa64b700) 00010000:00010000:1.0:1788876622.657253:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1400/0xf5bf0f7e313ad5f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485f4 expref: 136 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657267:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b900) 00010000:00010000:1.0:1788876622.657274:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.657299:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657311:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657320:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657332:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657339:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657346:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657435:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657444:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657451:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.657676:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].70, 64 off12672 00010000:00010000:1.0:1788876622.657724:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657734:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657741:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657748:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657754:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657760:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c580c600/0xf5bf0f7e313ad629 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657777:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.657793:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657799:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657810:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657816:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f415e400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.657820:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657828:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657837:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x43:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:1.0:1788876622.657840:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.657843:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657849:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e400/0xf5bf0f7e313ad622 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657863:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657870:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657876:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657881:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.657884:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657895:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657902:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e798c700) 00010000:00010000:1.0:1788876622.657904:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.657907:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657913:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313ad614 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.657927:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cf294d3 reply state 00000000147ff77f transno 68719477315 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657937:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.657943:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe7e8167a (ffff8a13e798cf00) 00010000:00010000:1.0:1788876622.657945:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.657948:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.658026:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511171456:12345-192.168.203.11@tcp:36:rm.0 Request processed in 902us (5476us total) trans 68719477315 rc 0/0 00000100:00100000:1.0:1788876622.658032:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2234 00010000:00010000:3.0:1788876622.658783:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658789:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658795:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb241e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.658797:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658803:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658809:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4a6465d5 (ffff8a13cfee8000) 00010000:00010000:3.0:1788876622.658811:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.658813:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658818:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb241e00/0xf5bf0f7e313acf45 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4a6465d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658832:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658838:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658844:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658848:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.658851:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658861:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658869:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2b60594b (ffff8a13fa77a900) 00010000:00010000:3.0:1788876622.658871:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.658874:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658879:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313acf6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2b60594b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658891:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658898:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658903:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658907:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.658910:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658914:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658921:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e8416a4 (ffff8a13cfe54800) 00010000:00010000:3.0:1788876622.658923:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.658925:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658931:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313acf99 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e8416a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658944:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658950:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658956:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.658960:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.658963:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.659389:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532227968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.659448:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.659481:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876622.659487:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532228352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.659508:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.659534:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532228096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.659555:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.659567:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.659571:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532228224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.659589:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.659626:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:0.0:1788876622.659636:0:8455:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_006' 00000100:00100000:0.0:1788876622.659651:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:0.0:1788876622.659669:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532227968 00000100:00100000:0.0:1788876622.659675:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532227968 00000100:00100000:0.0:1788876622.659700:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:0.0:1788876622.659705:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532228352 00000100:00100000:0.0:1788876622.659708:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532228352 00000100:00100000:0.0:1788876622.659717:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:0.0:1788876622.659721:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532228096 00000100:00100000:0.0:1788876622.659725:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532228096 00000100:00100000:0.0:1788876622.659732:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 6 min 3 max 116 00000100:00100000:0.0:1788876622.659747:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532228224 00000100:00100000:0.0:1788876622.659749:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532228224 00000100:00100000:0.0:1788876622.659933:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1788876622.659943:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3663:x1875771532226176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.660087:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:501 count 1 00010000:00010000:0.0:1788876622.660108:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.660124:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 120 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.660132:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f5:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.660136:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.660140:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.660164:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 120 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.660181:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.660193:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532228480:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.660247:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.662211:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532227584:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.662227:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313ad5ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.662279:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.662328:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.664469:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c765f3fc/0xf5bf0f7e313a6c26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704728a expref: 118 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.664487:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532227840:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.664505:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.664515:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.664522:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.664531:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.664539:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.664924:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10e2949/0xf5bf0f7e313a6bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047260 expref: 117 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.664938:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532226944:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.664965:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.664983:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.664990:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.664999:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665006:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665028:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.665190:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532226304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26844us (27316us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788876622.665198:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1788876622.665226:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1788876622.665250:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3663:x1875771532226048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.665273:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:500 count 1 00010000:00010000:0.0:1788876622.665292:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665305:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 116 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665316:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f4:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.665320:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.665324:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665355:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 116 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.665369:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 116 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.665382:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532228736:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.665450:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.666125:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788876622.666261:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532226432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14013us (28212us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788876622.666268:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1788876622.666289:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1788876622.666297:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3663:x1875771532226560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.666314:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:504 count 1 00010000:00010000:1.0:1788876622.666331:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.666345:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 116 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.666351:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f8:0x0].0x0 since=62s v=(0 0) 00010000:00010000:1.0:1788876622.666354:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.666358:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.666381:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 116 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.666391:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 116 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.666402:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532228864:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.666440:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00010000:00010000:3.0:1788876622.667399:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667412:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0bf2004 (ffff8a13d0bd4700) 00010000:00010000:3.0:1788876622.667415:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.667419:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667426:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0a00/0xf5bf0f7e313acfc3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667455:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667463:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667469:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667474:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa4c3200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.667476:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667481:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667489:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc97c73b6 (ffff8a13fa77a400) 00010000:00010000:3.0:1788876622.667491:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.667494:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667500:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3200/0xf5bf0f7e313acfed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc97c73b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667518:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667524:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667530:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.667535:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb240200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.667538:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876622.667843:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9c00/2, rc 0, transno 4294967455 00000100:00100000:1.0:1788876622.667861:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532225920:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.667874:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f8000/2, rc 0, transno 4294967457 00000100:00100000:1.0:1788876622.667878:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532226432:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.667888:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fb800/2, rc 0, transno 4294967456 00000100:00100000:1.0:1788876622.667892:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532226304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.668003:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876622.668015:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532228992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.668065:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876622.668095:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.668102:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668110:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.668113:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668121:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668133:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668140:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e39d935a/0xf5bf0f7e313ad5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668161:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.668165:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668171:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.668174:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668181:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668189:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668195:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313ad60d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.668207:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.668209:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.668210:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.669383:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669398:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb94c93cf (ffff8a13f07a2600) 00010000:00010000:3.0:1788876622.669401:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669405:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669412:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240200/0xf5bf0f7e313ad017 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb94c93cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669437:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669444:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669450:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669455:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669459:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669465:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669474:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2bd5303 (ffff8a13d0bd4900) 00010000:00010000:3.0:1788876622.669476:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669478:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669484:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1800/0xf5bf0f7e313ad041 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2bd5303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669504:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669510:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669515:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669521:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ac00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669523:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669530:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669539:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5497665d (ffff8a13cfe54f00) 00010000:00010000:3.0:1788876622.669541:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669544:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669564:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad06b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5497665d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669582:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669589:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669594:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669620:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669624:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669631:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669638:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5add03d2 (ffff8a13fa77b300) 00010000:00010000:3.0:1788876622.669640:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669643:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669648:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad095 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5add03d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669664:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669670:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669675:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669680:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669683:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669694:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669702:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e086f0c (ffff8a13fa77a600) 00010000:00010000:3.0:1788876622.669704:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669707:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669712:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313ad0bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e086f0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669727:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669734:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669740:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669745:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669748:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669754:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669762:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28685129 (ffff8a13d9f51000) 00010000:00010000:3.0:1788876622.669764:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669767:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669773:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ad0e9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28685129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669789:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669796:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669801:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669806:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669809:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669815:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669824:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43f93483 (ffff8a13eb32e200) 00010000:00010000:3.0:1788876622.669826:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669829:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669834:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ad113 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x43f93483 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669848:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669854:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669861:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669866:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669868:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669873:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669880:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9da35f0f (ffff8a13cfee8100) 00010000:00010000:3.0:1788876622.669881:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669884:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669889:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10000/0xf5bf0f7e313ad13d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9da35f0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669903:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669910:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669915:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669920:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669923:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669934:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669940:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf6c27508 (ffff8a13fa4ad100) 00010000:00010000:3.0:1788876622.669942:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.669945:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669950:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313ad167 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf6c27508 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669966:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669973:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669978:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669983:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cae00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.669986:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669991:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.669998:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fefa0a6 (ffff8a13fa4ad300) 00010000:00010000:3.0:1788876622.670000:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670003:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670010:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cae00/0xf5bf0f7e313ad191 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670025:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670030:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670036:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670040:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670043:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670049:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670056:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a5239e9 (ffff8a13fa77ac00) 00010000:00010000:3.0:1788876622.670058:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670060:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670065:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ad1bb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6a5239e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670079:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670085:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670091:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670096:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670098:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670104:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670112:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd765e03c (ffff8a13fa77a800) 00010000:00010000:3.0:1788876622.670114:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670116:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670121:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313ad1e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd765e03c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670136:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670142:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670148:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670153:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ae00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670156:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670165:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670172:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x44381d96 (ffff8a13eb32ee00) 00010000:00010000:3.0:1788876622.670174:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670177:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670183:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad20f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x44381d96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670196:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670202:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670207:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670212:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb240000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670215:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670220:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670227:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x294b033 (ffff8a13eb32e300) 00010000:00010000:3.0:1788876622.670241:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670244:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670250:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240000/0xf5bf0f7e313ad239 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x294b033 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670265:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670271:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670276:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670281:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1dc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670284:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670291:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670298:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fce2 (ffff8a13fa4adf00) 00010000:00010000:3.0:1788876622.670300:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670303:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670308:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1dc00/0xf5bf0f7e313ad263 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670322:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670328:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670334:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670339:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670342:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670347:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670355:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x601fe638 (ffff8a13d0bd4000) 00010000:00010000:3.0:1788876622.670357:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670359:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670365:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1a00/0xf5bf0f7e313ad28d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x601fe638 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670380:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670386:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670391:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670396:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb240c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670399:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670408:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670415:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf694adb2 (ffff8a13eb32eb00) 00010000:00010000:3.0:1788876622.670417:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670420:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670425:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240c00/0xf5bf0f7e313ad2b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf694adb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670439:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670445:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670451:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670455:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670458:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670463:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670470:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4023c2e5 (ffff8a13fa77aa00) 00010000:00010000:3.0:1788876622.670472:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670475:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670481:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ad2e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4023c2e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670495:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670501:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670507:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670511:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670513:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670520:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670527:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa05052df (ffff8a13fa4ada00) 00010000:00010000:3.0:1788876622.670529:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670532:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670538:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1d000/0xf5bf0f7e313ad30b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa05052df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670550:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670557:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670563:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670567:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb240600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670570:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670576:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670583:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd325fb94 (ffff8a13f4157500) 00010000:00010000:3.0:1788876622.670585:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670588:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670593:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb240600/0xf5bf0f7e313ad335 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd325fb94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670632:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670639:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670644:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670649:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670652:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670662:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670669:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79af08ee (ffff8a13fa77ab00) 00010000:00010000:3.0:1788876622.670671:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670674:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670679:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313ad35f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79af08ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670693:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670699:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670705:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670709:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670712:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670718:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670725:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2de6317 (ffff8a12c1a55900) 00010000:00010000:3.0:1788876622.670727:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670730:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670735:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ad389 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa2de6317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670749:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670756:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670761:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670766:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1402044a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670769:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670775:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670782:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddd0e36a (ffff8a12c1a55b00) 00010000:00010000:3.0:1788876622.670784:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670787:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670792:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044a00/0xf5bf0f7e313ad3b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xddd0e36a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670807:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670813:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670820:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670825:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670827:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670833:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670839:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2faaf6c3 (ffff8a12c1a55a00) 00010000:00010000:3.0:1788876622.670841:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670844:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670849:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad3dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2faaf6c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670863:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670869:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670874:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670878:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670881:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670889:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670895:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x10733897 (ffff8a13d0bd4400) 00010000:00010000:3.0:1788876622.670897:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670900:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670905:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0400/0xf5bf0f7e313ad407 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x10733897 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670923:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670929:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670934:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670939:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.670941:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670946:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670953:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x747d610 (ffff8a13d0bd4200) 00010000:00010000:3.0:1788876622.670955:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.670958:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670964:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b1e00/0xf5bf0f7e313ad431 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x747d610 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670981:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670988:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670993:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.670998:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671001:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671006:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671013:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6343e426 (ffff8a13fa77a000) 00010000:00010000:3.0:1788876622.671015:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671018:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671023:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313ad45b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6343e426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671035:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671041:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671047:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671052:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1ce00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671055:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671060:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671067:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f838975 (ffff8a13fa4ad800) 00010000:00010000:3.0:1788876622.671069:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671072:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671077:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1ce00/0xf5bf0f7e313ad485 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4f838975 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671091:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671097:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671102:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671106:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671109:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671117:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671124:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ceb4373 (ffff8a13e798c900) 00010000:00010000:3.0:1788876622.671126:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671129:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671134:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313ad4af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1ceb4373 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671147:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671154:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671159:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671163:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671166:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671171:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671178:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x847c26cc (ffff8a13d0bd4800) 00010000:00010000:3.0:1788876622.671180:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671183:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671189:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0e00/0xf5bf0f7e313ad4d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x847c26cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671202:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671208:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671213:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671218:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f415e600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671220:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671225:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671244:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa275fc18 (ffff8a13e798c400) 00010000:00010000:3.0:1788876622.671246:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671249:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671254:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415e600/0xf5bf0f7e313ad503 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa275fc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671266:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671272:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671277:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671282:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671285:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671290:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671296:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbe06df72 (ffff8a12c1a55200) 00010000:00010000:3.0:1788876622.671298:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671300:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671305:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffc00/0xf5bf0f7e313ad52d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbe06df72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671317:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671322:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671327:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671331:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671334:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671341:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671347:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1613f0e7 (ffff8a13fa4ad200) 00010000:00010000:3.0:1788876622.671349:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671351:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671356:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c000/0xf5bf0f7e313ad557 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1613f0e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671369:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671374:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671379:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671384:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671386:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671391:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671398:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a18c73a (ffff8a13fa4ad500) 00010000:00010000:3.0:1788876622.671401:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671403:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671408:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fbd1c600/0xf5bf0f7e313ad581 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7a18c73a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671422:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671429:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671434:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671439:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671442:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671447:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671454:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x856730c4 (ffff8a13d0bd4300) 00010000:00010000:3.0:1788876622.671456:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671458:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671463:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0600/0xf5bf0f7e313ad5ab lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x856730c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671479:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671485:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671491:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671496:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f47b0c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.671499:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671504:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671511:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc63cac9d (ffff8a13fae15900) 00010000:00010000:3.0:1788876622.671514:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.671516:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.671522:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f47b0c00/0xf5bf0f7e313ad5d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc63cac9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.671998:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532229120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.672069:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.672110:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.672117:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532229248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.672140:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.672170:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 8 min 3 max 116 00000100:00100000:0.0:1788876622.672178:0:10319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_008' 00000100:00100000:1.0:1788876622.672870:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.672961:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.673196:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532228608:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.673223:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.673271:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532228480:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.673285:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.673370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172096 00000100:00100000:0.0:1788876622.673375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172096 00010000:00010000:0.0:1788876622.673401:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 117 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.673430:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172224 00000100:00100000:0.0:1788876622.673433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172224 00010000:00010000:0.0:1788876622.673446:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1debb70/0xf5bf0f7e313a5726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046aaa expref: 118 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.673464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1788876622.673473:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+118:2396:x1875771511172096:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.673487:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.673492:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 118 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673505:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 118 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673527:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002358589d/0xf5bf0f7e313a6b46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047236 expref: 118 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673544:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.673560:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.673566:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673575:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673597:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.673674:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+117:2396:x1875771511172096:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 201us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.673681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1788876622.673697:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:0.0:1788876622.673704:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+116:2398:x1875771511172224:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.673712:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.673717:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1debb70/0xf5bf0f7e313a5726 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046aaa expref: 116 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673728:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1debb70/0xf5bf0f7e313a5726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046aaa expref: 116 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673739:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1debb70/0xf5bf0f7e313a5726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046aaa expref: 116 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673753:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.673756:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.673760:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673767:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673796:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.673816:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c86e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+115:2398:x1875771511172224:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 112us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.673822:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00010000:00010000:0.0:1788876622.673865:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673874:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673884:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673892:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.673906:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.674330:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3663:x1875771532226688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12517us (36205us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788876622.674338:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1788876622.674357:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1788876622.674365:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532227200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.674387:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:499 count 1 00010000:00010000:0.0:1788876622.674410:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674425:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674432:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f3:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.674436:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.674440:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674467:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674480:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.674493:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532229760:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.674538:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.674669:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fbb80/2, rc 0, transno 4294967459 00000100:00100000:0.0:1788876622.674681:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532226688:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876622.674700:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674708:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674717:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674724:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.674738:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876622.674883:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.674891:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674899:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb241c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.674903:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674912:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674930:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674937:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f08fe1a/0xf5bf0f7e313ad637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674975:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.674978:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674984:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1ca00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.674987:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.674994:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.675004:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.675010:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032cec757/0xf5bf0f7e313ad630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.675027:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.675028:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.675031:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.675227:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3663:x1875771532226176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15285us (37134us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788876622.675244:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1788876622.675261:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788876622.675268:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532227328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.675282:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:500 count 1 00010000:00010000:0.0:1788876622.675296:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.675308:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.675319:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f4:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.675323:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.675326:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.675345:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 120 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.675354:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 120 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.675364:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532229888:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.675503:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884840 going to sleep for 11 seconds 00000004:00080000:1.0:1788876622.676395:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9f80/2, rc 0, transno 4294967460 00000100:00100000:1.0:1788876622.676415:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532226176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.679976:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.680055:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532228736:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.680084:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680140:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.680162:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172608 00000100:00100000:0.0:1788876622.680168:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172608 00010000:00010000:0.0:1788876622.680203:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 115 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680258:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:0.0:1788876622.680267:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+115:2395:x1875771511172608:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.680280:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.680285:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 115 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680295:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 115 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680319:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680324:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680329:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680338:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680354:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.680399:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+115:2395:x1875771511172608:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 133us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.680406:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:0.0:1788876622.680439:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.680539:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.680578:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532229760:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.680594:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680647:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.680660:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172480 00000100:00100000:0.0:1788876622.680663:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172480 00010000:00010000:0.0:1788876622.680677:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 115 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680689:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172736 00000100:00100000:0.0:1788876622.680692:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172736 00010000:00010000:0.0:1788876622.680714:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097faddb3/0xf5bf0f7e313a6b7e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704724b expref: 121 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680726:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172864 00000100:00100000:0.0:1788876622.680728:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172864 00010000:00010000:0.0:1788876622.680740:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015acf2d7/0xf5bf0f7e313a56ee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a95 expref: 122 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.680753:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:0.0:1788876622.680758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+115:2396:x1875771511172480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.680768:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.680772:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 115 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680783:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 115 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680803:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c145bcf4/0xf5bf0f7e313a6ad6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704720c expref: 115 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680815:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680819:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680822:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680829:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680845:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.680869:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+114:2396:x1875771511172480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 110us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.680876:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:0.0:1788876622.680888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:0.0:1788876622.680894:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+122:2398:x1875771511172736:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.680902:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.680906:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097faddb3/0xf5bf0f7e313a6b7e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704724b expref: 122 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680916:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097faddb3/0xf5bf0f7e313a6b7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704724b expref: 122 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680943:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680946:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.680951:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680958:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.680970:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.680988:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+122:2398:x1875771511172736:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 94us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.680994:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:0.0:1788876622.681006:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1788876622.681011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+121:2397:x1875771511172864:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.681017:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.681022:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015acf2d7/0xf5bf0f7e313a56ee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a95 expref: 121 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681031:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015acf2d7/0xf5bf0f7e313a56ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a95 expref: 121 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681047:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.681050:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.681055:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681066:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681077:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.681091:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172352 00000100:00100000:3.0:1788876622.681098:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172352 00000100:00100000:0.0:1788876622.681100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+121:2397:x1875771511172864:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 88us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.681108:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00080000:0.0:1788876622.681129:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876622.681142:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.681142:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2235 00000100:00100000:3.0:1788876622.681154:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+89:33371:x1875771511172352:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.681156:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681170:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681179:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681180:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.681200:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.681204:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370485fb expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681313:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff000/0xf5bf0f7e313ad66f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681331:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff000/0xf5bf0f7e313ad66f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681342:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff000/0xf5bf0f7e313ad66f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.681382:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3663:x1875771532226048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16134us (43221us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788876622.681390:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1788876622.681408:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1788876622.681416:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3665:x1875771532227968:12345-0@lo:6:osp-syn-0-0.0 00000004:00200000:3.0:1788876622.681430:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00002000:00080000:0.0:1788876622.681434:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:502 count 1 00000004:00200000:3.0:1788876622.681435:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1788876622.681452:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876622.681457:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff000/0xf5bf0f7e313ad66f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681470:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb2386a8/0xf5bf0f7e313a6bee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047275 expref: 120 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681478:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f6:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.681482:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.681486:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485fb expref: 91 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681488:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681515:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff000/0xf5bf0f7e313ad66f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370485fb expref: 90 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681524:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:0.0:1788876622.681528:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb2386a8/0xf5bf0f7e313a6bee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047275 expref: 120 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681529:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876622.681533:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13ff5ff000, rc 0) 00010000:00010000:0.0:1788876622.681550:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb2386a8/0xf5bf0f7e313a6bee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047275 expref: 120 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.681562:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+90:33371:x1875771511172352:12345-192.168.203.11@tcp:101:rm.0 Request processed in 410us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.681567:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532230272:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.681575:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2235 00000100:00100000:0.0:1788876622.681651:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00010000:00010000:3.0:1788876622.681666:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097faddb3/0xf5bf0f7e313a6b7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704724b expref: 120 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681671:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.681681:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.681687:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532229376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.681698:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1da00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.681704:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681709:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681714:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681727:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681733:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681737:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681751:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e981e7/0xf5bf0f7e313ad63e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681755:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681768:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681776:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.681780:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.681784:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681784:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876622.681794:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.681798:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681805:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681816:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681829:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313ad64c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.681846:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.681849:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.681851:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.681882:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9180/2, rc 0, transno 4294967461 00000100:00100000:0.0:1788876622.681896:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532226048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.681910:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532227456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13407us (30819us total) trans 8589934747 rc 0/0 00000100:00100000:3.0:1788876622.681918:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1788876622.681940:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:3.0:1788876622.681948:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3665:x1875771532228352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.681963:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:505 count 1 00010000:00010000:3.0:1788876622.681977:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.681990:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006efca1aa/0xf5bf0f7e313a6d3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472f3 expref: 119 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.681998:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876622.682009:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f9:0x0].0x0 since=62s v=(0 0) 00010000:00010000:3.0:1788876622.682013:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f9:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876622.682017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511172992 00010000:00010000:3.0:1788876622.682017:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682023:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511172992 00010000:00010000:3.0:1788876622.682046:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006efca1aa/0xf5bf0f7e313a6d3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472f3 expref: 120 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682049:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.682067:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006efca1aa/0xf5bf0f7e313a6d3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472f3 expref: 120 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682079:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1788876622.682081:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532230400:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.682090:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+120:2398:x1875771511172992:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.682099:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.682105:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.682115:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c79f3540 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.682117:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.682134:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.682135:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5973de6/0xf5bf0f7e313a6a9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471f7 expref: 120 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682155:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.682158:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.682164:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682173:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682196:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.682219:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+119:2398:x1875771511172992:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 132us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.682226:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00010000:00010000:0.0:1788876622.682262:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.682267:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00010000:00010000:0.0:1788876622.682277:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.682280:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532228096:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876622.682294:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788876622.682299:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:503 count 1 00010000:00010000:0.0:1788876622.682303:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062bd7231/0xf5bf0f7e313ad65a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.682312:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682318:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.682325:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313a6c5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704729f expref: 118 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.682333:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f7:0x0].0x0 since=62s v=(0 0) 00010000:00010000:3.0:1788876622.682337:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.682342:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682403:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532227200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8038us (31041us total) trans 8589934748 rc 0/0 00000100:00100000:0.0:1788876622.682410:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00010000:00010000:3.0:1788876622.682420:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313a6c5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704729f expref: 118 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682427:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00010000:00010000:3.0:1788876622.682438:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313a6c5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704729f expref: 118 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682439:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532228224:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.682456:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532230528:192.168.203.11@tcp:104: 00002000:00080000:0.0:1788876622.682459:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:504 count 1 00010000:00010000:0.0:1788876622.682473:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.682485:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c79f3300 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.682486:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005939c77d/0xf5bf0f7e313a6cce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472c9 expref: 118 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682496:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f8:0x0].0x0 since=62s v=(0 0) 00010000:00010000:0.0:1788876622.682500:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.682504:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682525:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005939c77d/0xf5bf0f7e313a6cce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472c9 expref: 118 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682535:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005939c77d/0xf5bf0f7e313a6cce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472c9 expref: 118 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.682546:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532230656:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.682570:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.682653:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.682727:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511173120 00000100:00100000:3.0:1788876622.682732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511173120 00010000:00010000:3.0:1788876622.682753:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 119 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.682781:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1788876622.682790:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+119:2397:x1875771511173120:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.682799:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788876622.682800:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532229888:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.682807:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 119 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.682818:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.682822:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 119 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876622.688223:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb29a680/2, rc 0, transno 8589934748 00000100:00100000:1.0:1788876622.688254:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532227200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.688353:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532231424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.689470:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.689530:0:9553:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788876622.689537:0:9553:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788876622.689551:0:8455:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:1.0:1788876622.689556:0:8455:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_010' 00010000:00010000:1.0:1788876622.689731:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef7648d/0xf5bf0f7e313a6c96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472b4 expref: 113 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.689746:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532228864:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.689764:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.689774:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.689781:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689862:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.689870:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689878:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.689883:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689892:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689904:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689911:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313ad653 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.689929:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.689931:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.689933:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.689955:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb2386a8/0xf5bf0f7e313a6bee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047275 expref: 122 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.690048:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313a6b0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047221 expref: 122 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.690064:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.690068:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.690074:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.690092:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.690122:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.690238:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690251:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690267:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.690278:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.690282:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690287:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.690291:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690298:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690309:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690315:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313ad645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.690329:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.690331:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.690332:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.692000:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532230272:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.692084:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.692099:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.692107:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.692116:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.692124:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.692324:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876622.696081:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+117:2397:x1875771511173120:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 13284us (13418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.696094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:3.0:1788876622.696178:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:3.0:1788876622.696188:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532231424 00000100:00100000:3.0:1788876622.696195:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532231424 00010000:00010000:3.0:1788876622.696323:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006efca1aa/0xf5bf0f7e313a6d3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472f3 expref: 116 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.696342:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532230400:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.696860:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.696881:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.696888:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.696899:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.696910:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.697017:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876622.697116:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3663:x1875771532226560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30816us (58924us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788876622.697125:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000004:00080000:1.0:1788876622.697173:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35faa00/2, rc 0, transno 4294967462 00000100:00100000:1.0:1788876622.697188:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532226560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.697204:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3665:x1875771532228352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15255us (37692us total) trans 8589934751 rc 0/0 00000100:00100000:3.0:1788876622.697211:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1788876622.697274:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532231552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.697309:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876622.697321:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532231552 00000100:00100000:3.0:1788876622.697328:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532231552 00000100:00100000:3.0:1788876622.697359:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1788876622.697367:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3662:x1875771532229120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876622.697391:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:507 count 1 00010000:00010000:3.0:1788876622.697413:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.697427:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adb5d4dc/0xf5bf0f7e313a6de6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047332 expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.697435:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1fb:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788876622.697439:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.697443:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.697468:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adb5d4dc/0xf5bf0f7e313a6de6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047332 expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.697487:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adb5d4dc/0xf5bf0f7e313a6de6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047332 expref: 112 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.697500:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532231680:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.697541:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.697542:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1788876622.697554:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3662:x1875771532229248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.697569:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:508 count 1 00010000:00010000:1.0:1788876622.697583:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788876622.697583:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb298000/2, rc 0, transno 8589934751 00000100:00100000:3.0:1788876622.697598:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532228352:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.697617:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f57bbcc/0xf5bf0f7e313a6e56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704735c expref: 112 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.697626:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1fc:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.697629:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.697633:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.697653:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f57bbcc/0xf5bf0f7e313a6e56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704735c expref: 112 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.697663:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f57bbcc/0xf5bf0f7e313a6e56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704735c expref: 112 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.697678:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532231808:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.697880:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876622.697891:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532231936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.697929:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876622.698029:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313a6c5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704729f expref: 114 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.698044:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532230528:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.698059:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698068:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698075:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698083:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698090:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698106:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788876622.698117:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876622.698123:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698131:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa787200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.698135:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698144:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698159:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698169:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeee0298/0xf5bf0f7e313ad676 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698192:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876622.698196:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698202:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ff600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.698206:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698214:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.698227:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.698252:0:43952:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:1.0:1788876622.698259:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532231936 00000100:00100000:1.0:1788876622.698262:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532231936 00010000:00010000:3.0:1788876622.698296:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.698308:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876622.698310:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c434d7b5/0xf5bf0f7e313ad67d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.698329:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511174016 00010000:00010000:3.0:1788876622.698332:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788876622.698334:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511174016 00010000:00010000:3.0:1788876622.698338:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698347:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.698352:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.698354:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de737cda/0xf5bf0f7e313a6d76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047308 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698372:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698386:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.698390:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00010000:00010000:3.0:1788876622.698400:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000125211/0xf5bf0f7e313ad684 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.698402:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2398:x1875771511174016:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876622.698418:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.698425:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de737cda/0xf5bf0f7e313a6d76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047308 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.698425:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.698429:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.698432:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.698443:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de737cda/0xf5bf0f7e313a6d76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047308 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.698458:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.698463:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.698469:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.698483:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.698499:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876622.698522:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2398:x1875771511174016:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 121us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.698529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:3.0:1788876622.698762:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3662:x1875771532228096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16483us (39204us total) trans 8589934752 rc 0/0 00000100:00100000:3.0:1788876622.698770:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000004:00080000:3.0:1788876622.698811:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb299f80/2, rc 0, transno 8589934752 00000100:00100000:3.0:1788876622.698821:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532228096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.699176:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.699194:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532232064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.699197:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511174144 00000100:00100000:1.0:1788876622.699203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511174144 00010000:00010000:1.0:1788876622.699223:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313a6ec6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047386 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.699253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1788876622.699260:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2398:x1875771511174144:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876622.699269:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.699273:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313a6ec6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047386 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699283:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313a6ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047386 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699296:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.699299:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.699303:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699311:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699324:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876622.699344:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2398:x1875771511174144:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.699350:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1788876622.699404:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1788876622.699411:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3664:x1875771532230016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.699427:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:510 count 1 00010000:00010000:1.0:1788876622.699443:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699457:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313a6f36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473b0 expref: 112 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699463:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1fe:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.699465:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1fe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.699469:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699489:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313a6f36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473b0 expref: 112 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699500:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313a6f36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473b0 expref: 112 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.699511:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532232192:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.699536:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.699643:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1788876622.699650:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3663:x1875771532230144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.699663:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:511 count 1 00010000:00010000:1.0:1788876622.699674:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699685:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 112 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699692:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ff:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.699695:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.699699:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699716:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 112 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.699725:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 112 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.699733:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532232320:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.699752:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.699809:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.699860:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3665:x1875771532227968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18442us (40409us total) trans 8589934750 rc 0/0 00000004:00080000:3.0:1788876622.699860:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb299180/2, rc 0, transno 8589934750 00000100:00100000:0.0:1788876622.699872:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1788876622.699875:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532227968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.699899:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532232064 00000100:00100000:0.0:1788876622.699905:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532232064 00000100:00100000:0.0:1788876622.699927:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1788876622.699934:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876622.699935:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3664:x1875771532230912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.699953:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:506 count 1 00010000:00010000:0.0:1788876622.699981:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.699994:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313a6dae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704731d expref: 113 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.700001:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532232448:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876622.700003:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1fa:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.700011:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fa:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.700015:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.700038:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313a6dae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704731d expref: 113 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.700042:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876622.700070:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.700146:0:43955:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:3.0:1788876622.700153:0:43955:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_011' 00010000:00010000:0.0:1788876622.700173:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313a6dae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704731d expref: 113 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.700186:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532232576:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.700216:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884840 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.700551:0:43952:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:1.0:1788876622.700558:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532232448 00000100:00100000:1.0:1788876622.700562:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532232448 00010000:00010000:0.0:1788876622.701505:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005939c77d/0xf5bf0f7e313a6cce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370472c9 expref: 113 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.701520:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532230656:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.701540:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701556:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701564:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701575:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701582:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701614:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.701771:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3662:x1875771532228224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19334us (42179us total) trans 8589934753 rc 0/0 00000100:00100000:0.0:1788876622.701778:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1788876622.701826:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1788876622.701834:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3663:x1875771532230784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.701850:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:512 count 1 00010000:00010000:0.0:1788876622.701869:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701882:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004382d271/0xf5bf0f7e313a7016 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047404 expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701894:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x200:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.701898:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x200:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.701902:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701930:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004382d271/0xf5bf0f7e313a7016 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047404 expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.701942:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004382d271/0xf5bf0f7e313a7016 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047404 expref: 112 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.701955:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532232704:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.702006:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.702023:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.702030:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702038:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.702213:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702224:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702248:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702255:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad68b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702275:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702277:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702279:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702286:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.702309:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb29b800/2, rc 0, transno 8589934753 00000100:00100000:0.0:1788876622.702322:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532228224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.702375:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.702386:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532232832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.702419:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.702446:0:43952:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 11 min 3 max 116 00000100:00100000:0.0:1788876622.702457:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532232832 00000100:00100000:0.0:1788876622.702460:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532232832 00010000:00010000:0.0:1788876622.702491:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702694:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de737cda/0xf5bf0f7e313a6d76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047308 expref: 112 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.702707:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532231168:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.702722:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702731:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702742:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702751:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702758:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702772:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.702781:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.702797:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702805:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7a600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.702808:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702817:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702829:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702836:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad692 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.702852:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702854:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.702855:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.702959:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3664:x1875771532228992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19208us (34893us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788876622.702966:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000004:00080000:0.0:1788876622.702995:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa783480/2, rc 0, transno 4294967463 00000100:00100000:0.0:1788876622.703006:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532228992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.703069:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532232960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.703105:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.703130:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532232960 00000100:00100000:0.0:1788876622.703134:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532232960 00000100:00100000:0.0:1788876622.703153:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1788876622.703161:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3665:x1875771532231040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.703178:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:507 count 1 00010000:00010000:0.0:1788876622.703194:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703206:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 112 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703212:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1fb:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.703215:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.703220:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703255:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 112 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703267:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 112 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.703278:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532233088:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.703325:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.703353:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313a6ec6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047386 expref: 111 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.703364:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:43956:1875771532231296:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.703377:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703386:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703393:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703402:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703415:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703427:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.703434:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.703438:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703444:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7b600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.703446:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703453:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703464:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703472:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad699 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703489:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.703491:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.703492:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.703576:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3664:x1875771532229504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19570us (34633us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788876622.703582:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000004:00080000:0.0:1788876622.703630:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff574000/2, rc 0, transno 4294967464 00000100:00100000:0.0:1788876622.703638:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532229504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.703673:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876622.703680:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532233216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.703704:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.703728:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532233216 00000100:00100000:0.0:1788876622.703731:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532233216 00000100:00100000:0.0:1788876622.703750:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1788876622.703756:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3662:x1875771532231424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.703770:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:508 count 1 00010000:00010000:0.0:1788876622.703783:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703794:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 112 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703800:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1fc:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.703803:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.703806:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703825:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 112 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.703835:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 112 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.703846:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532233344:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.703877:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.705436:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705452:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705464:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705473:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705508:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.705522:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.705528:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705536:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fbd1d600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.705541:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705561:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705580:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705589:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd8c54d/0xf5bf0f7e313ad661 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.705626:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.705628:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.705630:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.705820:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3662:x1875771532227328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30550us (54417us total) trans 8589934754 rc 0/0 00000100:00100000:1.0:1788876622.705829:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000004:00080000:1.0:1788876622.705882:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb298a80/2, rc 0, transno 8589934754 00000100:00100000:1.0:1788876622.707286:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532227328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.707374:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532233472:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.707428:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.707485:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532233472 00000100:00100000:1.0:1788876622.707492:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532233472 00000100:00100000:1.0:1788876622.707531:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1788876622.707541:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3663:x1875771532231552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.707582:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:513 count 1 00010000:00010000:1.0:1788876622.707622:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.707641:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 110 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.707650:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x201:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.707655:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x201:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.707661:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.707685:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 110 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.707697:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 110 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.707709:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532233600:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.707761:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.718459:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1788876622.718470:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3665:x1875771532232064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.718489:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:509 count 1 00010000:00010000:3.0:1788876622.718504:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.718525:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.718533:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1fd:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788876622.718536:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.718540:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.718565:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 112 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.718591:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 112 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.718634:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532233856:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.718733:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f57bbcc/0xf5bf0f7e313a6e56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704735c expref: 109 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.718745:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532231808:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.718760:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718774:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718781:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718789:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718797:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718811:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876622.718896:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3662:x1875771532229248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21344us (46753us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788876622.718903:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1788876622.718919:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1788876622.718926:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3663:x1875771532232448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.718940:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:510 count 1 00010000:00010000:1.0:1788876622.718950:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718961:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 112 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718969:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1fe:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.718973:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.718976:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.718996:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 112 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.719005:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 112 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.719016:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532233984:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.720424:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313a6dae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704731d expref: 112 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.720444:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532232576:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.720467:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720477:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720485:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720495:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720502:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720525:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788876622.720814:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3664:x1875771532230912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20880us (37686us total) trans 8589934755 rc 0/0 00000100:00100000:0.0:1788876622.720826:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1788876622.720851:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1788876622.720860:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3662:x1875771532232832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.720882:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:511 count 1 00010000:00010000:0.0:1788876622.720900:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ad6f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720913:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313a6fde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473ef expref: 111 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720921:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ff:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.720925:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.720929:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ad6f4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720969:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313a6fde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473ef expref: 111 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.720982:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313a6fde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473ef expref: 111 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.720993:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532234112:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.724560:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00000004:00080000:1.0:1788876622.724642:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa781880/2, rc 0, transno 4294967466 00000100:00100000:1.0:1788876622.724662:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532229248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.724720:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.724745:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.724929:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.726898:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.727877:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.727916:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.729148:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e1610f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.729213:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004382d271/0xf5bf0f7e313a7016 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047404 expref: 108 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.729247:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532232704:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.729272:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.729282:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.729288:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.729299:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.729306:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.729320:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788876622.729500:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbe9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3663:x1875771532230784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27665us (46171us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788876622.729508:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1788876622.729538:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000004:00080000:3.0:1788876622.729596:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3034000/2, rc 0, transno 8589934755 00000100:00100000:3.0:1788876622.729631:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532230912:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876622.729646:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff574a80/2, rc 0, transno 4294967465 00000100:00100000:3.0:1788876622.729656:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532230016:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876622.729672:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876622.729680:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729689:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.729693:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729704:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729723:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729731:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad6ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729753:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876622.729757:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729775:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.729779:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729787:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729796:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729803:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313ad6a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729816:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876622.729821:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729827:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb240e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.729831:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729839:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729849:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729856:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10e2949/0xf5bf0f7e313ad6bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729870:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.729873:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729880:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e1f62c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.729883:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729891:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729899:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729906:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fd8adbd/0xf5bf0f7e313ad6c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.729920:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.729922:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.729924:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.729936:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511175040 00000100:00100000:3.0:1788876622.729951:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511175040 00010000:00010000:3.0:1788876622.729982:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 112 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730004:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511175168 00000100:00100000:3.0:1788876622.730007:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511175168 00010000:00010000:3.0:1788876622.730020:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 108 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730032:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511174528 00000100:00100000:3.0:1788876622.730034:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511174528 00010000:00010000:3.0:1788876622.730046:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 109 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511175296 00000100:00100000:3.0:1788876622.730058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511175296 00010000:00010000:3.0:1788876622.730068:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 113 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:3.0:1788876622.730086:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2397:x1875771511175040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.730100:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.730106:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730117:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 113 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730135:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730141:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730147:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730158:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.730159:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3664:x1875771532232960:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876622.730186:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1788876622.730192:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:514 count 1 00010000:00010000:0.0:1788876622.730215:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730240:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e68bb19/0xf5bf0f7e313a70f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047458 expref: 109 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730247:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+113:2397:x1875771511175040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (5515us total) trans 0 rc 0/0 00010000:00010000:0.0:1788876622.730256:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x202:0x0].0x0 since=61s v=(0 0) 00000100:00100000:3.0:1788876622.730261:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00010000:00010000:0.0:1788876622.730264:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x202:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.730270:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.730282:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:3.0:1788876622.730290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+109:2397:x1875771511175168:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.730300:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.730301:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e68bb19/0xf5bf0f7e313a70f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047458 expref: 109 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730308:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 109 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730320:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e68bb19/0xf5bf0f7e313a70f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047458 expref: 109 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730324:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 109 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.730349:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532234368:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.730350:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x201:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730358:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x201:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730362:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730370:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730386:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.730404:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.730412:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+109:2397:x1875771511175168:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 123us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.730420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:0.0:1788876622.730431:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1788876622.730439:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1788876622.730444:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+108:2398:x1875771511174528:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788876622.730453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+112:2397:x1875771511175296:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.730455:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.730465:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 108 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730466:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.730476:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 112 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730482:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 108 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730495:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 112 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730515:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730518:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.730521:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.730523:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.730527:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730530:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730549:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730561:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.730579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c86ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+112:2397:x1875771511175296:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (3638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.730585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00010000:00010000:3.0:1788876622.730629:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730642:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730651:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730664:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730671:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730677:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730775:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730784:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.730790:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730916:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.730935:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.730957:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+108:2398:x1875771511174528:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 518us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.730964:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000040:00080000:3.0:1788876622.730995:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].72, 64 off12800 00010000:00010000:0.0:1788876622.731029:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9769906/0xf5bf0f7e313a6e1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047347 expref: 111 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731041:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731052:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731064:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731071:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731077:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731084:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731100:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.731115:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.731119:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731125:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5fe800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.731129:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731136:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731145:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x44:0x0].0x0 (ffff8a13e7965800) 00010000:00010000:3.0:1788876622.731148:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876622.731153:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.731161:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876622.731165:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe800/0xf5bf0f7e313ad717 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731180:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.731183:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.731185:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.731196:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731203:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731209:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731215:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffe00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.731219:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731225:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731247:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x44:0x0].0x0 (ffff8a13e7965800) 00010000:00010000:3.0:1788876622.731250:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876622.731254:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731260:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ffe00/0xf5bf0f7e313ad710 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.731267:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532234496:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876622.731278:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731286:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731294:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731299:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ff600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.731302:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.731310:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876622.731314:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731324:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965600) 00010000:00010000:3.0:1788876622.731327:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.731329:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731336:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5ff600/0xf5bf0f7e313ad702 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876622.731353:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002365e0eb reply state 0000000045732f1b transno 68719477316 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731363:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.731370:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe744d4ca (ffff8a13e7965d00) 00010000:00010000:3.0:1788876622.731374:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876622.731376:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.731388:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532234624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.731421:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+90:33371:x1875771511173888:12345-192.168.203.11@tcp:36:rm.0 Request processed in 30155us (33602us total) trans 68719477316 rc 0/0 00000100:00100000:1.0:1788876622.731427:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876622.731435:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2236 00000100:00100000:3.0:1788876622.731466:0:43955:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 12 min 3 max 116 00000100:00100000:3.0:1788876622.731473:0:43955:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_012' 00010000:00010000:1.0:1788876622.731490:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adb5d4dc/0xf5bf0f7e313a6de6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047332 expref: 107 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.731503:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532231680:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.731523:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731533:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731541:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731644:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731651:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731666:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.731774:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3662:x1875771532229120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34406us (59704us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788876622.731783:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1788876622.731803:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532234240 00000100:00100000:1.0:1788876622.731809:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532234240 00000100:00100000:1.0:1788876622.731831:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532234496 00000100:00100000:1.0:1788876622.731834:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532234496 00000100:00100000:1.0:1788876622.731845:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532234624 00000100:00100000:1.0:1788876622.731847:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532234624 00000100:00100000:1.0:1788876622.731858:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1788876622.731865:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3664:x1875771532233216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.731886:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:456 count 1 00010000:00010000:1.0:1788876622.731900:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad71e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731914:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8bd92af/0xf5bf0f7e313a5796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ad4 expref: 106 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731922:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c8:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876622.731926:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.731929:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad71e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731953:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8bd92af/0xf5bf0f7e313a5796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ad4 expref: 106 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.731964:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8bd92af/0xf5bf0f7e313a5796 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ad4 expref: 106 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.731975:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532234752:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.732027:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234780 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.732039:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.732172:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732180:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5fe400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.732183:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732192:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732205:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732213:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa2ad3b1/0xf5bf0f7e313ad6a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732239:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.732241:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.732243:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.732269:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa783100/2, rc 0, transno 4294967468 00000100:00100000:1.0:1788876622.732279:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532229120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.732320:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532234880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.732350:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876622.732389:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313a6fa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473da expref: 106 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.732400:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532232320:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.732413:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732422:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732429:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732437:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732445:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.732459:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.732545:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532230144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32893us (55999us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788876622.732653:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532233088:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.732673:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732681:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732687:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732701:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732708:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732715:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.732807:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3665:x1875771532231040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29646us (49137us total) trans 8589934756 rc 0/0 00000100:00100000:0.0:1788876622.732814:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1788876622.732831:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532234880 00000100:00100000:0.0:1788876622.732835:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532234880 00000100:00100000:0.0:1788876622.732857:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1788876622.732864:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3662:x1875771532233472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.732881:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:512 count 1 00010000:00010000:0.0:1788876622.732898:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732910:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000aff4397/0xf5bf0f7e313a704e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047419 expref: 110 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732917:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x200:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.732920:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x200:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.732924:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732948:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000aff4397/0xf5bf0f7e313a704e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047419 expref: 110 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.732960:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000aff4397/0xf5bf0f7e313a704e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047419 expref: 110 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.732971:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532235008:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.733009:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3a8b780 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.733023:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876622.733029:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733036:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.733040:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733048:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733061:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733068:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad6b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733091:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.733095:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733102:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e1f62800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.733105:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733113:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733124:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733132:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d753b75c/0xf5bf0f7e313ad6ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733145:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.733147:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.733149:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.733262:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3036d80/2, rc 0, transno 8589934756 00000100:00100000:0.0:1788876622.733273:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532231040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.733317:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.733326:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532235136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.733354:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876622.733372:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.733392:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313a6e8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047371 expref: 110 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.733402:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532233344:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.733415:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733424:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733430:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733437:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733444:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.733457:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.733738:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:1.0:1788876622.733842:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532235136 00000100:00100000:1.0:1788876622.733846:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532235136 00000100:00100000:1.0:1788876622.733865:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1788876622.733873:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532234240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.733888:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:515 count 1 00010000:00010000:1.0:1788876622.733905:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.733918:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.733925:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x203:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.733928:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.733932:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.733951:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.733961:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.733977:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532235264:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.734008:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.734021:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.734026:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.734034:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eff0fe00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.734038:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.734427:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.734443:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.734451:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75fd3df/0xf5bf0f7e313ad6d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.734468:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.734470:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.734471:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.734497:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3037800/2, rc 0, transno 4294967467 00000100:00100000:0.0:1788876622.734636:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3662:x1875771532231424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29789us (44075us total) trans 8589934757 rc 0/0 00000100:00100000:0.0:1788876622.734647:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1788876622.734669:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1788876622.734677:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3665:x1875771532234624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.734692:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:516 count 1 00010000:00010000:0.0:1788876622.734705:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.734717:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093724cfe/0xf5bf0f7e313a71d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474ac expref: 105 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.734723:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x204:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.734726:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x204:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.734730:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.734749:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093724cfe/0xf5bf0f7e313a71d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474ac expref: 105 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.734762:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093724cfe/0xf5bf0f7e313a71d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474ac expref: 105 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.734772:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532235520:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.734815:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.734827:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.734861:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa781c00/2, rc 0, transno 8589934757 00000100:00100000:0.0:1788876622.734870:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532231424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.734922:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532235648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.734953:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.735031:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532230784:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.735060:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3036a00/2, rc 0, transno 4294967469 00010000:00010000:0.0:1788876622.735913:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f9c3d34/0xf5bf0f7e313a7086 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704742e expref: 105 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.735929:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532233600:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.735956:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.735977:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.735985:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.735996:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736004:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736020:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.736031:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.736036:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736057:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.736061:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736069:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736085:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736092:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad6d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736107:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.736109:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.736110:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.736262:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3663:x1875771532231552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28722us (38952us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788876622.736271:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1788876622.736290:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532235648 00000100:00100000:0.0:1788876622.736295:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532235648 00000100:00100000:0.0:1788876622.736316:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1788876622.736324:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3662:x1875771532234880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.736341:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:517 count 1 00010000:00010000:0.0:1788876622.736356:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736369:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a2a9/0xf5bf0f7e313a7246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474d6 expref: 104 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736380:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x205:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.736384:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x205:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.736388:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736410:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a2a9/0xf5bf0f7e313a7246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474d6 expref: 104 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.736420:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4a1a2a9/0xf5bf0f7e313a7246 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474d6 expref: 104 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.736432:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532235776:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.736476:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.737376:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532230144:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.737407:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa782d80/2, rc 0, transno 4294967470 00000100:00100000:0.0:1788876622.737495:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.737505:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532236160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.737534:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.737830:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532231552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.737848:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:1.0:1788876622.737857:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532235904 00000100:00100000:1.0:1788876622.737861:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532235904 00000100:00100000:1.0:1788876622.737884:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:1.0:1788876622.737889:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532236032 00000100:00100000:1.0:1788876622.737892:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532236032 00000100:00100000:1.0:1788876622.737901:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 13 min 3 max 116 00000100:00100000:1.0:1788876622.737905:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532236160 00000100:00100000:1.0:1788876622.737907:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532236160 00000100:00100000:1.0:1788876622.739185:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532233984:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.739211:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.739268:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511175680 00000100:00100000:0.0:1788876622.739272:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511175680 00010000:00010000:0.0:1788876622.739291:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 111 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.739313:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511175552 00000100:00100000:0.0:1788876622.739316:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511175552 00010000:00010000:0.0:1788876622.739330:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 112 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.739362:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1788876622.739371:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+112:2398:x1875771511175680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.739383:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.739389:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 112 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739399:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 112 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739423:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.739428:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.739435:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739444:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739463:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.739505:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+112:2398:x1875771511175680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 134us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.739513:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1788876622.739529:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:0.0:1788876622.739535:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+111:2398:x1875771511175552:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.739542:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.739549:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 111 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739670:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 111 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739688:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006744913e/0xf5bf0f7e313a6f6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370473c5 expref: 111 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739700:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.739703:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1fe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.739708:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739716:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739732:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.739752:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+110:2398:x1875771511175552:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 217us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.739759:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:0.0:1788876622.739788:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532234368:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.739803:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739831:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000417de23e/0xf5bf0f7e313a6efe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704739b expref: 109 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.739841:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532233856:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.739852:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739862:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739869:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739879:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739887:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.739900:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.740185:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3665:x1875771532232064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21717us (40376us total) trans 8589934758 rc 0/0 00000100:00100000:0.0:1788876622.740193:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000004:00080000:0.0:1788876622.740225:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7aafb80/2, rc 0, transno 8589934758 00000100:00100000:0.0:1788876622.740249:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532232064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.740308:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876622.740318:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532236288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.740352:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.740377:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532236288 00000100:00100000:0.0:1788876622.740382:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532236288 00000100:00100000:0.0:1788876622.740407:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1788876622.740416:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3662:x1875771532235136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.740435:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:514 count 1 00010000:00010000:0.0:1788876622.740456:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.740470:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 108 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.740478:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x202:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.740482:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x202:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.740486:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.740511:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 108 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.740523:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 108 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.740538:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532236416:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.740538:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1788876622.740551:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3664:x1875771532235648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.740565:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:515 count 1 00010000:00010000:3.0:1788876622.740577:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.740590:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 108 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.740597:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x203:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788876622.740632:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.740638:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740657:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.740662:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 108 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740665:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.740680:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 108 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740681:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.740688:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.740696:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532236544:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.740702:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740719:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740728:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad6e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740747:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.740749:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.740751:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.740765:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740774:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740783:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.740788:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.740792:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740810:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.740894:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532232448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21968us (40853us total) trans 8589934759 rc 0/0 00000100:00100000:1.0:1788876622.740902:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1788876622.740918:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1788876622.740925:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3664:x1875771532235904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.740938:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:518 count 1 00010000:00010000:1.0:1788876622.740951:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740962:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 104 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.740984:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x206:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.740988:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x206:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.740992:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741013:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 104 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741022:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 104 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.741034:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532236672:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.741076:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.741088:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.741093:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741100:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.741103:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741117:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741127:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741134:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad6ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.741148:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.741149:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.741151:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.741170:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7aad500/2, rc 0, transno 8589934759 00000100:00100000:1.0:1788876622.741180:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532232448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.741214:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532236800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.741249:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.741276:0:43955:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 14 min 3 max 116 00000100:00100000:1.0:1788876622.741282:0:43955:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_014' 00000100:00100000:1.0:1788876622.741299:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 14 min 3 max 116 00000100:00100000:1.0:1788876622.741304:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532236800 00000100:00100000:1.0:1788876622.741308:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532236800 00000100:00100000:0.0:1788876622.741654:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.742916:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.743031:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.744740:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532235008:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.744765:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.745450:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532234752:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.745474:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad71e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746018:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.746026:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746034:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.746038:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746048:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746063:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746071:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ad6fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.746087:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.746089:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.746091:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.746113:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532235264:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.746127:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.746344:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.746926:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1788876622.746937:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+27:3665:x1875771532236800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.746962:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:517 count 1 00010000:00010000:1.0:1788876622.747046:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.747063:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c16b30d/0xf5bf0f7e313a727e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474eb expref: 105 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.747072:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x205:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.747075:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x205:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.747079:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.747109:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c16b30d/0xf5bf0f7e313a727e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474eb expref: 105 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.747121:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c16b30d/0xf5bf0f7e313a727e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474eb expref: 105 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.747133:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532237696:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.747197:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.747418:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.747475:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511176064 00000100:00100000:0.0:1788876622.747483:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511176064 00000100:00100000:0.0:1788876622.747539:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2237 00000100:00100000:3.0:1788876622.747541:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.747554:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+90:33371:x1875771511176064:12345-192.168.203.11@tcp:101:rm.0 00000100:00100000:3.0:1788876622.747566:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.747571:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788876622.747585:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876622.747592:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048602 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.747637:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.747773:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511176448 00000100:00100000:3.0:1788876622.747779:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511176448 00010000:00010000:3.0:1788876622.747801:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.747823:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511176576 00000100:00100000:3.0:1788876622.747827:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511176576 00010000:00010000:3.0:1788876622.747844:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313a70be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047443 expref: 107 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.747865:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1788876622.747877:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+105:2397:x1875771511176448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.747888:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.747895:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.747908:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 105 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.747955:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052c20189/0xf5bf0f7e313a7166 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047482 expref: 104 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.747970:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.747974:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.747978:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.747988:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.748008:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.748044:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c86e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+103:2397:x1875771511176448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 169us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.748051:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1788876622.748087:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532236672:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.748106:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748126:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748134:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748144:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748164:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad72c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748181:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.748353:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3663:x1875771532234240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14480us (17196us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788876622.748360:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1788876622.748377:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1788876622.748385:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3662:x1875771532237056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.748401:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:518 count 1 00010000:00010000:1.0:1788876622.748416:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748428:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 107 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748435:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x206:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.748438:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x206:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.748442:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748469:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 107 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.748481:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 107 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.748495:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532237824:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.750449:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750464:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750475:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.750530:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.750535:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.750553:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750583:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048602 expref: 92 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750598:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048602 expref: 91 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750623:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876622.750626:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.750629:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10a200, rc 0) 00000100:00100000:0.0:1788876622.750658:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+91:33371:x1875771511176064:12345-192.168.203.11@tcp:101:rm.0 Request processed in 3109us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.750789:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2237 00000100:00100000:0.0:1788876622.750838:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532235520:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.750856:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.750884:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532236416:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.750896:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750912:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750920:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750929:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750936:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.750955:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.751185:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3662:x1875771532233472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18318us (43754us total) trans 8589934762 rc 0/0 00000100:00100000:0.0:1788876622.751192:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1788876622.751209:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1788876622.751218:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3662:x1875771532237440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.751251:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:521 count 1 00010000:00010000:0.0:1788876622.751268:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.751280:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 101 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.751287:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x209:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.751290:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.751294:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.751323:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 101 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.751336:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 101 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.751349:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532237952:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.751451:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.751478:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532235776:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.751491:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.751844:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.751910:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.751969:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.751991:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.752042:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532236544:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.752061:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.752142:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511177088 00000100:00100000:1.0:1788876622.752149:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511177088 00010000:00010000:1.0:1788876622.752176:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 102 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.752202:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511177344 00000100:00100000:1.0:1788876622.752205:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511177344 00010000:00010000:1.0:1788876622.752219:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ecdb26/0xf5bf0f7e313a7326 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704752a expref: 103 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.752242:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511176960 00000100:00100000:1.0:1788876622.752245:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511176960 00010000:00010000:1.0:1788876622.752256:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 104 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.752267:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511177216 00000100:00100000:1.0:1788876622.752269:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511177216 00010000:00010000:1.0:1788876622.752279:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 105 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.752297:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:1.0:1788876622.752304:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+103:2396:x1875771511177088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876622.752313:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.752318:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 103 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752330:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 103 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752355:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe49fed5/0xf5bf0f7e313a72b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047500 expref: 103 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.752360:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00010000:00010000:1.0:1788876622.752374:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x206:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1788876622.752374:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+102:2396:x1875771511177344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876622.752383:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x206:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.752386:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.752388:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752399:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752400:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ecdb26/0xf5bf0f7e313a7326 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704752a expref: 102 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752424:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ecdb26/0xf5bf0f7e313a7326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704752a expref: 102 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752435:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876622.752441:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ecdb26/0xf5bf0f7e313a7326 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704752a expref: 102 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752450:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752454:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x207:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.752461:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x207:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.752469:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752473:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752485:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752490:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752501:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752511:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.752516:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788876622.752539:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+101:2396:x1875771511177344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 169us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.752548:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:3.0:1788876622.752567:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1788876622.752574:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+105:2396:x1875771511176960:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.752597:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788876622.752650:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3664:x1875771532235904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11725us (15733us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788876622.752656:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1788876622.752686:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+100:2396:x1875771511177088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 382us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.752692:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:1.0:1788876622.752706:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:1.0:1788876622.752714:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+105:2396:x1875771511177216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.752724:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 105 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.752729:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.752739:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 105 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752742:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 105 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752765:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022337b99/0xf5bf0f7e313a719e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047497 expref: 105 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752775:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.752778:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x203:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.752783:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752790:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752804:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.752819:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+104:2396:x1875771511176960:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 246us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.752826:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00010000:00010000:3.0:1788876622.752845:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752853:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752866:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752872:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.752880:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788876622.753280:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 103 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.753301:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c840f822/0xf5bf0f7e313a712e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704746d expref: 103 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.753313:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x202:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.753317:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x202:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.753321:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.753329:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.753341:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:3664:x1875771532235648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12792us (18386us total) trans 8589934763 rc 0/0 00000100:00100000:3.0:1788876622.753351:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00010000:00010000:1.0:1788876622.753353:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876622.753374:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+102:2396:x1875771511177216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 660us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.753382:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:3.0:1788876622.754912:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532238464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.754963:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788876622.755006:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d12f1c00/2, rc 0, transno 4294967472 00000100:00100000:3.0:1788876622.755016:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532234240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.755027:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876622.755032:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532238336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.755056:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876622.755098:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.755108:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.755117:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.755125:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.755135:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1788876622.755242:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532238464 00000100:00100000:1.0:1788876622.755250:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532238464 00000100:00100000:1.0:1788876622.755287:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532238336 00000100:00100000:1.0:1788876622.755290:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532238336 00000100:00100000:1.0:1788876622.755311:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1788876622.755319:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3663:x1875771532238464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.755348:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:523 count 1 00010000:00010000:1.0:1788876622.755370:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.755386:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be8014ad/0xf5bf0f7e313a74e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475d2 expref: 99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.755395:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x20b:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.755399:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.755404:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.755428:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be8014ad/0xf5bf0f7e313a74e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475d2 expref: 99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.755439:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be8014ad/0xf5bf0f7e313a74e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475d2 expref: 99 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.755450:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532238592:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.755546:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.755559:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876622.755564:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755571:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.755575:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755583:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755594:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755624:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad756 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755641:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876622.755645:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755651:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.755655:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755662:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755673:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755680:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7b86d93/0xf5bf0f7e313ad74f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755692:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876622.755696:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755703:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7b600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.755706:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755713:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755721:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755740:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a4f333/0xf5bf0f7e313ad75d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755753:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876622.755756:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755763:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7bc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.755766:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755774:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755783:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755790:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006913ca6d/0xf5bf0f7e313ad733 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755801:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.755803:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.755805:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.755816:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755825:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755833:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755846:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad748 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.755858:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.756621:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.756644:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1788876622.756655:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3663:x1875771532238336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.756670:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:522 count 1 00010000:00010000:1.0:1788876622.756685:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.756698:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027224121/0xf5bf0f7e313a7476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475a8 expref: 99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.756706:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x20a:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.756709:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.756714:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.756747:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027224121/0xf5bf0f7e313a7476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475a8 expref: 99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.756758:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027224121/0xf5bf0f7e313a7476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475a8 expref: 99 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.756770:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532238848:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.756796:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788876622.757708:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c91880/2, rc 0, transno 4294967475 00000100:00100000:1.0:1788876622.757721:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532236032:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.757748:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa782300/2, rc 0, transno 8589934762 00000100:00100000:1.0:1788876622.757758:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532233472:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.757775:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.760193:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:3664:x1875771532234496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25926us (28877us total) trans 8589934764 rc 0/0 00000100:00100000:3.0:1788876622.760525:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1788876622.760547:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3662:x1875771532235136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20129us (27189us total) trans 8589934765 rc 0/0 00000100:00100000:0.0:1788876622.760559:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00010000:00010000:0.0:1788876622.760628:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.760821:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532238208 00000100:00100000:3.0:1788876622.760830:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532238208 00000100:00100000:3.0:1788876622.760878:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532238720 00000100:00100000:3.0:1788876622.760882:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532238720 00000100:00100000:3.0:1788876622.760905:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1788876622.760917:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+28:3665:x1875771532238208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.760949:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:519 count 1 00010000:00010000:3.0:1788876622.760978:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.761003:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e64db2c8/0xf5bf0f7e313a735e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704753f expref: 101 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.761012:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x207:0x0].0x0 since=61s v=(0 0) 00010000:00010000:3.0:1788876622.761017:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x207:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.761022:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.761052:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e64db2c8/0xf5bf0f7e313a735e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704753f expref: 101 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.762059:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e64db2c8/0xf5bf0f7e313a735e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704753f expref: 101 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.762091:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532239232:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.762309:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876622.762321:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532239104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876622.767768:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.767873:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.767912:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.767952:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.767970:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.768021:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.768043:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.768059:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511177984 00000100:00100000:3.0:1788876622.768064:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511177984 00000100:00100000:3.0:1788876622.768108:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2238 00000100:00100000:3.0:1788876622.768117:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+91:33371:x1875771511177984:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876622.768154:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876622.768175:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa786400/0xf5bf0f7e313aa4e3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ce7 expref: 91 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768199:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x45:0x0].0x0 (ffff8a13f5612a00) 00010000:00010000:3.0:1788876622.768217:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ad787 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048602 expref: 90 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768244:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:3.0:1788876622.768253:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876622.768275:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768293:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768305:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768323:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768332:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768349:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768477:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768492:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768504:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876622.768712:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].71, 64 off12736 00010000:00010000:3.0:1788876622.768754:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768764:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768772:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768789:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768798:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768804:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768823:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.768839:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768852:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768866:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768872:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.768877:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768884:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768894:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x45:0x0].0x0 (ffff8a13e7965200) 00010000:00010000:3.0:1788876622.768897:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876622.768901:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768907:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ad7cd lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768927:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768938:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768947:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768952:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.768954:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768960:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768966:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965600) 00010000:00010000:3.0:1788876622.768968:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.768971:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.768976:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad7bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876622.768986:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041468d22 reply state 00000000254cc090 transno 68719477317 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769001:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769013:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38f0d619 (ffff8a13e7965800) 00010000:00010000:3.0:1788876622.769017:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876622.769020:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876622.769055:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+91:33371:x1875771511177984:12345-192.168.203.11@tcp:36:rm.0 Request processed in 937us (1033us total) trans 68719477317 rc 0/0 00000100:00100000:3.0:1788876622.769067:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2238 00000100:00100000:3.0:1788876622.769094:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1788876622.769102:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+99:2395:x1875771511177472:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.769111:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.769119:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a32f2a/0xf5bf0f7e313a7396 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047554 expref: 99 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769136:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a32f2a/0xf5bf0f7e313a7396 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047554 expref: 99 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769161:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a32f2a/0xf5bf0f7e313a7396 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047554 expref: 99 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769174:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x208:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769180:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x208:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769186:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769207:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769243:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.769264:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+97:2395:x1875771511177472:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 162us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.769270:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1788876622.769284:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1788876622.769289:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+104:2398:x1875771511177600:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.769296:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.769300:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cccc596/0xf5bf0f7e313a720e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474c1 expref: 104 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769310:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cccc596/0xf5bf0f7e313a720e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474c1 expref: 104 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769323:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x204:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769326:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x204:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769331:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769337:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769353:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.769370:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+104:2398:x1875771511177600:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 81us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.769377:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1788876622.769390:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1788876622.769397:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+103:2395:x1875771511178240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.769406:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.769412:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea919f3a/0xf5bf0f7e313a57ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ae9 expref: 103 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769421:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea919f3a/0xf5bf0f7e313a57ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ae9 expref: 103 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769443:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769447:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.769452:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769468:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.769490:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.769515:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+103:2395:x1875771511178240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 118us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.769522:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1788876622.769555:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc180 going to sleep for 11 seconds 00010000:00010000:3.0:1788876622.770138:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876622.770144:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770152:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.770156:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770163:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770174:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x45:0x0].0x0 (ffff8a13e7965200) 00010000:00010000:3.0:1788876622.770176:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876622.770180:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770186:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad7d4 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770200:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.770204:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770211:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.770213:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770220:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770959:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770967:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d75669/0xf5bf0f7e313ad76b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770984:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.770988:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.770995:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7a600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.770998:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771005:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771015:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771022:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082da333d/0xf5bf0f7e313ad764 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771036:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.771038:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.771040:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.771594:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea919f3a/0xf5bf0f7e313a57ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ae9 expref: 100 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.771637:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532238080:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.771656:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771666:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771672:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771680:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771687:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce0d850/0xf5bf0f7e313ad795 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.771705:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876622.772724:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3664:x1875771532237568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20880us (27328us total) trans 8589934767 rc 0/0 00000100:00100000:3.0:1788876622.772734:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1788876622.773140:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532237952:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.773162:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773186:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773194:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773204:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773213:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad73a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773227:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.773337:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3665:x1875771532234624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 38661us (41912us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788876622.773345:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1788876622.773392:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.773425:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532239616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.773451:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.773657:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532239104 00000100:00100000:0.0:1788876622.773664:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532239104 00000100:00100000:0.0:1788876622.773694:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532239616 00000100:00100000:0.0:1788876622.773697:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532239616 00000100:00100000:0.0:1788876622.773711:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1788876622.773719:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3663:x1875771532239104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.773740:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:457 count 1 00010000:00010000:0.0:1788876622.773761:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773776:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 96 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773784:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c9:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876622.773788:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.773793:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773818:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 96 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773829:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 96 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.773840:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532240000:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.773887:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.773903:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1788876622.773910:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3663:x1875771532239616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.773924:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:521 count 1 00010000:00010000:0.0:1788876622.773936:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773947:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.773954:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x209:0x0].0x0 since=61s v=(0 0) 00010000:00010000:0.0:1788876622.773957:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.773961:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774158:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774168:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 99 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.774183:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532240128:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.774208:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.774780:0:43962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c16b30d/0xf5bf0f7e313a727e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370474eb expref: 99 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.774792:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532237696:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.774810:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774819:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774827:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774837:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774844:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad772 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.774858:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.774988:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3665:x1875771532236800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28053us (33737us total) trans 8589934768 rc 0/0 00000100:00100000:0.0:1788876622.774998:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000004:00080000:1.0:1788876622.775115:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f41cdc00/2, rc 0, transno 8589934765 00000100:00100000:1.0:1788876622.775129:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532235136:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.775183:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.775192:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.775200:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.775208:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.775490:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876622.775496:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11c2364/0xf5bf0f7e313ad741 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.775507:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532240256 00000100:00100000:0.0:1788876622.775512:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532240256 00000100:00100000:0.0:1788876622.775546:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1788876622.775554:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+32:3665:x1875771532240256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.775575:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:523 count 1 00010000:00010000:0.0:1788876622.775595:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.775627:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031f1118d/0xf5bf0f7e313a751e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475e7 expref: 98 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.775635:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x20b:0x0].0x0 since=61s v=(0 0) 00000100:00100000:1.0:1788876622.775638:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3662:x1875771532234880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39315us (43287us total) trans 4294967478 rc 0/0 00010000:00010000:0.0:1788876622.775639:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.775644:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.775645:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00010000:00010000:0.0:1788876622.775668:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031f1118d/0xf5bf0f7e313a751e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475e7 expref: 98 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.775678:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031f1118d/0xf5bf0f7e313a751e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475e7 expref: 98 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.775689:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532240384:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.775696:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.775709:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d12f3b80/2, rc 0, transno 4294967478 00000100:00100000:1.0:1788876622.775719:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532234880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.775946:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532240512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.776580:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.776657:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876622.776658:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532240640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.776663:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532240768:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.776689:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.776710:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532240768 00000100:00100000:0.0:1788876622.776715:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532240768 00000100:00100000:1.0:1788876622.776895:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.776919:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532240512 00000100:00100000:1.0:1788876622.776923:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532240512 00000100:00100000:1.0:1788876622.776958:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1788876622.777036:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3662:x1875771532240512:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.777051:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00002000:00080000:1.0:1788876622.777059:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:524 count 1 00010000:00010000:1.0:1788876622.777080:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.777096:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016e34079/0xf5bf0f7e313a758e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047611 expref: 98 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.777103:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x20c:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.777107:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.777110:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.777133:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016e34079/0xf5bf0f7e313a758e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047611 expref: 98 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.777144:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016e34079/0xf5bf0f7e313a758e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047611 expref: 98 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.777155:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532240896:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.777185:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00000004:00080000:1.0:1788876622.777216:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c92300/2, rc 0, transno 4294967476 00000100:00100000:1.0:1788876622.777224:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532236160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.777272:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532241024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.777296:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.777328:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876622.777485:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511178112 00000100:00100000:3.0:1788876622.777490:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511178112 00010000:00010000:3.0:1788876622.777516:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 97 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.777540:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:3.0:1788876622.777547:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+97:2395:x1875771511178112:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.777557:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.778156:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 97 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.778171:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 97 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.778193:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002758702/0xf5bf0f7e313a7406 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704757e expref: 97 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.778206:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.778210:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.778216:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.778225:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.778704:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532241024 00000100:00100000:0.0:1788876622.778708:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532241024 00000100:00100000:1.0:1788876622.778938:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532238592:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.778959:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.779009:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532237824:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.779022:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.779040:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532240640 00000100:00100000:1.0:1788876622.779043:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532240640 00000100:00100000:1.0:1788876622.779063:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1788876622.779070:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3665:x1875771532240768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.779087:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:526 count 1 00010000:00010000:1.0:1788876622.779103:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779116:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313a7636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047650 expref: 96 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779124:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x20e:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.779128:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.779131:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779157:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313a7636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047650 expref: 96 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779169:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313a7636 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047650 expref: 96 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.779182:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532241280:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.779239:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511178496 00000100:00100000:0.0:1788876622.779243:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511178496 00010000:00010000:0.0:1788876622.779260:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027224121/0xf5bf0f7e313a7476 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475a8 expref: 97 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.779273:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511178752 00000100:00100000:0.0:1788876622.779275:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511178752 00010000:00010000:0.0:1788876622.779285:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077d27032/0xf5bf0f7e313a7556 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475fc expref: 98 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.779295:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511179136 00000100:00100000:0.0:1788876622.779296:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511179136 00010000:00010000:0.0:1788876622.779306:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000033574da/0xf5bf0f7e313a73ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047569 expref: 101 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.779316:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511178368 00000100:00100000:0.0:1788876622.779318:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511178368 00010000:00010000:0.0:1788876622.779327:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be8014ad/0xf5bf0f7e313a74e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475d2 expref: 99 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.779339:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1788876622.779344:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+102:2398:x1875771511178624:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.779351:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.779355:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 102 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.779367:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 102 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.779381:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780daff0/0xf5bf0f7e313a72ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047515 expref: 102 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.779391:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x206:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.779394:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x206:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.779398:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.779406:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.779420:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876622.779467:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.779484:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779492:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779501:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779510:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779527:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.779681:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3662:x1875771532237056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31298us (37093us total) trans 8589934769 rc 0/0 00000100:00100000:1.0:1788876622.779687:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1788876622.779698:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1788876622.779703:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3663:x1875771532240640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.779714:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:525 count 1 00010000:00010000:1.0:1788876622.779743:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779760:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313a75c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047626 expref: 97 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779768:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x20d:0x0].0x0 since=61s v=(0 0) 00010000:00010000:1.0:1788876622.779770:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.779774:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779793:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313a75c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047626 expref: 97 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779803:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313a75c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047626 expref: 97 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.779812:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532241408:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.779836:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.779847:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.779853:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779860:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.779864:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779873:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779885:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779893:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad780 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779908:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.779910:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.779912:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.779934:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027224121/0xf5bf0f7e313a7476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475a8 expref: 97 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.779945:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532238848:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.779958:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779966:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779974:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779982:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.779993:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780008:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.780016:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.780020:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780026:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.780029:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780036:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780047:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780055:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad7a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780069:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.780070:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.780071:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.780158:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3663:x1875771532238336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23506us (25101us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788876622.780165:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1788876622.780179:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1788876622.780186:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3665:x1875771532241024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.780197:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:527 count 1 00010000:00010000:1.0:1788876622.780208:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780219:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d836a2f/0xf5bf0f7e313a76a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704767a expref: 96 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780226:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x20f:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.780240:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.780244:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780262:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d836a2f/0xf5bf0f7e313a76a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704767a expref: 96 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.780271:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d836a2f/0xf5bf0f7e313a76a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704767a expref: 96 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.780281:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532241536:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.780304:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788876622.780328:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa780000/2, rc 0, transno 4294967479 00000100:00100000:1.0:1788876622.780338:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532238336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.780382:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532241664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.780406:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.780425:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876622.780430:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532241152:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.780453:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.780472:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:1.0:1788876622.780478:0:43956:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_015' 00000100:00100000:0.0:1788876622.780904:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+98:2398:x1875771511178624:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1556us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.780911:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1788876622.780931:0:43962:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:0.0:1788876622.780937:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532241664 00000100:00100000:0.0:1788876622.780941:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532241664 00000100:00100000:0.0:1788876622.780959:0:43962:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 15 min 3 max 116 00000100:00100000:0.0:1788876622.780964:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532241152 00000100:00100000:0.0:1788876622.780967:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532241152 00010000:00010000:3.0:1788876622.781114:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.781144:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+94:2395:x1875771511178112:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3596us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.781152:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00010000:00010000:0.0:1788876622.781326:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.781348:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.781358:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.781367:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.781390:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.781497:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3662:x1875771532237440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30280us (36249us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788876622.781505:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1788876622.781524:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1788876622.781534:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3663:x1875771532241664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.781551:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:528 count 1 00010000:00010000:0.0:1788876622.781570:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.781590:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a50dbf4c/0xf5bf0f7e313a7716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476a4 expref: 93 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.781971:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532240896:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.781985:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782001:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.782006:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782013:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.782016:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782026:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782037:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782044:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ad78e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782059:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.782063:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031612aaf/0xf5bf0f7e313ad7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782069:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7aa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.782072:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031612aaf/0xf5bf0f7e313ad7b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782079:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031612aaf/0xf5bf0f7e313ad7b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782089:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031612aaf/0xf5bf0f7e313ad7b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782095:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031612aaf/0xf5bf0f7e313ad7b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782110:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.782111:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.782113:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.782119:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.782136:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532240384:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.782148:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.782416:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e64db2c8/0xf5bf0f7e313a735e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704753f expref: 96 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.782433:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532239232:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.782450:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.782467:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511179392 00000100:00100000:3.0:1788876622.782472:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511179392 00010000:00010000:3.0:1788876622.782494:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 96 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.782525:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511179520 00000100:00100000:3.0:1788876622.782530:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511179520 00010000:00010000:3.0:1788876622.782546:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031f1118d/0xf5bf0f7e313a751e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370475e7 expref: 97 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.782571:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511179648 00000100:00100000:3.0:1788876622.782576:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511179648 00010000:00010000:3.0:1788876622.782590:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016e34079/0xf5bf0f7e313a758e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047611 expref: 98 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782659:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.782664:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d3ac359/0xf5bf0f7e313ad7b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782672:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3c7be00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.782676:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d3ac359/0xf5bf0f7e313ad7b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782677:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x210:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.782686:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x210:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.782691:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d3ac359/0xf5bf0f7e313ad7b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782693:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.782718:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d3ac359/0xf5bf0f7e313ad7b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782732:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a50dbf4c/0xf5bf0f7e313a7716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476a4 expref: 92 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782743:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a50dbf4c/0xf5bf0f7e313a7716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476a4 expref: 92 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.782754:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532241920:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.782790:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.782813:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532240128:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.782827:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.782844:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511179776 00000100:00100000:0.0:1788876622.782847:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511179776 00010000:00010000:0.0:1788876622.782864:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 93 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.782880:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1788876622.782888:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+98:2397:x1875771511179392:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.782897:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.782902:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 98 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782918:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 98 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782933:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec535f39/0xf5bf0f7e313a743e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047593 expref: 98 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782944:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.782947:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x209:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.782952:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782960:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782978:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.782988:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.782995:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.783002:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.783009:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.783029:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876622.783029:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d3ac359/0xf5bf0f7e313ad7b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783049:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.783053:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783060:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.783065:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783079:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783091:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad79c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783100:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.783103:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783110:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10a800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.783114:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783122:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.783129:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3663:x1875771532239616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9217us (9674us total) trans 8589934771 rc 0/0 00010000:00010000:1.0:1788876622.783136:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.783140:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00010000:00010000:1.0:1788876622.783150:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c81787b/0xf5bf0f7e313ad7e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.783163:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.783167:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.783170:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.783175:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.783191:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4088380/2, rc 0, transno 8589934771 00000100:00100000:0.0:1788876622.783206:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532239616:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876622.783216:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7aae680/2, rc 0, transno 4294967481 00000100:00100000:1.0:1788876622.783238:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532238720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.783282:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876622.783290:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532242048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.783320:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876622.783964:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.783970:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad7db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783978:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.783981:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad7db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.783989:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad7db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784001:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c981e39/0xf5bf0f7e313ad7db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784009:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.784011:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.784012:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.784317:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:3.0:1788876622.784330:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+93:2397:x1875771511179776:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.784342:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.784349:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 93 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784368:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000026ac31f/0xf5bf0f7e313a5806 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046afe expref: 93 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784391:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.784395:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.784398:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784412:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784437:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.784462:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+93:2397:x1875771511179776:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 134us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.784474:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00010000:00010000:3.0:1788876622.784503:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784518:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784538:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.784545:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784833:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.784839:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784846:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.784851:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784859:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784870:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784879:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.784880:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.784882:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.784891:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784898:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784905:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784911:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.784923:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.785005:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3662:x1875771532240512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8040us (8110us total) trans 8589934773 rc 0/0 00000100:00100000:1.0:1788876622.785015:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00010000:00010000:1.0:1788876622.785030:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.785035:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785042:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.785045:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785053:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785064:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785071:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad7f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785086:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.785088:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.785089:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.785114:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c93100/2, rc 0, transno 8589934772 00010000:00010000:3.0:1788876622.785491:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.785502:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddf3c0ed/0xf5bf0f7e313ad7aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.785847:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+35:3665:x1875771532238208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24932us (25150us total) trans 8589934774 rc 0/0 00000100:00100000:3.0:1788876622.785854:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1788876622.785932:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532239744:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876622.785954:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa780700/2, rc 0, transno 8589934774 00000100:00100000:1.0:1788876622.785960:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532238208:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.785980:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.785985:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.785993:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.785997:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786005:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786018:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786026:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013cb8da7/0xf5bf0f7e313ad7e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786039:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.786041:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.786043:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.786049:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.786058:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786067:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786075:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.786083:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.786353:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1788876622.786369:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3664:x1875771532242688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.786386:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:457 count 1 00010000:00010000:0.0:1788876622.786404:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.786425:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008656139f/0xf5bf0f7e313a583e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b13 expref: 92 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.786435:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1c9:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876622.786439:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.786444:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.786478:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008656139f/0xf5bf0f7e313a583e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b13 expref: 92 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.786498:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008656139f/0xf5bf0f7e313a583e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b13 expref: 92 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.786511:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532242944:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.786544:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721480 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.786588:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c93480/2, rc 0, transno 4294967483 00000100:00100000:0.0:1788876622.786789:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532239104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.786829:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532243072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.786858:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.786887:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532243072 00000100:00100000:0.0:1788876622.786890:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532243072 00000100:00100000:0.0:1788876622.787373:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1788876622.787386:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3665:x1875771532243072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.787401:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:530 count 1 00010000:00010000:0.0:1788876622.787417:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.787431:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b6ac017/0xf5bf0f7e313a77f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476f8 expref: 91 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.787440:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x212:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.787444:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x212:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.787448:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.787473:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b6ac017/0xf5bf0f7e313a77f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476f8 expref: 91 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.787490:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b6ac017/0xf5bf0f7e313a77f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476f8 expref: 91 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.787561:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532243328:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.787673:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721900 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.787700:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa780380/2, rc 0, transno 4294967482 00000100:00100000:0.0:1788876622.787713:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532238464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.787753:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532242560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.787780:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.788070:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.790008:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532242560 00000100:00100000:1.0:1788876622.790014:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532242560 00000100:00100000:1.0:1788876622.790046:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1788876622.790054:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3663:x1875771532242560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.790074:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:528 count 1 00010000:00010000:1.0:1788876622.790094:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.790100:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532243840 00000100:00100000:0.0:1788876622.790106:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532243840 00010000:00010000:1.0:1788876622.790111:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099d6ba70/0xf5bf0f7e313a774e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476b9 expref: 92 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790122:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x210:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.790126:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x210:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876622.790131:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00010000:00010000:1.0:1788876622.790131:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.790141:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+40:3665:x1875771532243840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.790156:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:532 count 1 00010000:00010000:1.0:1788876622.790171:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099d6ba70/0xf5bf0f7e313a774e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476b9 expref: 92 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.790173:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790197:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099d6ba70/0xf5bf0f7e313a774e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476b9 expref: 92 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.790198:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000124f82c5/0xf5bf0f7e313a78d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704774c expref: 91 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.790220:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x214:0x0].0x0 since=60s v=(0 0) 00000100:00100000:1.0:1788876622.790248:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532243968:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.790295:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.790328:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.790334:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad867 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790341:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.790344:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad867 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790352:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad867 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790362:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x46:0x0].0x0 (ffff8a13c4c77200) 00010000:00010000:1.0:1788876622.790365:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.790368:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad867 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790374:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad867 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790387:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.790389:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.790390:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.790419:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313a75c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047626 expref: 91 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.790432:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532241408:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.790452:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790462:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790469:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790476:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790482:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.790496:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.791198:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x214:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.791206:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791252:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000124f82c5/0xf5bf0f7e313a78d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704774c expref: 90 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791263:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000124f82c5/0xf5bf0f7e313a78d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704774c expref: 90 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.791277:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532244096:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.791315:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040780 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.791338:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532243584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.791370:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.791414:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c86eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+92:2397:x1875771511179392:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 8527us (10207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.791423:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00010000:00010000:0.0:1788876622.791750:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313a7636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047650 expref: 90 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.791763:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532241280:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.791779:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791788:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791801:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791810:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791817:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.791833:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.791946:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3665:x1875771532240768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12876us (15256us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788876622.791953:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1788876622.791969:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532243584 00000100:00100000:0.0:1788876622.791974:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532243584 00000100:00100000:0.0:1788876622.791996:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1788876622.792003:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3663:x1875771532243584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.792021:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:531 count 1 00010000:00010000:0.0:1788876622.792038:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.792050:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075d67969/0xf5bf0f7e313a7866 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047722 expref: 89 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.792057:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x213:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.792061:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x213:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.792065:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.792085:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075d67969/0xf5bf0f7e313a7866 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047722 expref: 89 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.792095:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075d67969/0xf5bf0f7e313a7866 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047722 expref: 89 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.792106:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532244224:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.792132:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.792161:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fad80/2, rc 0, transno 4294967485 00000100:00100000:0.0:1788876622.792172:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532240768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.793058:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876622.793071:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532244352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.793108:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.793147:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532244352 00000100:00100000:0.0:1788876622.793151:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532244352 00010000:00010000:0.0:1788876622.793191:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788876622.794441:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+41:3665:x1875771532240256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18886us (19030us total) trans 8589934775 rc 0/0 00000100:00100000:0.0:1788876622.794451:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000004:00080000:0.0:1788876622.794492:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cff7d880/2, rc 0, transno 8589934775 00000100:00100000:0.0:1788876622.794515:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532240256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.794535:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1788876622.794544:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3663:x1875771532244352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876622.794567:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:533 count 1 00010000:00010000:0.0:1788876622.794597:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.794946:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce962bde/0xf5bf0f7e313a7946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047776 expref: 89 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.794953:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x215:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.794957:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x215:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.794961:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.794985:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce962bde/0xf5bf0f7e313a7946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047776 expref: 89 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.794996:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce962bde/0xf5bf0f7e313a7946 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047776 expref: 89 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.795009:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532244608:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.795090:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.795937:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+43:3663:x1875771532240640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16230us (18604us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788876622.795947:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1788876622.795972:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1788876622.795982:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3664:x1875771532243712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.796004:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:530 count 1 00010000:00010000:1.0:1788876622.796024:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad88a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796038:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b89b34b7/0xf5bf0f7e313a782e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704770d expref: 91 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796046:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x212:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.796049:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x212:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.796053:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313ad88a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796077:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b89b34b7/0xf5bf0f7e313a782e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704770d expref: 91 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796088:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b89b34b7/0xf5bf0f7e313a782e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704770d expref: 91 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.796100:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532244736:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.796139:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.796156:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876622.796163:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796171:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.796175:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796185:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796203:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796211:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796240:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.796244:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796250:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.796253:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796260:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796270:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796276:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad80c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796288:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.796292:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796298:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.796301:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796309:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796319:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796326:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ad7f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796339:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796341:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796342:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796350:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796355:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796382:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d836a2f/0xf5bf0f7e313a76a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704767a expref: 89 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.796393:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532241536:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.796413:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796423:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796435:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796444:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796452:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796467:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.796477:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.796480:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796487:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.796490:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796497:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796507:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796514:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad81a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.796529:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796531:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.796532:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.796684:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3665:x1875771532241024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16498us (19386us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788876622.796691:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000004:00080000:1.0:1788876622.796827:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fb100/2, rc 0, transno 4294967486 00000100:00100000:1.0:1788876622.796840:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532241024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.796890:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876622.796900:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532244864:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.796929:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.796963:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532244864 00000100:00100000:1.0:1788876622.796968:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532244864 00000100:00100000:1.0:1788876622.796994:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1788876622.797001:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3662:x1875771532243456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.797016:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:529 count 1 00010000:00010000:1.0:1788876622.797030:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.797041:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006bd1715/0xf5bf0f7e313a77be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476e3 expref: 91 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.797049:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x211:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.797052:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x211:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.797056:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.797078:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006bd1715/0xf5bf0f7e313a77be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476e3 expref: 91 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.797088:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006bd1715/0xf5bf0f7e313a77be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476e3 expref: 91 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.797098:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532244992:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.797129:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.797524:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fa300/2, rc 0, transno 4294967484 00000100:00100000:0.0:1788876622.797543:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532240640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.799334:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532245120:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.799411:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.799902:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532245120 00000100:00100000:0.0:1788876622.799910:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532245120 00000100:00100000:0.0:1788876622.799955:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1788876622.799965:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+41:3662:x1875771532244480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.799993:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:531 count 1 00010000:00010000:0.0:1788876622.800019:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.800039:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 91 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.800048:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x213:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.800051:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x213:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.800055:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.800083:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 91 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.800096:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 91 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.800108:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:43963:1875771532245248:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.800619:0:43956:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 16 min 3 max 116 00000100:00100000:1.0:1788876622.800628:0:43956:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_016' 00000100:00100000:1.0:1788876622.803280:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532242176:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.803310:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804562:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a50dbf4c/0xf5bf0f7e313a7716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476a4 expref: 89 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.804579:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532241920:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.804595:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804627:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804633:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804644:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804718:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.804778:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.807433:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.807445:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807459:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.807463:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807478:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807497:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807506:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313ad821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807531:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.807536:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b60d71cf/0xf5bf0f7e313ad828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807542:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5fea00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.807545:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b60d71cf/0xf5bf0f7e313ad828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807553:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b60d71cf/0xf5bf0f7e313ad828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807565:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b60d71cf/0xf5bf0f7e313ad828 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807572:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.807573:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.807576:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.807598:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.807638:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807657:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807668:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807676:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.807696:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.807899:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3665:x1875771532242048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24349us (24575us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788876622.807908:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1788876622.809059:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1788876622.809076:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3665:x1875771532244864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.809113:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:534 count 1 00010000:00010000:1.0:1788876622.809142:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.809177:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 86 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.809206:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x216:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.809212:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.809218:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.809267:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 86 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.809292:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 86 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.809329:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532245376:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.810115:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810156:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810181:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810207:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810250:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810277:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810336:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810360:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810447:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810474:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810496:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810588:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.810682:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511180928 00000100:00100000:3.0:1788876622.810686:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511180928 00000100:00100000:3.0:1788876622.810718:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2241 00000100:00100000:3.0:1788876622.810726:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+92:33371:x1875771511180928:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876622.810744:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876622.810763:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048610 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810826:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810839:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810849:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876622.810891:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876622.810895:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876622.810913:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810937:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048610 expref: 94 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810962:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ad8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048610 expref: 93 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.810987:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965200) 00010000:00010000:3.0:1788876622.810991:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876622.810995:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873e00, rc 0) 00000100:00100000:3.0:1788876622.811048:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+93:33371:x1875771511180928:12345-192.168.203.11@tcp:101:rm.0 Request processed in 318us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.811065:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2241 00000100:00100000:0.0:1788876622.811860:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3663:x1875771532241664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30324us (31448us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788876622.811872:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00010000:00010000:0.0:1788876622.811931:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6ac017/0xf5bf0f7e313a77f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476f8 expref: 89 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.811952:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532243328:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.811973:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.811990:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812000:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812011:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812019:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812051:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.812205:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3665:x1875771532243072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24820us (25345us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1788876622.812223:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00010000:00010000:0.0:1788876622.812273:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008656139f/0xf5bf0f7e313a583e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b13 expref: 91 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.812521:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532242944:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.812535:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812545:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812552:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812561:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812567:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812580:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788876622.812791:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3664:x1875771532242688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26427us (26569us total) trans 8589934777 rc 0/0 00000100:00100000:0.0:1788876622.812798:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00010000:00010000:0.0:1788876622.812829:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075d67969/0xf5bf0f7e313a7866 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047722 expref: 85 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.812840:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532244224:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.812857:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812866:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812873:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812881:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812888:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.812896:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788876622.812964:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3663:x1875771532243584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20962us (21593us total) trans 4294967490 rc 0/0 00000100:00100000:0.0:1788876622.812971:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1788876622.813894:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.813909:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788876622.813916:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813926:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ffa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.813930:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813940:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813957:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813966:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000125211/0xf5bf0f7e313ad82f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813987:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876622.813991:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.813998:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.814000:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814006:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814015:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814022:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ad84b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814036:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.814039:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814045:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.814049:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814055:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814065:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814072:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ad83d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814084:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.814088:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814094:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.814097:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814104:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814113:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814119:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ad87c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.814133:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.814135:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.814136:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.814143:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.814177:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb29aa00/2, rc 0, transno 4294967489 00000100:00100000:1.0:1788876622.814190:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532243072:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876622.814202:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3658a80/2, rc 0, transno 4294967488 00000100:00100000:1.0:1788876622.814206:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532242048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.814440:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532245632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.814549:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.814582:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876622.814588:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532245760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.814868:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.814899:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532245632 00000100:00100000:1.0:1788876622.814906:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532245632 00000100:00100000:1.0:1788876622.814941:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532245760 00000100:00100000:1.0:1788876622.814944:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532245760 00000100:00100000:1.0:1788876622.814961:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:1.0:1788876622.814969:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3662:x1875771532245632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.814993:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:535 count 1 00010000:00010000:1.0:1788876622.815014:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815032:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 84 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815046:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x217:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.815050:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x217:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.815054:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815079:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 84 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815091:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 84 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.815103:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532245888:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.815131:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788876622.815146:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1788876622.815153:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3662:x1875771532245760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.815166:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:536 count 1 00010000:00010000:1.0:1788876622.815178:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815189:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 84 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.815197:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x218:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.815200:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x218:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.815206:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.815239:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1788876622.815251:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+89:2398:x1875771511182336:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.815263:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.815270:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 89 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815282:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 89 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815309:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x213:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.815312:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x213:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.815317:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815326:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815440:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.815526:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+89:2398:x1875771511182336:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 279us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.815534:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00010000:00010000:0.0:1788876622.815577:0:43962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000124f82c5/0xf5bf0f7e313a78d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704774c expref: 84 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.815588:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532244096:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.815835:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815848:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815855:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815864:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815871:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.815886:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.816019:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+47:3665:x1875771532243840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25880us (27949us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1788876622.816026:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000004:00080000:0.0:1788876622.816059:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c92680/2, rc 0, transno 4294967490 00000100:00100000:0.0:1788876622.816071:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532243584:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876622.816087:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7aad880/2, rc 0, transno 8589934776 00000100:00100000:0.0:1788876622.816096:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532241152:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876622.816107:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cff7df80/2, rc 0, transno 4294967487 00000100:00100000:0.0:1788876622.816110:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532241664:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876622.816170:0:43961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce962bde/0xf5bf0f7e313a7946 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047776 expref: 83 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.816182:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532244608:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.816195:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.816204:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.816211:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.816218:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.816225:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.816255:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876622.816565:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 82 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816577:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 82 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.816588:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532246144:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.816696:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+47:3663:x1875771532244352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22153us (23586us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1788876622.816703:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1788876622.816766:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876622.816790:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.816795:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816803:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.816807:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816816:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816829:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816836:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ad875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816852:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.816855:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816860:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.816863:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816870:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816877:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816883:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003bc40b3/0xf5bf0f7e313ad883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.816893:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.816894:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.816895:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.816900:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.816920:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4677b80/2, rc 0, transno 4294967491 00000100:00100000:3.0:1788876622.816922:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.816929:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532243840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.816933:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876622.816942:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532246016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876622.816967:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876622.817008:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d6ba70/0xf5bf0f7e313a774e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476b9 expref: 88 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.817019:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532243968:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.817033:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817041:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817049:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817058:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817066:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817077:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876622.817122:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532245504:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.817135:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.817161:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3663:x1875771532242560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27108us (29379us total) trans 8589934778 rc 0/0 00000100:00100000:1.0:1788876622.817167:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1788876622.817183:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246016 00000100:00100000:1.0:1788876622.817187:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246016 00000100:00100000:1.0:1788876622.817213:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1788876622.817220:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3665:x1875771532246016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876622.817250:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:537 count 1 00010000:00010000:1.0:1788876622.817266:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817279:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 82 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817296:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x219:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.817300:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.817304:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.817324:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511182464 00010000:00010000:1.0:1788876622.817325:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 82 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.817328:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511182464 00010000:00010000:3.0:1788876622.817345:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d78b8a7a/0xf5bf0f7e313a5876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b28 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.817363:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:3.0:1788876622.817369:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c6678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+83:2397:x1875771511182464:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.817377:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.817382:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d78b8a7a/0xf5bf0f7e313a5876 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b28 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.817392:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 83 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817392:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d78b8a7a/0xf5bf0f7e313a5876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b28 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.817403:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532246272:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.817407:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78b8a7a/0xf5bf0f7e313a5876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b28 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817417:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.817420:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.817424:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817432:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.817435:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28846c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788876622.817451:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.817471:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c6678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+82:2397:x1875771511182464:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 102us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.817478:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00010000:00010000:3.0:1788876622.817501:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817510:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817518:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.817525:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788876622.817807:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4676d80/2, rc 0, transno 4294967492 00000100:00100000:0.0:1788876622.817819:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532244352:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876622.817829:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff5e5500/2, rc 0, transno 8589934778 00000100:00100000:0.0:1788876622.817833:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532242560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.817859:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca0409c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876622.817873:0:43963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d21076e/0xf5bf0f7e313a789e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047737 expref: 87 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.817885:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:43963:1875771532245248:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.817897:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.817906:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.817912:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.817920:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.817928:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.826580:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788876622.826724:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788876622.826921:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+42:3662:x1875771532244480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26953us (32084us total) trans 8589934779 rc 0/0 00000100:00100000:0.0:1788876622.826932:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000004:00080000:0.0:1788876622.826986:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f45d8380/2, rc 0, transno 8589934779 00000100:00100000:0.0:1788876622.826993:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532244480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.827445:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532245120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18366us (28033us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1788876622.827453:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1788876622.827691:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532245888:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.827714:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.828281:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.828369:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.828371:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532246144:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876622.828385:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.828387:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.828408:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.828511:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511182592 00000100:00100000:3.0:1788876622.828519:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511182592 00010000:00010000:3.0:1788876622.828552:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 82 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.828591:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511182720 00000100:00100000:3.0:1788876622.828594:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511182720 00000100:00100000:0.0:1788876622.828597:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511182848 00000100:00100000:0.0:1788876622.828617:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511182848 00010000:00010000:3.0:1788876622.828623:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 84 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.828631:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 84 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.828644:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:3.0:1788876622.828652:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2398:x1875771511182592:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.828665:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.828671:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 84 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.828684:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 84 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.828707:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.828712:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.828717:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.828728:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.828747:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.828788:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2398:x1875771511182592:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 136us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.829368:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:3.0:1788876622.829375:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:0.0:1788876622.829379:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2397:x1875771511182720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.829390:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.829396:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 83 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.829400:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00010000:00010000:0.0:1788876622.829407:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 83 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.829407:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+83:2398:x1875771511182848:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.829415:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876622.829416:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876622.829420:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 83 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829423:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000105b63a1/0xf5bf0f7e313a7a26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477ca expref: 83 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829427:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.829433:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 83 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829440:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x217:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.829448:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.829449:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x217:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.829457:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829458:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829481:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829482:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829512:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876622.829515:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b80d6c/0xf5bf0f7e313a7a96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477f4 expref: 82 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829520:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.829527:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x218:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.829530:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313ad86e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.829532:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x218:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876622.829535:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+81:2397:x1875771511182720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 159us (1166us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876622.829540:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.829550:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00010000:00010000:3.0:1788876622.829556:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829571:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876622.829576:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.829582:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.829583:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829591:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.829598:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829619:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829627:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829635:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829642:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829645:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829652:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb782a54/0xf5bf0f7e313ad8a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829680:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788876622.829682:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876622.829687:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829694:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10a200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.829696:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829703:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829712:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829720:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c50f55cf/0xf5bf0f7e313ad898 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829735:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.829740:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009489e08a/0xf5bf0f7e313ad836 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.829749:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+80:2398:x1875771511182848:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 195us (1214us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876622.829750:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5ff000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.829756:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009489e08a/0xf5bf0f7e313ad836 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.829771:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00010000:00010000:1.0:1788876622.829790:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009489e08a/0xf5bf0f7e313ad836 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829802:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009489e08a/0xf5bf0f7e313ad836 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.829811:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532245632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14840us (15260us total) trans 4294967494 rc 0/0 00010000:00010000:1.0:1788876622.829812:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.829819:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.829823:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00010000:00010000:1.0:1788876622.829831:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.829836:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829844:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829847:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829862:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829863:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829888:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313ad8bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829890:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.829913:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.829913:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.829917:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.829921:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876622.829945:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.830009:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532245760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14857us (15142us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788876622.830018:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000004:00080000:0.0:1788876622.830050:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3355880/2, rc 0, transno 4294967495 00000100:00100000:0.0:1788876622.830059:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532245760:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876622.830066:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3357480/2, rc 0, transno 4294967494 00000100:00100000:0.0:1788876622.830070:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532245632:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876622.830736:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb29bb80/2, rc 0, transno 8589934777 00010000:00010000:3.0:1788876622.830743:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.830746:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532242688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.830752:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788876622.830753:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.830761:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.830764:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532246400:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876622.830768:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.830777:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876622.830804:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.830854:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532246528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.830880:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.830898:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876622.830903:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532246656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.830922:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876622.830948:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3662:x1875771532242432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43686us (44285us total) trans 8589934780 rc 0/0 00000100:00100000:3.0:1788876622.830955:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000004:00080000:0.0:1788876622.831332:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff5e7800/2, rc 0, transno 8589934780 00000100:00100000:0.0:1788876622.831341:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532242432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.831383:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532246784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.831410:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876622.835883:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246400 00000100:00100000:3.0:1788876622.835889:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246400 00000100:00100000:3.0:1788876622.835917:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246528 00000100:00100000:3.0:1788876622.835922:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246528 00000100:00100000:3.0:1788876622.835943:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246656 00000100:00100000:3.0:1788876622.835948:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246656 00000100:00100000:3.0:1788876622.835975:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1788876622.835984:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbe98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3662:x1875771532246528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.836005:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:533 count 1 00010000:00010000:3.0:1788876622.836021:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.836043:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 85 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.836056:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x215:0x0].0x0 since=60s v=(0 0) 00010000:00010000:3.0:1788876622.836061:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x215:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.836084:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 4/0,1 mode: --/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.836115:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 85 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.836146:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 85 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.836175:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532247168:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876622.836996:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246784 00000100:00100000:1.0:1788876622.837009:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246784 00000100:00100000:1.0:1788876622.837064:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1788876622.837073:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3662:x1875771532246656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876622.837092:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:534 count 1 00010000:00010000:1.0:1788876622.837109:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.837124:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 85 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.837132:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x216:0x0].0x0 since=60s v=(0 0) 00010000:00010000:1.0:1788876622.837137:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.837142:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.837168:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 85 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.837178:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 85 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.837190:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532247296:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.837754:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788876622.837896:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.838009:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1788876622.838021:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3664:x1875771532246784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876622.838037:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:535 count 1 00010000:00010000:3.0:1788876622.838053:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.838065:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313a7a5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477df expref: 85 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.838091:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x217:0x0].0x0 since=60s v=(0 0) 00010000:00010000:3.0:1788876622.838094:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x217:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.838098:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.838121:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313a7a5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477df expref: 85 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.838132:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313a7a5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477df expref: 85 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.838142:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532247424:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876622.838173:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.839176:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511183232 00000100:00100000:0.0:1788876622.839182:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511183232 00010000:00010000:0.0:1788876622.839219:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 80 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.839270:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:1.0:1788876622.839271:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.839281:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+80:2398:x1875771511183232:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.839347:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876622.839353:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 80 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.839369:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 80 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839387:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876622.839389:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.839394:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876622.839396:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.839399:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839420:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876622.839422:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839426:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839442:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.839446:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876622.839458:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839467:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070249a0f/0xf5bf0f7e313ad8c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.839475:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+80:2398:x1875771511183232:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 195us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.839484:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00010000:00010000:1.0:1788876622.839489:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.839495:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839503:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52a00 already unused, calling callback (ffffffffc0cf24f0) 00000004:00080000:0.0:1788876622.839542:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff5e4a80/2, rc 0, transno 8589934781 00000100:00100000:0.0:1788876622.839554:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532242304:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.839574:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839584:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839595:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839632:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313ad844 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839648:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.839651:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad8fa lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839658:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.839661:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad8fa lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839668:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad8fa lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839677:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x47:0x0].0x0 (ffff8a13c4c77c00) 00010000:00010000:1.0:1788876622.839680:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.839683:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad8fa lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839690:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad8fa lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839703:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.839705:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.839707:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.839715:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.839730:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532246912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.839791:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532247552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876622.839821:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876622.839847:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876622.839866:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532247552 00000100:00100000:0.0:1788876622.839871:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532247552 00000004:00080000:1.0:1788876622.839889:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f8700/2, rc 0, transno 4294967493 00000100:00100000:0.0:1788876622.839899:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532246912 00000100:00100000:1.0:1788876622.839904:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532245120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876622.839905:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532246912 00010000:00010000:1.0:1788876622.839943:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313a7b06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704781e expref: 79 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.839955:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532246272:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.839973:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839984:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.839991:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.840002:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.840011:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6ddf40/0xf5bf0f7e313ad8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.840024:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876622.840041:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1788876622.840050:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3662:x1875771532247552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.840067:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:537 count 1 00010000:00010000:0.0:1788876622.840085:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840099:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 85 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840107:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x219:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.840110:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.840114:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840135:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 85 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840146:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 85 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.840156:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532247680:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.840184:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876622.840210:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1788876622.840218:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3665:x1875771532246912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876622.840306:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:536 count 1 00010000:00010000:0.0:1788876622.840321:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840338:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 85 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840363:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x218:0x0].0x0 since=60s v=(0 0) 00010000:00010000:0.0:1788876622.840369:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x218:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.840379:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840406:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 84 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.840433:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 84 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.840460:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532247808:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876622.840489:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca0403c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788876622.840828:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c90e00/2, rc 0, transno 8589934782 00000100:00100000:0.0:1788876622.840838:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532243712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876622.841371:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532246016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24149us (24401us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788876622.841379:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00010000:00010000:1.0:1788876622.841400:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876622.841417:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4676a00/2, rc 0, transno 4294967496 00000100:00100000:1.0:1788876622.841428:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532246016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876622.841461:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ea03fc0/0xf5bf0f7e313a79b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477a0 expref: 78 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.841472:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532245376:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.841486:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.841495:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.841502:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.841577:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.841586:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313ad89f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.841625:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.841701:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532244864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32632us (44770us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788876622.841707:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000004:00080000:1.0:1788876622.841734:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3659c00/2, rc 0, transno 4294967497 00000100:00100000:1.0:1788876622.841743:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532244864:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876622.841766:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bd1715/0xf5bf0f7e313a77be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370476e3 expref: 84 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.842182:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532244992:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.842196:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.842204:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.842211:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.842219:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.842236:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313ad891 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.842255:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.842348:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532243456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 45346us (48931us total) trans 8589934783 rc 0/0 00000100:00100000:1.0:1788876622.842355:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000004:00080000:0.0:1788876622.842771:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3035180/2, rc 0, transno 8589934783 00000100:00100000:0.0:1788876622.842782:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532243456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.843281:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.843309:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.843341:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532247424:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.843360:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.843383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511183616 00000100:00100000:3.0:1788876622.843388:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511183616 00010000:00010000:3.0:1788876622.843416:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 84 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.843449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1788876622.843458:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2397:x1875771511183616:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.843472:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.843478:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 84 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.843490:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 84 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.843587:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x215:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.843592:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x215:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.843598:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.843626:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.843645:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.843678:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2397:x1875771511183616:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 220us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.843685:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00010000:00010000:3.0:1788876622.843719:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009924f527/0xf5bf0f7e313a797e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704778b expref: 83 pid: 10319 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.843738:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532247168:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876622.843752:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.843762:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.844212:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.844225:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.844243:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.844258:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788876622.844395:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbe98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532246528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8412us (13513us total) trans 8589934784 rc 0/0 00000100:00100000:3.0:1788876622.844402:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00010000:00010000:1.0:1788876622.844883:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.844890:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.844898:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.844901:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.844910:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.844923:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.844930:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2409823/0xf5bf0f7e313ad8ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.844949:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.844951:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.844953:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876622.845187:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d12f2300/2, rc 0, transno 8589934784 00000100:00100000:0.0:1788876622.845199:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532246528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876622.850113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511183488 00000100:00100000:3.0:1788876622.850122:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511183488 00010000:00010000:3.0:1788876622.850158:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ce1ec5/0xf5bf0f7e313a790e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047761 expref: 83 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.850195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511183744 00000100:00100000:3.0:1788876622.850199:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511183744 00010000:00010000:3.0:1788876622.850215:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313a7a5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477df expref: 84 pid: 8453 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.850240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511184128 00000100:00100000:3.0:1788876622.850244:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511184128 00010000:00010000:3.0:1788876622.850262:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 86 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.850297:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1788876622.850310:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+87:2398:x1875771511183488:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.850325:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.850336:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0ce1ec5/0xf5bf0f7e313a790e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047761 expref: 87 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850356:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0ce1ec5/0xf5bf0f7e313a790e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047761 expref: 87 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ce1ec5/0xf5bf0f7e313a790e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047761 expref: 87 pid: 8455 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850412:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x214:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850422:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x214:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850430:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850459:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850493:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.850543:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+85:2398:x1875771511183488:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 236us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.850549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1788876622.850567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:3.0:1788876622.850573:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2397:x1875771511183872:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.850582:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.850586:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 84 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850595:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 84 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850633:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850636:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x216:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850640:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850647:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850659:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876622.850677:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+84:2397:x1875771511183872:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 104us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.850683:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:3.0:1788876622.850697:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:3.0:1788876622.850703:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+83:2397:x1875771511184128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876622.850711:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.850715:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850725:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850737:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9567305/0xf5bf0f7e313a7ace lrc: 0/0,0 mode: --/PW res: [0x280000401:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047809 expref: 83 pid: 8456 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.850747:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x218:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850750:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x218:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876622.850754:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.850755:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00010000:00010000:3.0:1788876622.850762:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.850765:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+82:2397:x1875771511184000:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876622.850777:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876622.850779:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.850782:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 82 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.850791:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 82 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.850796:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+82:2397:x1875771511184128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 94us (771us total) trans 0 rc 0/0 00010000:00010000:0.0:1788876622.850804:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313a7b3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047833 expref: 82 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876622.850805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00010000:00010000:0.0:1788876622.850814:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.850817:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x219:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876622.850821:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.850828:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.850847:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876622.850873:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+79:2397:x1875771511184000:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 110us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.850884:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00010000:00010000:1.0:1788876622.851259:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000991feec0/0xf5bf0f7e313a79ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370477b5 expref: 78 pid: 17045 timeout: 1710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.851273:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532247296:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876622.851287:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851296:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851304:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851317:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851324:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851337:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876622.851439:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3662:x1875771532246656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14367us (20515us total) trans 8589934786 rc 0/0 00000100:00100000:1.0:1788876622.851447:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000004:00080000:0.0:1788876622.851666:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cff7ed80/2, rc 0, transno 8589934786 00000100:00100000:0.0:1788876622.851678:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532246656:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.851928:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876622.851936:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851943:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.851948:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851956:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851971:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851979:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066a4defc/0xf5bf0f7e313ad901 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.851996:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.852000:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.852006:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.852009:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.852016:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.852026:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.852032:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1be23b0/0xf5bf0f7e313ad8f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.852045:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.852047:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.852048:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.853440:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.853801:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.853823:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.853835:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.853844:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.853864:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876622.854162:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532247552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14112us (14337us total) trans 8589934787 rc 0/0 00000100:00100000:1.0:1788876622.854171:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00010000:00010000:1.0:1788876622.854198:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.854204:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.854212:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ac00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.854216:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.854224:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.854252:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.854261:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017a70097/0xf5bf0f7e313ad908 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.854281:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.854283:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.854284:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.857166:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.857173:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.857181:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.857185:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.857193:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.857210:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.857219:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313ad8e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.857249:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.857251:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.857255:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.857268:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.857279:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.857734:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097086511/0xf5bf0f7e313ad90f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.857757:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876622.857879:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532246912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17660us (18031us total) trans 8589934789 rc 0/0 00000100:00100000:3.0:1788876622.857887:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1788876622.857958:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.858113:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511184384 00000100:00100000:1.0:1788876622.858122:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511184384 00000100:00100000:1.0:1788876622.858169:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2244 00000100:00100000:1.0:1788876622.858178:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+94:33371:x1875771511184384:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876622.858332:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000004:00080000:0.0:1788876622.858336:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4675f80/2, rc 0, transno 8589934785 00000100:00100000:0.0:1788876622.858353:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532246784:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.858354:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313aa0bb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c07 expref: 94 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858372:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2d:0x0].0x0 (ffff8a13fa64b600) 00000004:00080000:0.0:1788876622.858382:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4674000/2, rc 0, transno 8589934787 00000100:00100000:0.0:1788876622.858391:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532247552:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.858391:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313ad91d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048617 expref: 93 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858406:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b400) 00010000:00010000:1.0:1788876622.858413:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1788876622.858435:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d12f0a80/2, rc 0, transno 8589934788 00010000:00010000:1.0:1788876622.858436:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876622.858446:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532246400:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876622.858451:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858463:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858474:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858481:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858487:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858689:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858698:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.858706:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788876622.858801:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4674a80/2, rc 0, transno 8589934789 00000100:00100000:0.0:1788876622.858815:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532246912:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1788876622.858985:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].73, 64 off12864 00010000:00010000:1.0:1788876622.859027:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859037:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859046:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859053:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859058:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859064:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ad939 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859115:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.859131:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859152:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859159:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859164:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.859168:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859174:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859183:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2d:0x0].0x0 (ffff8a13ff372100) 00010000:00010000:1.0:1788876622.859186:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.859198:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859205:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad932 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859221:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859235:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859242:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859247:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.859251:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859258:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859265:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876622.859268:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.859271:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859277:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad924 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.859290:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5541cda reply state 00000000cdc971d3 transno 68719477320 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859300:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.859306:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x684c3f1c (ffff8a13ff372900) 00010000:00010000:1.0:1788876622.859308:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.859310:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876622.859379:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+94:33371:x1875771511184384:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1200us (1421us total) trans 68719477320 rc 0/0 00000100:00100000:1.0:1788876622.859386:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2244 00000100:00100000:3.0:1788876622.884589:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511184768 00000100:00100000:3.0:1788876622.884620:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511184768 00010000:00010000:1.0:1788876622.887328:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.887338:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ad963 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.887348:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.887351:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ad963 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.887360:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ad963 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.887441:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x48:0x0].0x0 (ffff8a13fae0b100) 00010000:00010000:1.0:1788876622.887444:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.887449:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ad963 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.887455:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ad963 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.887477:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.887479:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.887481:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.889929:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.893897:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511184896 00000100:00100000:1.0:1788876622.893912:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511184896 00000100:00100000:1.0:1788876622.894235:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2247 00000100:00100000:1.0:1788876622.894256:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+95:33371:x1875771511184896:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876622.894285:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876622.894309:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad96a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048625 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894376:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894392:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894404:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876622.894453:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876622.894456:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876622.894475:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894501:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313ad96a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048625 expref: 97 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894958:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048625 expref: 96 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.894969:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876622.894972:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876622.894976:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a87600, rc 0) 00000100:00100000:1.0:1788876622.895052:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+96:33371:x1875771511184896:12345-192.168.203.11@tcp:101:rm.0 Request processed in 806us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.895060:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2247 00000100:00100000:0.0:1788876622.901265:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511185152 00000100:00100000:0.0:1788876622.901276:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511185152 00000100:00100000:0.0:1788876622.901339:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2248 00000100:00100000:0.0:1788876622.901349:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+96:33371:x1875771511185152:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.901404:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.901431:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa786c00/0xf5bf0f7e313aa56f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d03 expref: 96 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901452:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x49:0x0].0x0 (ffff8a13f5612300) 00010000:00010000:0.0:1788876622.901470:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ad971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048625 expref: 95 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901480:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:0.0:1788876622.901487:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.901796:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901811:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901823:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901836:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901844:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901851:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901951:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901960:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.901967:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876622.902178:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].74, 64 off12928 00000004:00080000:0.0:1788876622.902188:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1610797584870ns, next at 1611797581869ns, rc = 0 00010000:00010000:0.0:1788876622.902245:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902259:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902267:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902274:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902281:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902288:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313ad98d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902309:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876622.902326:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902332:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902339:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902345:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ae00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.902348:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902355:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902367:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x49:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876622.902369:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876622.902373:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902379:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad986 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902395:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902401:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902406:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902410:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876622.902413:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902418:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902424:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:0.0:1788876622.902426:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876622.902428:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902434:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad978 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876622.902450:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b8a738 reply state 00000000e5643b69 transno 68719477322 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902461:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.902467:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe3db4e5b (ffff8a13fa4ad900) 00010000:00010000:0.0:1788876622.902469:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876622.902471:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876622.902569:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+96:33371:x1875771511185152:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1220us (1424us total) trans 68719477322 rc 0/0 00000100:00100000:0.0:1788876622.902576:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2248 00000100:00100000:3.0:1788876622.906262:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511185280 00000100:00100000:3.0:1788876622.906272:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511185280 00000100:00100000:3.0:1788876622.906329:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2249 00000100:00100000:3.0:1788876622.906339:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+96:33371:x1875771511185280:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876622.906363:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876622.906387:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad994 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704862c expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906455:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ad99b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906469:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ad99b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906480:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ad99b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876622.906537:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876622.906540:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876622.906560:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ad99b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906582:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ad994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704862c expref: 98 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906597:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ad99b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704862c expref: 97 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.906642:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965600) 00010000:00010000:3.0:1788876622.906645:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876622.906649:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873800, rc 0) 00000100:00100000:3.0:1788876622.906705:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+97:33371:x1875771511185280:12345-192.168.203.11@tcp:101:rm.0 Request processed in 368us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.906712:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2249 00000100:00100000:1.0:1788876622.914002:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876622.915362:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876622.915369:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313ad9b7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.915375:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876622.915379:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313ad9b7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.915386:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313ad9b7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.915395:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4a:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:3.0:1788876622.915397:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876622.915400:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313ad9b7 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.915404:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313ad9b7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.915417:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.915418:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876622.915420:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876622.927198:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511185664 00000100:00100000:0.0:1788876622.927208:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511185664 00000100:00100000:0.0:1788876622.927278:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2251 00000100:00100000:0.0:1788876622.927297:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+97:33371:x1875771511185664:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.927323:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.927359:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048633 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927424:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad9c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927439:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927451:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.927504:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.927507:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.927525:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927548:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ad9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048633 expref: 99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927564:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313ad9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048633 expref: 98 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.927573:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:0.0:1788876622.927576:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.927580:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10ae00, rc 0) 00000100:00100000:0.0:1788876622.927663:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+98:33371:x1875771511185664:12345-192.168.203.11@tcp:101:rm.0 Request processed in 376us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.927670:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2251 00000100:00100000:3.0:1788876622.930853:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876622.932323:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.932330:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ad9e1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.932337:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.932340:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ad9e1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.932347:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ad9e1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.932361:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4b:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:1.0:1788876622.932363:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.932366:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ad9e1 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.932371:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ad9e1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.932384:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.932386:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.932388:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.940710:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000004:00200000:2.0:1788876622.941199:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876622.941218:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad9ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.941254:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704863a expref: 100 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.941272:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad9ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704863a expref: 99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.941281:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b800) 00010000:00010000:2.0:1788876622.941284:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876622.941288:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52800, rc 0) 00000100:00100000:2.0:1788876622.941348:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+99:33371:x1875771511186048:12345-192.168.203.11@tcp:101:rm.0 Request processed in 338us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876622.941355:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2253 00000100:00100000:3.0:1788876622.949661:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876622.949765:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511186304 00000100:00100000:2.0:1788876622.949775:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511186304 00000100:00100000:2.0:1788876622.949823:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2254 00000100:00100000:2.0:1788876622.949834:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+99:33371:x1875771511186304:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876622.949887:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876622.949915:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415fc00/0xf5bf0f7e313aa5d8 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d18 expref: 99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.949936:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4c:0x0].0x0 (ffff8a13efd0c400) 00010000:00010000:2.0:1788876622.949963:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ad9ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704863a expref: 98 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.949971:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b800) 00010000:00010000:2.0:1788876622.949978:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876622.950001:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950014:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950024:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950036:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950043:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950049:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950149:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950157:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950164:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876622.950361:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].76, 64 off13056 00010000:00010000:2.0:1788876622.950406:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950415:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950423:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950430:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950436:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950442:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950468:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876622.950484:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950490:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950497:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950503:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876622.950507:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950515:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950523:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4c:0x0].0x0 (ffff8a13fa77bb00) 00010000:00010000:2.0:1788876622.950527:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876622.950531:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950537:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada04 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950551:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950557:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950562:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950567:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876622.950570:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950576:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950584:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876622.950586:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876622.950588:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950593:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ad9f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876622.950643:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c05295d reply state 000000004cb74712 transno 68719477325 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950660:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.950666:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8eefc1 (ffff8a13fa77b400) 00010000:00010000:2.0:1788876622.950668:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876622.950671:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876622.950742:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+99:33371:x1875771511186304:12345-192.168.203.11@tcp:36:rm.0 Request processed in 909us (1088us total) trans 68719477325 rc 0/0 00000100:00100000:2.0:1788876622.950750:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2254 00010000:00010000:1.0:1788876622.950855:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.950863:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.950871:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.950875:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.950882:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.950892:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4c:0x0].0x0 (ffff8a13fa77bb00) 00010000:00010000:1.0:1788876622.950895:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.950899:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.950905:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ada0b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.950926:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.950929:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.950931:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.953792:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876622.953911:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511186432 00000100:00100000:2.0:1788876622.953923:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511186432 00000100:00100000:2.0:1788876622.954156:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2255 00000100:00100000:2.0:1788876622.954170:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+99:33371:x1875771511186432:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876622.954201:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876622.954225:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313ada12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048641 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954308:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954326:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954337:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876622.954385:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876622.954389:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876622.954410:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954439:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313ada12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048641 expref: 101 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954462:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048641 expref: 100 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.954471:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b000) 00010000:00010000:2.0:1788876622.954478:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876622.954482:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53c00, rc 0) 00000100:00100000:2.0:1788876622.954550:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+100:33371:x1875771511186432:12345-192.168.203.11@tcp:101:rm.0 Request processed in 381us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876622.954560:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2255 00000100:00100000:1.0:1788876622.958935:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.959026:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511186688 00000100:00100000:3.0:1788876622.959039:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511186688 00000100:00100000:3.0:1788876622.959111:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2256 00000100:00100000:3.0:1788876622.959124:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+100:33371:x1875771511186688:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876622.959197:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876622.959236:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221200/0xf5bf0f7e313aa5fb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d1f expref: 100 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959261:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4d:0x0].0x0 (ffff8a13d9f5b900) 00010000:00010000:3.0:1788876622.959277:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ada19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048641 expref: 99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959296:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b000) 00010000:00010000:3.0:1788876622.959304:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876622.959330:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959351:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959361:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959374:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959381:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959386:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959480:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959488:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959499:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876622.959743:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].76, 64 off13056 00010000:00010000:3.0:1788876622.959793:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959802:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959969:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959979:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959986:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.959993:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960016:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876622.960032:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960039:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960046:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960055:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.960059:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960066:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960075:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4d:0x0].0x0 (ffff8a13e7965000) 00010000:00010000:3.0:1788876622.960078:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876622.960082:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960088:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ada2e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960103:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960110:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960116:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960120:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876622.960123:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960129:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.960144:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876622.960155:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960157:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876622.960164:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876622.960168:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.960170:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876622.960177:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960181:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313ada20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.960191:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876622.960201:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d49bcbc reply state 000000008b0d03e1 transno 68719477326 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.960205:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4d:0x0].0x0 (ffff8a13e7965000) 00010000:00010000:2.0:1788876622.960212:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876622.960217:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960220:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960248:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeb7b910e (ffff8a13e7965c00) 00010000:00010000:2.0:1788876622.960250:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313ada35 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.960252:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876622.960256:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788876622.960271:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876622.960274:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876622.960276:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876622.960532:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+100:33371:x1875771511186688:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1207us (1402us total) trans 68719477326 rc 0/0 00000100:00100000:3.0:1788876622.960543:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2256 00000100:00100000:2.0:1788876622.965286:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876622.965437:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511186816 00000100:00100000:3.0:1788876622.965448:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511186816 00000100:00100000:3.0:1788876622.965510:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2257 00000100:00100000:3.0:1788876622.965520:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+100:33371:x1875771511186816:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876622.965543:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876622.965566:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ada3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048648 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.965929:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.965946:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.965959:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876622.966008:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876622.966011:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876622.966031:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.966058:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313ada3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048648 expref: 102 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.966077:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048648 expref: 101 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876622.966085:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876622.966088:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876622.966092:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873e00, rc 0) 00000100:00100000:3.0:1788876622.966259:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+101:33371:x1875771511186816:12345-192.168.203.11@tcp:101:rm.0 Request processed in 739us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876622.966268:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2257 00000100:00100000:2.0:1788876622.973010:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.973064:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187072 00000100:00100000:0.0:1788876622.973074:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187072 00000100:00100000:0.0:1788876622.973137:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2258 00000100:00100000:0.0:1788876622.973148:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+101:33371:x1875771511187072:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876622.973289:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876622.973318:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ec00/0xf5bf0f7e313aa61e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d26 expref: 101 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973335:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4e:0x0].0x0 (ffff8a13c3e1a800) 00010000:00010000:0.0:1788876622.973350:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ada43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048648 expref: 100 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973358:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:0.0:1788876622.973363:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876622.973387:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973399:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973407:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973417:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973423:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.973429:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974163:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974175:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974183:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876622.974438:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].77, 64 off13120 00010000:00010000:1.0:1788876622.974477:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974486:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974493:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974500:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974506:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974511:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974584:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876622.974637:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974644:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974658:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974664:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.974670:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974677:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974689:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4e:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876622.974692:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876622.974696:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974702:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada58 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974719:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974725:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974735:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974740:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876622.974743:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974749:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974757:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad500) 00010000:00010000:1.0:1788876622.974759:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876622.974762:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974768:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ada4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876622.974783:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df1fd5db reply state 00000000dfe92e52 transno 68719477327 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974793:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.974799:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd017f5e (ffff8a13fa4ad200) 00010000:00010000:1.0:1788876622.974801:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876622.974803:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788876622.974863:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876622.974869:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.974876:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876622.974879:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.974885:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876622.974886:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+101:33371:x1875771511187072:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1738us (1884us total) trans 68719477327 rc 0/0 00000100:00100000:1.0:1788876622.974894:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2258 00010000:00010000:2.0:1788876622.974894:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4e:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:2.0:1788876622.974897:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876622.974900:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.974904:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ada5f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.974916:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876622.974918:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876622.974920:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876622.977871:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876622.977954:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187200 00000100:00100000:0.0:1788876622.977966:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187200 00000100:00100000:0.0:1788876622.978040:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2259 00000100:00100000:0.0:1788876622.978050:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+101:33371:x1875771511187200:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876622.978077:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876622.978101:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704864f expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978179:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978193:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978207:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876622.978326:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876622.978330:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876622.978352:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978377:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704864f expref: 103 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978396:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704864f expref: 102 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876622.978405:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876622.978408:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876622.978412:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10b400, rc 0) 00000100:00100000:0.0:1788876622.978472:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+102:33371:x1875771511187200:12345-192.168.203.11@tcp:101:rm.0 Request processed in 422us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876622.978479:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2259 00000100:00100000:3.0:1788876622.983463:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876622.983695:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187456 00000100:00100000:2.0:1788876622.983706:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187456 00000100:00100000:2.0:1788876622.983770:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2260 00000100:00100000:2.0:1788876622.983781:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+102:33371:x1875771511187456:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876622.983835:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876622.983861:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d0000/0xf5bf0f7e313aa641 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d2d expref: 102 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.983886:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4f:0x0].0x0 (ffff8a13d5606100) 00010000:00010000:2.0:1788876622.983907:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313ada6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704864f expref: 101 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.983916:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:2.0:1788876622.983924:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876622.983960:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.983973:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.983983:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.983996:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984002:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984009:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984119:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984128:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984136:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876622.984566:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].77, 64 off13120 00010000:00010000:2.0:1788876622.984793:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984804:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984812:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984819:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984826:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984832:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984895:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876622.984921:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984945:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984952:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984957:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876622.984961:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984969:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984981:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4f:0x0].0x0 (ffff8a13fa77b500) 00010000:00010000:2.0:1788876622.984984:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876622.984988:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.984993:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ada82 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985009:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985015:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985020:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985024:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876622.985027:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985033:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985040:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876622.985047:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876622.985050:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985057:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313ada74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876622.985071:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f01b196c reply state 000000002cd068d1 transno 68719477328 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985081:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876622.985087:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fa8675d (ffff8a13fa77b800) 00010000:00010000:2.0:1788876622.985090:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876622.985092:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876622.985177:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+102:33371:x1875771511187456:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1396us (1720us total) trans 68719477328 rc 0/0 00000100:00100000:2.0:1788876622.985185:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2260 00010000:00010000:1.0:1788876622.993516:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876622.993591:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.993628:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876622.993632:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.993643:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.993663:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4f:0x0].0x0 (ffff8a13fa77b500) 00010000:00010000:1.0:1788876622.993666:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876622.993672:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.993678:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313ada89 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.993706:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.993709:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876622.993711:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876622.997751:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876622.997949:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187584 00000100:00100000:1.0:1788876622.997959:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187584 00000100:00100000:1.0:1788876622.998020:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2261 00000100:00100000:1.0:1788876622.998041:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+102:33371:x1875771511187584:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876622.998066:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876622.998090:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048656 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998166:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998182:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998195:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876622.998250:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876622.998254:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876622.998272:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998295:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ada90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048656 expref: 104 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998316:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048656 expref: 103 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876622.998324:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372d00) 00010000:00010000:1.0:1788876622.998328:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876622.998331:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a86e00, rc 0) 00000100:00100000:1.0:1788876622.998402:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+103:33371:x1875771511187584:12345-192.168.203.11@tcp:101:rm.0 Request processed in 363us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876622.998409:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2261 00000100:00100000:3.0:1788876623.007305:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.008241:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187840 00000100:00100000:0.0:1788876623.008252:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187840 00000100:00100000:0.0:1788876623.008318:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2262 00000100:00100000:0.0:1788876623.008328:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+103:33371:x1875771511187840:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.008382:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.008406:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313aa664 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d34 expref: 103 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008425:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x50:0x0].0x0 (ffff8a13d9f5b800) 00010000:00010000:0.0:1788876623.008442:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313ada97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048656 expref: 102 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008451:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372d00) 00010000:00010000:0.0:1788876623.008458:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.008481:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008495:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008504:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008516:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008524:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008530:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008665:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008675:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008682:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.008901:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].78, 64 off13184 00010000:00010000:0.0:1788876623.008948:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008957:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008965:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008972:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008979:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.008986:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009006:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.009022:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009032:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009038:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009044:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.009048:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009055:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009063:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x50:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:0.0:1788876623.009066:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.009069:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009076:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaac lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009090:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009097:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009103:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009109:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.009112:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009119:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009126:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:0.0:1788876623.009129:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.009132:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009137:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313ada9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.009149:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000968800ab reply state 000000007fb3b3be transno 68719477329 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009159:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.009165:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9e7919c (ffff8a13fa4adf00) 00010000:00010000:0.0:1788876623.009168:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.009171:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.009257:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+103:33371:x1875771511187840:12345-192.168.203.11@tcp:36:rm.0 Request processed in 930us (1969us total) trans 68719477329 rc 0/0 00000100:00100000:0.0:1788876623.009265:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2262 00010000:00010000:2.0:1788876623.011592:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.011630:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.011640:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.011644:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.011664:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.011681:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x50:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:2.0:1788876623.011684:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876623.011689:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.011695:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adab3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.011719:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.011721:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.011723:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.017951:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.019501:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511187968 00000100:00100000:2.0:1788876623.019518:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511187968 00000100:00100000:2.0:1788876623.019593:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2263 00000100:00100000:2.0:1788876623.019632:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+103:33371:x1875771511187968:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.019672:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.019695:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704865d expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019763:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019777:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019788:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.019836:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.019840:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.019860:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019887:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704865d expref: 105 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019907:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704865d expref: 104 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.019916:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876623.019919:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.019923:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52800, rc 0) 00000100:00100000:2.0:1788876623.020141:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+104:33371:x1875771511187968:12345-192.168.203.11@tcp:101:rm.0 Request processed in 537us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.020148:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2263 00000100:00100000:3.0:1788876623.027350:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.027431:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511188224 00000100:00100000:2.0:1788876623.027440:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511188224 00000100:00100000:2.0:1788876623.027498:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2264 00000100:00100000:2.0:1788876623.027508:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+104:33371:x1875771511188224:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.027573:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.027624:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313aa687 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d3b expref: 104 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027647:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x51:0x0].0x0 (ffff8a13c3e1a100) 00010000:00010000:2.0:1788876623.027666:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adac1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704865d expref: 103 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027676:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876623.027683:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.027708:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027721:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027731:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027743:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027749:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027755:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027849:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027857:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.027864:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.029071:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].78, 64 off13184 00010000:00010000:3.0:1788876623.029128:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029141:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029151:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029159:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029166:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029173:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029195:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.029214:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029221:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029235:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029241:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.029245:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029252:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029261:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x51:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:3.0:1788876623.029264:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.029268:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029274:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adad6 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029289:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029295:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029300:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029305:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.029308:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029313:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029320:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:3.0:1788876623.029322:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.029324:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029330:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adac8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.029347:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043959fca reply state 00000000c81fb41c transno 68719477330 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029357:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.029363:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf9e0350 (ffff8a13fa77b200) 00010000:00010000:3.0:1788876623.029365:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.029368:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.029459:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+104:33371:x1875771511188224:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1949us (2116us total) trans 68719477330 rc 0/0 00000100:00100000:3.0:1788876623.029467:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2264 00010000:00010000:2.0:1788876623.030193:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.030203:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.030210:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.030214:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.030221:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.030242:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x51:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.030245:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876623.030248:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.030254:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adadd lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.030269:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.030271:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.030272:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.033349:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.033442:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511188352 00000100:00100000:0.0:1788876623.033452:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511188352 00000100:00100000:0.0:1788876623.033509:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2265 00000100:00100000:0.0:1788876623.033520:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+104:33371:x1875771511188352:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.033542:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.033566:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048664 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033679:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033694:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033706:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.033748:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.033751:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.033769:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033793:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048664 expref: 106 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033810:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048664 expref: 105 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.033818:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:0.0:1788876623.033821:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.033824:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10b200, rc 0) 00000100:00100000:0.0:1788876623.033876:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+105:33371:x1875771511188352:12345-192.168.203.11@tcp:101:rm.0 Request processed in 358us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.033884:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2265 00000100:00100000:1.0:1788876623.040325:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.040399:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511188608 00000100:00100000:2.0:1788876623.040408:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511188608 00000100:00100000:2.0:1788876623.040465:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2266 00000100:00100000:2.0:1788876623.040475:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+105:33371:x1875771511188608:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.040528:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.040554:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313aa0de lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c0e expref: 105 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040575:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2e:0x0].0x0 (ffff8a13fa64b200) 00010000:00010000:2.0:1788876623.040593:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adaeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048664 expref: 104 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040658:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:2.0:1788876623.040666:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.040691:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040703:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040713:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040726:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040733:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040740:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040841:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040849:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.040856:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.041394:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].79, 64 off13248 00010000:00010000:2.0:1788876623.041443:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041455:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041463:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041470:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041476:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041483:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041507:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.041527:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041533:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041540:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041545:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.041550:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041558:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041570:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2e:0x0].0x0 (ffff8a13fa77b900) 00010000:00010000:2.0:1788876623.041573:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.041577:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041583:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb00 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041599:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041628:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041633:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041638:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.041641:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041647:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041654:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.041657:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.041659:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041665:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adaf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.041683:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d007d41 reply state 000000000649b121 transno 68719477331 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041694:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.041700:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c06bb61 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876623.041702:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.041705:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788876623.041827:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.041834:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.041840:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.041844:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.041850:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.041860:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2e:0x0].0x0 (ffff8a13fa77b900) 00010000:00010000:1.0:1788876623.041862:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.041866:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.041871:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb07 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.041884:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.041886:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.041888:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876623.041920:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+105:33371:x1875771511188608:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1444us (1602us total) trans 68719477331 rc 0/0 00000100:00100000:2.0:1788876623.041945:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2266 00000100:00100000:3.0:1788876623.052517:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.052741:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511188736 00000100:00100000:0.0:1788876623.052752:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511188736 00000100:00100000:0.0:1788876623.052838:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2267 00000100:00100000:0.0:1788876623.052847:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+105:33371:x1875771511188736:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.052869:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.052891:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704866b expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.052953:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.052968:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.052979:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.053022:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.053026:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.053044:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.053067:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704866b expref: 107 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.053083:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704866b expref: 106 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.053091:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:0.0:1788876623.053094:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.053097:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10b800, rc 0) 00000100:00100000:0.0:1788876623.053156:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+106:33371:x1875771511188736:12345-192.168.203.11@tcp:101:rm.0 Request processed in 309us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.053163:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2267 00000100:00100000:3.0:1788876623.060223:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.060685:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511188992 00000100:00100000:2.0:1788876623.060695:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511188992 00000100:00100000:2.0:1788876623.060757:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2268 00000100:00100000:2.0:1788876623.060766:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+106:33371:x1875771511188992:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.060813:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.060837:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d0e00/0xf5bf0f7e313aa6aa lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d42 expref: 106 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060855:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x52:0x0].0x0 (ffff8a13d5606600) 00010000:00010000:2.0:1788876623.060869:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704866b expref: 105 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060878:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:2.0:1788876623.060883:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.060904:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060915:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060924:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060935:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x86501ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060942:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.060948:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061045:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061054:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061061:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.061495:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].80, 64 off13312 00010000:00010000:2.0:1788876623.061543:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061553:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061561:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061568:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061574:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061579:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061774:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.061794:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061800:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061806:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061812:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.061816:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061824:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061833:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x52:0x0].0x0 (ffff8a13fa77b900) 00010000:00010000:2.0:1788876623.061835:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.061839:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061849:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb2a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061864:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061869:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061874:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061878:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.061880:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061885:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061892:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.061895:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.061897:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061902:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.061913:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045734e20 reply state 00000000ef9b341b transno 68719477332 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061922:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.061929:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x86501ba (ffff8a13fa77b300) 00010000:00010000:2.0:1788876623.061931:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.061934:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.062007:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+106:33371:x1875771511188992:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1240us (1791us total) trans 68719477332 rc 0/0 00000100:00100000:2.0:1788876623.062015:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2268 00010000:00010000:0.0:1788876623.063211:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.063221:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.063240:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.063244:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.063253:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.063268:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x52:0x0].0x0 (ffff8a13fa77b900) 00010000:00010000:0.0:1788876623.063270:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.063274:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.063280:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adb31 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.063295:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.063297:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.063299:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.064902:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.064976:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511189120 00000100:00100000:2.0:1788876623.064985:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511189120 00000100:00100000:2.0:1788876623.065042:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2269 00000100:00100000:2.0:1788876623.065051:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+106:33371:x1875771511189120:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.065072:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.065093:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048672 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065152:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065165:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065175:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.065215:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.065219:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.065251:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065274:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048672 expref: 108 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065291:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048672 expref: 107 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.065300:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:2.0:1788876623.065304:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.065307:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52400, rc 0) 00000100:00100000:2.0:1788876623.065367:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+107:33371:x1875771511189120:12345-192.168.203.11@tcp:101:rm.0 Request processed in 316us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.065374:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2269 00000100:00100000:3.0:1788876623.071127:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.071302:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511189376 00000100:00100000:0.0:1788876623.071312:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511189376 00000100:00100000:0.0:1788876623.071370:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2270 00000100:00100000:0.0:1788876623.071380:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+107:33371:x1875771511189376:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.071431:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.071458:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa787a00/0xf5bf0f7e313aa6cd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d49 expref: 107 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071477:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x53:0x0].0x0 (ffff8a13c133ed00) 00010000:00010000:0.0:1788876623.071493:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adb3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048672 expref: 106 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071502:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:0.0:1788876623.071509:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.071532:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071545:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071555:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071566:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071573:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071580:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071726:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071735:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071742:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.071923:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].79, 64 off13248 00010000:00010000:0.0:1788876623.071976:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071984:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071991:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.071999:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072006:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072011:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072026:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.072040:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072045:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072051:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072059:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ac00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.072063:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072070:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072077:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x53:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876623.072080:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.072083:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072090:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb54 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072103:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072108:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072113:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072117:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.072119:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072126:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072136:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.072138:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.072141:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072146:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.072158:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044ba00ea reply state 00000000b0214a8d transno 68719477333 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072168:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.072174:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e67c437 (ffff8a13fa4adc00) 00010000:00010000:0.0:1788876623.072176:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.072178:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.072310:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+107:33371:x1875771511189376:12345-192.168.203.11@tcp:36:rm.0 Request processed in 930us (1192us total) trans 68719477333 rc 0/0 00000100:00100000:0.0:1788876623.072318:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2270 00010000:00010000:2.0:1788876623.072392:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.072399:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.072406:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.072409:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.072415:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.072424:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x53:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:2.0:1788876623.072426:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876623.072429:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.072435:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adb5b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.072446:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.072448:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.072450:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.074523:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.074630:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511189504 00000100:00100000:2.0:1788876623.074639:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511189504 00000100:00100000:2.0:1788876623.074690:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2271 00000100:00100000:2.0:1788876623.074700:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+107:33371:x1875771511189504:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.074723:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.074743:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048679 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074803:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074815:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074827:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.074865:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.074869:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.074886:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074906:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048679 expref: 109 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074921:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048679 expref: 108 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.074929:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.074932:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.074936:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53a00, rc 0) 00000100:00100000:2.0:1788876623.075091:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+108:33371:x1875771511189504:12345-192.168.203.11@tcp:101:rm.0 Request processed in 390us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.075098:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2271 00000100:00100000:1.0:1788876623.081483:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.081560:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511189760 00000100:00100000:0.0:1788876623.081570:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511189760 00000100:00100000:0.0:1788876623.081676:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2272 00000100:00100000:0.0:1788876623.081687:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+108:33371:x1875771511189760:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.081741:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.081767:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415fa00/0xf5bf0f7e313aa6f0 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d50 expref: 108 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081789:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x54:0x0].0x0 (ffff8a13c3e1a200) 00010000:00010000:0.0:1788876623.081803:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adb69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048679 expref: 107 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081812:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:0.0:1788876623.081817:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.081838:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081850:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081859:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081869:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081875:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081881:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081970:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081978:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.081990:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.082184:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].81, 64 off13376 00010000:00010000:0.0:1788876623.082480:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082491:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082500:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082508:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082515:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082521:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082534:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.082550:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082557:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082563:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082574:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.082578:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082586:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082594:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x54:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:0.0:1788876623.082597:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.082633:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082641:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adb7e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082655:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082661:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082667:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082671:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.082674:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082680:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082691:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.082694:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.082697:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082703:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adb70 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.082716:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff8a44f1 reply state 00000000bbf9fe35 transno 68719477334 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082727:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.082734:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x15bd5207 (ffff8a13fa4ad700) 00010000:00010000:0.0:1788876623.082736:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.082738:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.082802:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+108:33371:x1875771511189760:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1116us (1328us total) trans 68719477334 rc 0/0 00000100:00100000:0.0:1788876623.082809:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2272 00010000:00010000:1.0:1788876623.083211:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.083219:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.083225:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.083237:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.083244:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.083254:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x54:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:1.0:1788876623.083256:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.083259:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.083264:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adb85 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.083276:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.083277:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.083279:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.087551:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.087747:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511189888 00000100:00100000:2.0:1788876623.087757:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511189888 00000100:00100000:2.0:1788876623.087814:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2273 00000100:00100000:2.0:1788876623.087824:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+108:33371:x1875771511189888:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.087848:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.087872:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048680 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.087940:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.087954:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.087966:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.088005:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.088009:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.088025:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.088049:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048680 expref: 110 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.088071:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048680 expref: 109 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.088080:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b500) 00010000:00010000:2.0:1788876623.088083:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.088087:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53c00, rc 0) 00000100:00100000:2.0:1788876623.088149:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+109:33371:x1875771511189888:12345-192.168.203.11@tcp:101:rm.0 Request processed in 327us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.088156:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2273 00000100:00100000:3.0:1788876623.108096:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.109032:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511190144 00000100:00100000:1.0:1788876623.109045:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511190144 00000100:00100000:1.0:1788876623.109100:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2274 00000100:00100000:1.0:1788876623.109110:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+109:33371:x1875771511190144:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.109162:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.109190:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d1200/0xf5bf0f7e313aa713 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d57 expref: 109 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109224:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x55:0x0].0x0 (ffff8a13d5606700) 00010000:00010000:1.0:1788876623.109250:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adb93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048680 expref: 108 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109260:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b500) 00010000:00010000:1.0:1788876623.109266:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.109292:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109309:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109319:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109331:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109338:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109345:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109439:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109447:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.109454:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.109946:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].80, 64 off13312 00010000:00010000:1.0:1788876623.110290:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110303:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110313:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110322:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110329:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110336:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110521:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.110542:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110548:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110554:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110558:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.110563:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110571:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110581:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x55:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876623.110583:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.110588:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110598:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adba8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110643:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110713:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110719:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110724:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.110727:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110733:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110741:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372500) 00010000:00010000:1.0:1788876623.110743:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.110747:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110753:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adb9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.110768:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001377ac03 reply state 00000000b4ac293b transno 68719477335 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110778:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.110786:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddbd5356 (ffff8a13ff372600) 00010000:00010000:1.0:1788876623.110788:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.110791:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.110872:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+109:33371:x1875771511190144:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1761us (2784us total) trans 68719477335 rc 0/0 00000100:00100000:1.0:1788876623.110880:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2274 00010000:00010000:2.0:1788876623.114141:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.114155:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.114165:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.114169:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.114178:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.114201:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x55:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:2.0:1788876623.114204:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876623.114209:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.114215:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adbaf lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.118814:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.118821:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.118824:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.119029:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.119102:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511190272 00000100:00100000:3.0:1788876623.119111:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511190272 00000100:00100000:3.0:1788876623.119194:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2275 00000100:00100000:3.0:1788876623.119204:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+109:33371:x1875771511190272:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.119237:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.119261:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048687 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119320:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119332:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119343:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.119386:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.119390:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.119408:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119430:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048687 expref: 111 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119447:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048687 expref: 110 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.119455:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.119458:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.119462:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873800, rc 0) 00000100:00100000:3.0:1788876623.119534:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+110:33371:x1875771511190272:12345-192.168.203.11@tcp:101:rm.0 Request processed in 333us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.119541:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2275 00000100:00100000:0.0:1788876623.129831:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.129932:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511190528 00000100:00100000:3.0:1788876623.129942:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511190528 00000100:00100000:3.0:1788876623.129994:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2276 00000100:00100000:3.0:1788876623.130004:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+110:33371:x1875771511190528:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.130053:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.130078:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa787e00/0xf5bf0f7e313aa736 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d5e expref: 110 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130096:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x56:0x0].0x0 (ffff8a13c133ee00) 00010000:00010000:3.0:1788876623.130110:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048687 expref: 109 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130119:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.130124:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.130145:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130156:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130165:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130176:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x93460dbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130182:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130187:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130300:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130308:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130315:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.130509:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].82, 64 off13440 00010000:00010000:3.0:1788876623.130550:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130558:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130567:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130574:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130580:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130585:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130600:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.130777:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130787:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130793:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130799:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.130803:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130811:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130819:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x56:0x0].0x0 (ffff8a13e7965600) 00010000:00010000:3.0:1788876623.130822:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.130825:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130831:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adbd2 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130845:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130850:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130855:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130859:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.130862:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130868:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130875:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876623.130877:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.130879:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130884:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adbc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.130894:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038c39104 reply state 00000000f3ecb3cc transno 68719477336 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130904:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.130911:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93460dbd (ffff8a13e7965000) 00010000:00010000:3.0:1788876623.130913:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.130915:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.130977:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+110:33371:x1875771511190528:12345-192.168.203.11@tcp:36:rm.0 Request processed in 973us (1155us total) trans 68719477336 rc 0/0 00000100:00100000:3.0:1788876623.130985:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2276 00010000:00010000:1.0:1788876623.131051:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.131058:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.131064:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.131067:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.131075:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.131084:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x56:0x0].0x0 (ffff8a13e7965600) 00010000:00010000:1.0:1788876623.131086:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.131089:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.131094:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbd9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.131108:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.131110:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.131112:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.137658:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.137783:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511190656 00000100:00100000:1.0:1788876623.137792:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511190656 00000100:00100000:1.0:1788876623.137850:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2277 00000100:00100000:1.0:1788876623.137859:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+110:33371:x1875771511190656:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876623.137882:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876623.137913:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adbe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704868e expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.137974:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.137988:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.137999:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876623.138039:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876623.138042:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876623.138058:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.138079:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adbe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704868e expref: 112 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.138097:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704868e expref: 111 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.138105:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372500) 00010000:00010000:1.0:1788876623.138108:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876623.138111:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a86600, rc 0) 00000100:00100000:1.0:1788876623.138168:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+111:33371:x1875771511190656:12345-192.168.203.11@tcp:101:rm.0 Request processed in 310us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876623.138176:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2277 00000100:00100000:0.0:1788876623.141920:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.141990:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511190912 00000100:00100000:3.0:1788876623.141999:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511190912 00000100:00100000:3.0:1788876623.142054:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2278 00000100:00100000:3.0:1788876623.142063:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+111:33371:x1875771511190912:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.142111:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.142138:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313aa759 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d65 expref: 111 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142157:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x57:0x0].0x0 (ffff8a13c3e1a300) 00010000:00010000:3.0:1788876623.142171:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adbe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704868e expref: 110 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142180:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372500) 00010000:00010000:3.0:1788876623.142186:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.142208:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142219:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142240:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142252:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x845850a4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142258:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142264:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142733:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142745:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.142754:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.142959:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].81, 64 off13376 00010000:00010000:3.0:1788876623.143006:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.143016:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.143024:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.143031:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.143037:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.143042:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.145792:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.149807:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149826:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149834:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149845:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.149850:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149858:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149875:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x57:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:3.0:1788876623.149879:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.149884:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149890:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adbfc lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149917:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149923:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149929:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149934:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.149937:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149943:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149953:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.149956:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.149959:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149964:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adbee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.149984:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0c57d50 reply state 000000008e32ff65 transno 68719477337 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.149997:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.150004:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x845850a4 (ffff8a13e7965200) 00010000:00010000:3.0:1788876623.150006:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.150009:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.150121:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+111:33371:x1875771511190912:12345-192.168.203.11@tcp:36:rm.0 Request processed in 8053us (8204us total) trans 68719477337 rc 0/0 00000100:00100000:3.0:1788876623.150132:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2278 00010000:00010000:1.0:1788876623.156916:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.156929:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.157084:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.157089:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.157099:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.157117:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x57:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:1.0:1788876623.157120:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.157125:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.157132:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313adc03 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.157212:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.157216:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.157218:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.159915:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.160038:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511191040 00000100:00100000:3.0:1788876623.160048:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511191040 00000100:00100000:3.0:1788876623.160101:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2279 00000100:00100000:3.0:1788876623.160111:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+111:33371:x1875771511191040:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.160137:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.160157:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313adc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048695 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160218:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160243:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160256:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.160307:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.160312:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.160334:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160360:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313adc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048695 expref: 113 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160377:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048695 expref: 112 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.160385:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876623.160388:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.160392:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873400, rc 0) 00000100:00100000:3.0:1788876623.160453:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+112:33371:x1875771511191040:12345-192.168.203.11@tcp:101:rm.0 Request processed in 342us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.160460:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2279 00000100:00100000:0.0:1788876623.177666:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.177753:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511191296 00000100:00100000:2.0:1788876623.177764:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511191296 00000100:00100000:2.0:1788876623.177813:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2280 00000100:00100000:2.0:1788876623.177822:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+112:33371:x1875771511191296:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.177885:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.177914:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d1000/0xf5bf0f7e313aa77c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d6c expref: 112 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.177936:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x58:0x0].0x0 (ffff8a13d5606b00) 00010000:00010000:2.0:1788876623.177953:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adc11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048695 expref: 111 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.177962:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:2.0:1788876623.177969:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.177994:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178007:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178017:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178028:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfde679fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178036:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178042:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178135:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178144:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178151:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.178386:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].83, 64 off13504 00010000:00010000:2.0:1788876623.178430:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178440:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178448:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178455:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178461:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178466:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178483:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.178500:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178509:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178516:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178522:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.178526:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178533:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178541:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x58:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:2.0:1788876623.178544:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.178548:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178554:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adc26 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178568:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178573:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178579:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178584:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.178587:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178593:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178598:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b000) 00010000:00010000:2.0:1788876623.178627:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.178630:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178636:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adc18 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.178649:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf9a2c13 reply state 000000004734729d transno 68719477338 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178658:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.178664:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfde679fc (ffff8a13fa77bb00) 00010000:00010000:2.0:1788876623.178667:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.178669:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.178744:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+112:33371:x1875771511191296:12345-192.168.203.11@tcp:36:rm.0 Request processed in 921us (1086us total) trans 68719477338 rc 0/0 00000100:00100000:2.0:1788876623.178752:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2280 00010000:00010000:3.0:1788876623.178957:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.178964:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.178971:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.178974:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.178982:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.178991:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x58:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:3.0:1788876623.178993:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.178996:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.179002:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc2d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.179014:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.179016:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.179017:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.181815:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.181884:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511191424 00000100:00100000:3.0:1788876623.181894:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511191424 00000100:00100000:3.0:1788876623.181953:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2281 00000100:00100000:3.0:1788876623.181963:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+112:33371:x1875771511191424:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.181985:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.182006:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adc34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704869c expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182063:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182075:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182086:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.182125:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.182129:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.182145:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182167:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adc34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704869c expref: 114 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182182:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704869c expref: 113 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.182199:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.182202:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.182205:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872600, rc 0) 00000100:00100000:3.0:1788876623.182283:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+113:33371:x1875771511191424:12345-192.168.203.11@tcp:101:rm.0 Request processed in 313us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.182290:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2281 00000100:00100000:1.0:1788876623.186293:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.186443:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511191680 00000100:00100000:2.0:1788876623.186453:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511191680 00000100:00100000:2.0:1788876623.186517:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2282 00000100:00100000:2.0:1788876623.186528:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+113:33371:x1875771511191680:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.186588:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.186651:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0fc00/0xf5bf0f7e313aa79f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d73 expref: 113 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186671:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x59:0x0].0x0 (ffff8a13c3e1ad00) 00010000:00010000:2.0:1788876623.186690:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313adc3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704869c expref: 112 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186700:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:2.0:1788876623.186706:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.186730:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186743:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186753:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186766:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x79c64dea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186772:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186779:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186873:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186882:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.186890:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.187109:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].82, 64 off13440 00010000:00010000:2.0:1788876623.187156:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187167:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187176:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187183:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187190:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187197:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187223:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.187250:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187257:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187264:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187284:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.187289:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187296:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187305:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x59:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.187308:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.187311:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187317:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adc50 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187334:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187339:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187345:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187350:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.187352:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187358:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187370:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:2.0:1788876623.187372:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.187375:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187381:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313adc42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.187395:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4ec3122 reply state 00000000de449da7 transno 68719477339 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187405:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.187411:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79c64dea (ffff8a13fa77b500) 00010000:00010000:2.0:1788876623.187413:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.187415:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.187480:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+113:33371:x1875771511191680:12345-192.168.203.11@tcp:36:rm.0 Request processed in 953us (1195us total) trans 68719477339 rc 0/0 00000100:00100000:2.0:1788876623.187488:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2282 00010000:00010000:1.0:1788876623.187707:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.187715:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.187721:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.187725:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.187731:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.187741:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x59:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:1.0:1788876623.187743:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.187746:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.187752:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313adc57 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.187764:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.187766:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.187768:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.189829:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.189905:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511191808 00000100:00100000:2.0:1788876623.189914:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511191808 00000100:00100000:2.0:1788876623.189970:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2283 00000100:00100000:2.0:1788876623.189979:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+113:33371:x1875771511191808:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.189998:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.190017:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adc5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486a3 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190072:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190085:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190095:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.190135:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.190138:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.190154:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190174:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adc5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486a3 expref: 115 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190190:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486a3 expref: 114 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.190198:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b000) 00010000:00010000:2.0:1788876623.190200:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.190203:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8000, rc 0) 00000100:00100000:2.0:1788876623.190263:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+114:33371:x1875771511191808:12345-192.168.203.11@tcp:101:rm.0 Request processed in 285us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.190270:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2283 00000100:00100000:0.0:1788876623.197347:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.197428:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192064 00000100:00100000:2.0:1788876623.197438:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192064 00000100:00100000:2.0:1788876623.197504:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2284 00000100:00100000:2.0:1788876623.197515:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+114:33371:x1875771511192064:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.197572:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.197598:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0f800/0xf5bf0f7e313aa7c2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d7a expref: 114 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197650:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5a:0x0].0x0 (ffff8a13c3e1a700) 00010000:00010000:2.0:1788876623.197669:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adc65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486a3 expref: 113 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197679:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b000) 00010000:00010000:2.0:1788876623.197686:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.197708:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197721:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197731:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197742:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xffcae178 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197749:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197755:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197841:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197850:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.197857:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.198041:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].84, 64 off13568 00010000:00010000:2.0:1788876623.198091:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198101:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198108:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198115:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198121:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198126:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198138:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.198153:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198158:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198164:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198172:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.198176:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198183:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198191:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5a:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.198194:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.198197:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198203:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc7a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198215:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198221:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198237:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198243:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.198246:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198252:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198262:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:2.0:1788876623.198264:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.198267:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198272:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.198282:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004345e934 reply state 00000000c731e992 transno 68719477340 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198293:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.198299:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xffcae178 (ffff8a13fa77b900) 00010000:00010000:2.0:1788876623.198302:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.198304:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.198373:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+114:33371:x1875771511192064:12345-192.168.203.11@tcp:36:rm.0 Request processed in 859us (1034us total) trans 68719477340 rc 0/0 00000100:00100000:2.0:1788876623.198380:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2284 00010000:00010000:0.0:1788876623.199673:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.199682:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.199693:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.199697:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.199706:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.199718:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5a:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:0.0:1788876623.199721:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.199724:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.199729:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adc81 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.199748:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.199750:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.199751:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.203341:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.203461:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192192 00000100:00100000:3.0:1788876623.203472:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192192 00000100:00100000:3.0:1788876623.203532:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2285 00000100:00100000:3.0:1788876623.203542:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+114:33371:x1875771511192192:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.203564:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.203586:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adc88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486aa expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203683:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203702:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203714:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.203759:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.203762:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.203782:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203805:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adc88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486aa expref: 116 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203820:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486aa expref: 115 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.203829:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.203832:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.203835:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873e00, rc 0) 00000100:00100000:3.0:1788876623.203889:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+115:33371:x1875771511192192:12345-192.168.203.11@tcp:101:rm.0 Request processed in 349us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.203896:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2285 00000100:00100000:3.0:1788876623.216307:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.216427:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192448 00000100:00100000:2.0:1788876623.216436:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192448 00000100:00100000:2.0:1788876623.216490:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2286 00000100:00100000:2.0:1788876623.216498:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+115:33371:x1875771511192448:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.216550:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.216573:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d1600/0xf5bf0f7e313aa7e5 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d81 expref: 115 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216597:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5b:0x0].0x0 (ffff8a13d9f51700) 00010000:00010000:2.0:1788876623.216658:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adc8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486aa expref: 114 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216668:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:2.0:1788876623.216673:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.216694:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216705:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216714:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216724:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216730:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216736:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216814:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216822:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.216833:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.217014:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].83, 64 off13504 00010000:00010000:2.0:1788876623.217051:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217060:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217067:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217074:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217080:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217086:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217100:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.217113:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217119:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217125:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217134:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.217139:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217146:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217153:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5b:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:2.0:1788876623.217156:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.217159:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217164:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adca4 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217177:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217183:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217189:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217193:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.217196:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217201:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217211:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:2.0:1788876623.217213:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.217216:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217221:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adc96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.217245:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bcb0ef8 reply state 0000000080f496bc transno 68719477341 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217254:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.217259:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d587f95 (ffff8a13fa77b000) 00010000:00010000:2.0:1788876623.217261:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.217264:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.217335:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+115:33371:x1875771511192448:12345-192.168.203.11@tcp:36:rm.0 Request processed in 837us (1036us total) trans 68719477341 rc 0/0 00000100:00100000:2.0:1788876623.217343:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2286 00010000:00010000:0.0:1788876623.217462:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.217468:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.217474:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.217478:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.217484:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.217494:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5b:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:0.0:1788876623.217496:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.217499:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.217504:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adcab lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.217518:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.217520:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.217521:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.222000:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.222077:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192576 00000100:00100000:2.0:1788876623.222087:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192576 00000100:00100000:2.0:1788876623.222145:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2287 00000100:00100000:2.0:1788876623.222155:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+115:33371:x1875771511192576:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.222179:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.222202:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486b1 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222279:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222294:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222306:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.222349:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.222353:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.222371:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222394:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b1 expref: 117 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222412:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b1 expref: 116 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.222420:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.222423:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.222427:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8800, rc 0) 00000100:00100000:2.0:1788876623.222490:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+116:33371:x1875771511192576:12345-192.168.203.11@tcp:101:rm.0 Request processed in 337us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.222498:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2287 00000100:00100000:1.0:1788876623.225562:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.225686:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192832 00000100:00100000:0.0:1788876623.225696:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192832 00000100:00100000:0.0:1788876623.225751:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2288 00000100:00100000:0.0:1788876623.225761:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+116:33371:x1875771511192832:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.225813:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.225843:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3e00/0xf5bf0f7e313aa101 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c15 expref: 116 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225862:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff8a13e7962000) 00010000:00010000:0.0:1788876623.225880:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adcb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b1 expref: 115 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225893:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77bc00) 00010000:00010000:0.0:1788876623.225900:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.225925:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225939:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225961:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225975:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225983:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.225989:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226096:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226104:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226111:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.226358:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].84, 64 off13568 00010000:00010000:0.0:1788876623.226522:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226533:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226545:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226553:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226558:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226564:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226578:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.226595:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226631:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226639:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226644:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.226648:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226657:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226667:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:0.0:1788876623.226669:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.226674:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226681:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313adcce lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226696:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226702:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226708:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226713:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.226716:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226722:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226730:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.226732:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.226735:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226741:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adcc0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.226755:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0bc69e0 reply state 0000000004cea500 transno 68719477342 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226770:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.226777:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68e42da7 (ffff8a13fa4ada00) 00010000:00010000:0.0:1788876623.226779:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.226782:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.226869:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+116:33371:x1875771511192832:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1107us (1313us total) trans 68719477342 rc 0/0 00000100:00100000:0.0:1788876623.226878:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2288 00010000:00010000:1.0:1788876623.227015:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.227022:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.227029:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.227033:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.227040:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.227049:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:1.0:1788876623.227052:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.227055:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.227064:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313adcd5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.227078:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.227080:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.227081:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.231795:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.232110:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511192960 00000100:00100000:3.0:1788876623.232121:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511192960 00000100:00100000:3.0:1788876623.232192:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2289 00000100:00100000:3.0:1788876623.232203:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+116:33371:x1875771511192960:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.232238:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.232267:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adcdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486b8 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232348:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232362:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232375:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.232431:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.232436:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.232463:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232489:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adcdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b8 expref: 118 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232508:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b8 expref: 117 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.232519:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876623.232522:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.232526:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873e00, rc 0) 00000100:00100000:3.0:1788876623.233185:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+117:33371:x1875771511192960:12345-192.168.203.11@tcp:101:rm.0 Request processed in 402us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.233194:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2289 00000100:00100000:3.0:1788876623.237787:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.237962:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511193216 00000100:00100000:2.0:1788876623.237974:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511193216 00000100:00100000:2.0:1788876623.238036:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2290 00000100:00100000:2.0:1788876623.238046:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+117:33371:x1875771511193216:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.238104:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.238134:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0ee00/0xf5bf0f7e313aa808 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d88 expref: 117 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238152:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5c:0x0].0x0 (ffff8a13c3e1ac00) 00010000:00010000:2.0:1788876623.238169:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adce3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486b8 expref: 116 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238180:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:2.0:1788876623.238187:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.238213:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238234:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238244:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238257:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe274b122 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238264:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238271:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238371:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238379:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238387:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.238659:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].85, 64 off13632 00010000:00010000:2.0:1788876623.238710:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238720:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238728:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238736:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238743:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238750:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238772:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.238792:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238798:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238804:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238815:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.238820:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238828:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238838:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5c:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:2.0:1788876623.238841:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.238844:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238850:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313adcf8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238866:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238872:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238878:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238883:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.238886:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238891:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238904:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa77b700) 00010000:00010000:2.0:1788876623.238906:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.238909:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238914:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313adcea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.238927:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009bdb7d8 reply state 00000000a2545311 transno 68719477343 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238938:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.238944:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe274b122 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876623.238946:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.238949:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.239018:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+117:33371:x1875771511193216:12345-192.168.203.11@tcp:36:rm.0 Request processed in 972us (1239us total) trans 68719477343 rc 0/0 00000100:00100000:2.0:1788876623.239026:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2290 00010000:00010000:3.0:1788876623.240110:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.240120:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.240129:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.240133:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.240141:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.240155:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5c:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:3.0:1788876623.240158:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.240162:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.240168:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adcff lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.240184:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.240187:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.240188:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.242573:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.244836:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511193344 00000100:00100000:2.0:1788876623.244852:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511193344 00000100:00100000:2.0:1788876623.244918:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2291 00000100:00100000:2.0:1788876623.244929:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+117:33371:x1875771511193344:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.244954:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.244978:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313add06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486bf expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245046:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245062:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245074:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.245118:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.245121:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.245141:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245164:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313add06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486bf expref: 119 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245181:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486bf expref: 118 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.245190:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:2.0:1788876623.245193:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.245196:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:2.0:1788876623.245388:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+118:33371:x1875771511193344:12345-192.168.203.11@tcp:101:rm.0 Request processed in 461us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.245396:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2291 00000100:00100000:0.0:1788876623.250321:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.250404:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511193600 00000100:00100000:3.0:1788876623.250414:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511193600 00000100:00100000:3.0:1788876623.250467:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2292 00000100:00100000:3.0:1788876623.250477:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+118:33371:x1875771511193600:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.250525:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.250549:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0f400/0xf5bf0f7e313aa82b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d8f expref: 118 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250573:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5d:0x0].0x0 (ffff8a13c3e1aa00) 00010000:00010000:3.0:1788876623.250588:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313add0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486bf expref: 117 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250598:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:3.0:1788876623.250643:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.250667:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250679:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250688:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250701:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250708:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250714:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250801:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250809:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.250820:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.251018:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].85, 64 off13632 00010000:00010000:3.0:1788876623.251061:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251071:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251078:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251085:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251092:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251098:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251110:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.251124:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251130:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251136:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251145:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.251149:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251156:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251164:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5d:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876623.251167:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.251171:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251176:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add22 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251190:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251196:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251201:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251205:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.251208:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251214:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251235:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:3.0:1788876623.251238:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.251241:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251247:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.251259:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b48d426b reply state 00000000ec801d35 transno 68719477344 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251270:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.251541:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5bda7b75 (ffff8a13e7965600) 00010000:00010000:3.0:1788876623.251544:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.251546:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788876623.251723:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.251730:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.251737:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.251740:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.251747:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.251758:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5d:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:0.0:1788876623.251760:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.251763:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.251770:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313add29 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.251788:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.251790:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.251791:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.251891:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+118:33371:x1875771511193600:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1413us (1578us total) trans 68719477344 rc 0/0 00000100:00100000:3.0:1788876623.251900:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2292 00000100:00100000:3.0:1788876623.257469:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.257726:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511193728 00000100:00100000:0.0:1788876623.257737:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511193728 00000100:00100000:0.0:1788876623.257785:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2293 00000100:00100000:0.0:1788876623.257794:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+118:33371:x1875771511193728:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.257817:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.257841:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486c6 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.257905:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.257918:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.257929:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.257974:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.257978:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.257999:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.258022:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486c6 expref: 120 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.258041:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486c6 expref: 119 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.258050:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.258052:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.258056:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10b200, rc 0) 00000100:00100000:0.0:1788876623.258129:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+119:33371:x1875771511193728:12345-192.168.203.11@tcp:101:rm.0 Request processed in 335us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.258136:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2293 00000100:00100000:1.0:1788876623.261826:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.261921:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511193984 00000100:00100000:2.0:1788876623.261938:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511193984 00000100:00100000:2.0:1788876623.261995:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2294 00000100:00100000:2.0:1788876623.262005:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+119:33371:x1875771511193984:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.262069:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.262101:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d9e00/0xf5bf0f7e313aa84e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d96 expref: 119 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262123:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5e:0x0].0x0 (ffff8a13d9f51c00) 00010000:00010000:2.0:1788876623.262141:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313add37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486c6 expref: 118 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262150:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:2.0:1788876623.262157:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.262184:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262197:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262206:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262218:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x33c39277 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262236:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262244:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262350:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262359:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262367:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.262780:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].86, 64 off13696 00010000:00010000:2.0:1788876623.262827:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262837:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262844:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262852:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262858:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262864:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262876:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.262892:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262898:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262905:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262914:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.262918:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262937:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262946:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5e:0x0].0x0 (ffff8a13ff5bbc00) 00010000:00010000:2.0:1788876623.262949:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.262953:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262959:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add4c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262975:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262980:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262986:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262991:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.262993:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.262999:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.263010:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:2.0:1788876623.263012:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.263015:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.263020:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add3e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.263033:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000009b13b4 reply state 000000003c0cf351 transno 68719477345 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.263042:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.263048:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33c39277 (ffff8a13fae0b500) 00010000:00010000:2.0:1788876623.263050:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.263052:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.263122:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+119:33371:x1875771511193984:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1117us (1303us total) trans 68719477345 rc 0/0 00000100:00100000:2.0:1788876623.263130:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2294 00010000:00010000:1.0:1788876623.263217:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.263234:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.263241:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.263244:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.263250:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.263259:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5e:0x0].0x0 (ffff8a13ff5bbc00) 00010000:00010000:1.0:1788876623.263262:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.263265:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.263270:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add53 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.263291:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.263293:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.263294:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876623.274287:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.274405:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511194112 00000100:00100000:3.0:1788876623.274416:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511194112 00000100:00100000:3.0:1788876623.274481:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2295 00000100:00100000:3.0:1788876623.274492:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+119:33371:x1875771511194112:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.274520:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.274548:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486cd expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274669:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274683:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274695:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.274740:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.274744:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.274761:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274785:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486cd expref: 121 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274804:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486cd expref: 120 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.274813:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:3.0:1788876623.274816:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.274820:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873400, rc 0) 00000100:00100000:3.0:1788876623.274872:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+120:33371:x1875771511194112:12345-192.168.203.11@tcp:101:rm.0 Request processed in 382us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.274878:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2295 00000100:00100000:0.0:1788876623.283669:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.283965:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511194368 00000100:00100000:2.0:1788876623.283975:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511194368 00000100:00100000:2.0:1788876623.284037:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2296 00000100:00100000:2.0:1788876623.284047:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+120:33371:x1875771511194368:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.284098:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.284124:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313aa871 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047d9d expref: 120 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284151:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5f:0x0].0x0 (ffff8a13ff372f00) 00010000:00010000:2.0:1788876623.284166:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486cd expref: 119 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284174:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:2.0:1788876623.284180:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.284205:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284216:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284236:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284248:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3148b334 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284254:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284261:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284557:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284567:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284578:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.284818:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].86, 64 off13696 00010000:00010000:2.0:1788876623.284867:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284877:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284885:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284892:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284898:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284904:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.284921:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.285016:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.285023:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.285031:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.285035:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.285044:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 5/0,0 mode: PW/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.285054:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5f:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:3.0:1788876623.285057:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.285060:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 3/0,0 mode: --/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.285067:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.285069:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.285070:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.285125:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313add7d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285151:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285157:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285166:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285172:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.285175:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285182:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285190:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5f:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.285193:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.285196:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285201:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313add76 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285219:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285236:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285242:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285248:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.285252:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285263:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285270:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:2.0:1788876623.285346:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.285351:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285358:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313add68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.285371:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007eae481 reply state 0000000096d2cfd3 transno 68719477346 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285382:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.285389:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148b334 (ffff8a13ff5bbf00) 00010000:00010000:2.0:1788876623.285392:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.285394:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.285514:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+120:33371:x1875771511194368:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1465us (1851us total) trans 68719477346 rc 0/0 00000100:00100000:2.0:1788876623.285522:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2296 00000100:00100000:1.0:1788876623.292208:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.292296:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511194496 00000100:00100000:3.0:1788876623.292306:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511194496 00000100:00100000:3.0:1788876623.292366:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2297 00000100:00100000:3.0:1788876623.292376:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+120:33371:x1875771511194496:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.292400:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.292448:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486d4 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292515:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292529:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292541:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.292587:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.292591:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.292644:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292669:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313add84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486d4 expref: 122 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292686:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486d4 expref: 121 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.292696:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.292699:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.292703:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873400, rc 0) 00000100:00100000:3.0:1788876623.292760:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+121:33371:x1875771511194496:12345-192.168.203.11@tcp:101:rm.0 Request processed in 386us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.292767:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2297 00000100:00100000:0.0:1788876623.302800:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.306533:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511194752 00000100:00100000:3.0:1788876623.306549:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511194752 00000100:00100000:0.0:1788876623.310293:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2298 00000100:00100000:0.0:1788876623.310309:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+121:33371:x1875771511194752:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.310365:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.310392:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0f000/0xf5bf0f7e313aa894 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047da4 expref: 121 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310413:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x60:0x0].0x0 (ffff8a13cff8bc00) 00010000:00010000:0.0:1788876623.310429:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313add8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486d4 expref: 120 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310439:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:0.0:1788876623.310445:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.310469:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310482:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310497:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310509:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310516:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310523:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310651:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310661:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310668:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.310867:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].87, 64 off13760 00010000:00010000:0.0:1788876623.310911:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310921:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310929:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310945:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310952:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310958:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310974:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.310990:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.310997:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311003:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311008:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.311012:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311020:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311028:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x60:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:0.0:1788876623.311031:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.311035:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311041:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313adda0 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311055:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311061:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311079:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311084:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.311088:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311094:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311102:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876623.311105:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.311108:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311114:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313add92 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.311127:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062c4d0f2 reply state 00000000cb12f5ec transno 68719477347 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311138:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.311144:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e3ef675 (ffff8a13fa4ad500) 00010000:00010000:0.0:1788876623.311146:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.311149:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.311215:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+121:33371:x1875771511194752:12345-192.168.203.11@tcp:36:rm.0 Request processed in 909us (8423us total) trans 68719477347 rc 0/0 00000100:00100000:0.0:1788876623.311233:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2298 00010000:00010000:1.0:1788876623.311294:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.311301:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.311307:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.311310:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.311317:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.311326:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x60:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:1.0:1788876623.311328:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.311331:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.311337:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adda7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.311350:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.311352:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.311354:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.314102:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.320075:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511194880 00000100:00100000:2.0:1788876623.320091:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511194880 00000100:00100000:2.0:1788876623.320172:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2299 00000100:00100000:2.0:1788876623.320182:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+121:33371:x1875771511194880:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.320205:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.320239:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313addae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486db expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320466:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320482:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320494:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.320537:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.320541:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.320558:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320581:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313addae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486db expref: 123 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320625:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486db expref: 122 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.320635:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:2.0:1788876623.320638:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.320642:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8c00, rc 0) 00000100:00100000:2.0:1788876623.320707:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+122:33371:x1875771511194880:12345-192.168.203.11@tcp:101:rm.0 Request processed in 525us (6615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.320714:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2299 00000100:00100000:2.0:1788876623.326116:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.326189:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511195136 00000100:00100000:1.0:1788876623.326199:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511195136 00000100:00100000:1.0:1788876623.326269:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2300 00000100:00100000:1.0:1788876623.326291:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+122:33371:x1875771511195136:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.326345:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.326371:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d9200/0xf5bf0f7e313aa8b7 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dab expref: 122 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326397:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x61:0x0].0x0 (ffff8a13d5606f00) 00010000:00010000:1.0:1788876623.326413:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313addb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486db expref: 121 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326422:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:1.0:1788876623.326429:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.326455:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326469:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326478:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326488:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326494:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326500:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326620:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326629:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326640:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.326841:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].87, 64 off13760 00010000:00010000:1.0:1788876623.326884:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326894:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326901:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326908:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326914:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326921:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326951:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.326969:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.326974:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326981:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.326984:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.326992:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327001:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x61:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.327004:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.327008:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327014:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313addd1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327025:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.327027:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.327029:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.327040:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327047:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327054:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327059:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.327063:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327069:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327077:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x61:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.327079:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.327083:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327094:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313addca lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327111:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327117:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327124:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327129:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.327132:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327139:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327146:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876623.327148:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.327151:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327157:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313addbc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.327167:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d8400a9 reply state 000000009a36ac33 transno 68719477348 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327178:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.327185:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7f9d98ea (ffff8a13ff372000) 00010000:00010000:1.0:1788876623.327187:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.327190:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.327267:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+122:33371:x1875771511195136:12345-192.168.203.11@tcp:36:rm.0 Request processed in 977us (1158us total) trans 68719477348 rc 0/0 00000100:00100000:1.0:1788876623.327275:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2300 00000100:00100000:1.0:1788876623.329400:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.329460:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511195264 00000100:00100000:2.0:1788876623.329469:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511195264 00000100:00100000:2.0:1788876623.329518:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2301 00000100:00100000:2.0:1788876623.329527:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+122:33371:x1875771511195264:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.329547:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.329568:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313addd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486e2 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329672:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329687:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329699:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.329741:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.329745:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.329762:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329786:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313addd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e2 expref: 124 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329802:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e2 expref: 123 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.329810:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.329813:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.329817:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9400, rc 0) 00000100:00100000:2.0:1788876623.329866:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+123:33371:x1875771511195264:12345-192.168.203.11@tcp:101:rm.0 Request processed in 340us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.329873:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2301 00000100:00100000:1.0:1788876623.342427:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.348170:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511195520 00000100:00100000:2.0:1788876623.348185:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511195520 00000100:00100000:2.0:1788876623.348267:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2302 00000100:00100000:2.0:1788876623.349214:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+123:33371:x1875771511195520:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.350054:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.350160:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa786e00/0xf5bf0f7e313aa8da lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047db2 expref: 123 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350185:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x62:0x0].0x0 (ffff8a13d355c800) 00010000:00010000:2.0:1788876623.350203:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adddf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e2 expref: 122 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350213:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.350219:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.350257:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350271:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350347:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350362:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350375:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350381:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350474:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350483:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350490:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.350794:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].88, 64 off13824 00010000:00010000:2.0:1788876623.350837:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350847:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350856:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350864:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350871:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350877:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350903:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.350922:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.350929:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351012:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351021:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.351026:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351035:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351044:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x62:0x0].0x0 (ffff8a13ff5bb600) 00010000:00010000:2.0:1788876623.351047:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.351051:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351058:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313addf4 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351464:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351473:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351484:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351490:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.351493:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351500:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351508:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb000) 00010000:00010000:2.0:1788876623.351511:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.351514:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351520:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313adde6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.351536:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f67d4eb3 reply state 00000000ec752d99 transno 68719477349 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351547:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.351554:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd06b4f64 (ffff8a13ff5bbe00) 00010000:00010000:2.0:1788876623.351556:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.351559:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.351678:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+123:33371:x1875771511195520:12345-192.168.203.11@tcp:36:rm.0 Request processed in 3399us (9401us total) trans 68719477349 rc 0/0 00000100:00100000:2.0:1788876623.351688:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2302 00010000:00010000:3.0:1788876623.353176:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.353187:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.353197:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.353201:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.353210:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.353237:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x62:0x0].0x0 (ffff8a13ff5bb600) 00010000:00010000:3.0:1788876623.353240:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.353244:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.353250:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313addfb lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.353270:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.353271:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.353282:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.355416:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.356217:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511195648 00000100:00100000:2.0:1788876623.356238:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511195648 00000100:00100000:2.0:1788876623.356305:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2303 00000100:00100000:2.0:1788876623.356316:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+123:33371:x1875771511195648:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.356340:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.356365:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486e9 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357110:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357127:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357140:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.357181:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.357185:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.357202:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357238:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e9 expref: 125 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357259:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e9 expref: 124 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.357269:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876623.357429:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.357435:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8400, rc 0) 00000100:00100000:2.0:1788876623.357503:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+124:33371:x1875771511195648:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1188us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.357512:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2303 00000100:00100000:0.0:1788876623.360673:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.360771:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511195904 00000100:00100000:2.0:1788876623.360781:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511195904 00000100:00100000:2.0:1788876623.360825:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2304 00000100:00100000:2.0:1788876623.360835:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+124:33371:x1875771511195904:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.360885:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.360910:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402044800/0xf5bf0f7e313aa8fd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047db9 expref: 124 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.360930:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x63:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:2.0:1788876623.360957:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486e9 expref: 123 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.360969:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876623.360975:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.360998:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361011:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361020:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361031:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361043:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361049:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361147:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361157:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361164:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.361368:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].88, 64 off13824 00010000:00010000:2.0:1788876623.361413:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361423:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361431:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361439:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361447:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361453:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361475:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.361489:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361496:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361503:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361510:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.361514:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361523:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361531:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x63:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.361534:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.361538:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361545:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade1e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361560:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361566:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361577:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361583:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.361586:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361593:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361628:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bba00) 00010000:00010000:2.0:1788876623.361631:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.361634:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361641:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313ade10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.361655:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dadc8dd5 reply state 000000009b66ac10 transno 68719477350 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361665:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.361671:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f5a2b28 (ffff8a13ff5bb800) 00010000:00010000:2.0:1788876623.361673:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.361675:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.361739:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+124:33371:x1875771511195904:12345-192.168.203.11@tcp:36:rm.0 Request processed in 904us (1073us total) trans 68719477350 rc 0/0 00000100:00100000:2.0:1788876623.361746:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2304 00010000:00010000:3.0:1788876623.361888:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.361895:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.361901:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.361904:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.361912:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.361922:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x63:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:3.0:1788876623.361924:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.361927:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.361933:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade25 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.361955:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.361957:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.361959:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.365914:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.366089:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511196032 00000100:00100000:2.0:1788876623.366099:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511196032 00000100:00100000:2.0:1788876623.366144:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2305 00000100:00100000:2.0:1788876623.366153:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+124:33371:x1875771511196032:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.366175:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.366197:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ade2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486f0 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366272:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366298:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366310:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.366351:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.366355:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.366371:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366393:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ade2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f0 expref: 126 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366410:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f0 expref: 125 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.366418:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876623.366421:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.366425:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52800, rc 0) 00000100:00100000:2.0:1788876623.366486:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+125:33371:x1875771511196032:12345-192.168.203.11@tcp:101:rm.0 Request processed in 332us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.366492:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2305 00000100:00100000:3.0:1788876623.373108:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.373260:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511196288 00000100:00100000:2.0:1788876623.373270:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511196288 00000100:00100000:2.0:1788876623.373330:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2306 00000100:00100000:2.0:1788876623.373339:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+125:33371:x1875771511196288:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.373389:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.373416:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d9c00/0xf5bf0f7e313aa920 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dc0 expref: 125 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373436:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x64:0x0].0x0 (ffff8a13e7962800) 00010000:00010000:2.0:1788876623.373452:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ade33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f0 expref: 124 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373461:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876623.373466:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.373487:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373500:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373509:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373521:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373533:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373539:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373650:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373659:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373666:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.373872:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].89, 64 off13888 00010000:00010000:2.0:1788876623.373918:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373927:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.373991:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.374002:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.374009:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.374015:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.374135:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.374281:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374290:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374297:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374303:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.374307:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374315:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374325:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x64:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:0.0:1788876623.374328:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.374332:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374338:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313ade48 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374354:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374360:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374372:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374377:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.374380:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374386:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374392:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:0.0:1788876623.374394:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.374397:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374402:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ade3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.374415:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e779fc6 reply state 000000009bf8463a transno 68719477351 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374425:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.374431:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd95ebeb7 (ffff8a13ff5bb000) 00010000:00010000:0.0:1788876623.374433:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.374435:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.374508:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+125:33371:x1875771511196288:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1168us (1406us total) trans 68719477351 rc 0/0 00000100:00100000:0.0:1788876623.374517:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2306 00010000:00010000:3.0:1788876623.379761:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.379778:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.379788:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.379793:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.379804:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.379824:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x64:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:3.0:1788876623.379827:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.379832:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.379839:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ade4f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.379868:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.379870:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.379873:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.383873:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.385035:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511196416 00000100:00100000:2.0:1788876623.385047:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511196416 00000100:00100000:0.0:1788876623.388478:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2307 00000100:00100000:0.0:1788876623.388492:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+125:33371:x1875771511196416:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.388518:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.388542:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486f7 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388676:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388692:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388705:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.388749:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.388753:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.388769:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388793:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f7 expref: 127 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388811:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f7 expref: 126 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.388821:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876623.388825:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.388829:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b1000, rc 0) 00000100:00100000:0.0:1788876623.388922:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+126:33371:x1875771511196416:12345-192.168.203.11@tcp:101:rm.0 Request processed in 432us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.388930:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2307 00000100:00100000:2.0:1788876623.405201:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.407534:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511196672 00000100:00100000:0.0:1788876623.407551:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511196672 00000100:00100000:0.0:1788876623.407778:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2308 00000100:00100000:0.0:1788876623.407790:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+126:33371:x1875771511196672:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.407845:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.407870:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0ea00/0xf5bf0f7e313aa943 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dc7 expref: 126 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407889:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x65:0x0].0x0 (ffff8a13cff8b000) 00010000:00010000:0.0:1788876623.407904:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ade5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486f7 expref: 125 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407912:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876623.407918:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.407951:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407964:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407973:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407986:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xecedf1db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.407997:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408003:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408108:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408116:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408123:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.408328:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].89, 64 off13888 00010000:00010000:0.0:1788876623.408371:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408381:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408389:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408395:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408401:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408406:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408434:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.408451:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408457:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408463:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408469:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.408473:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408479:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408487:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x65:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.408489:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.408493:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408498:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ade72 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408512:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408518:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408527:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408531:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.408533:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408538:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408544:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876623.408546:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.408549:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408554:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313ade64 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.408565:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f527c9c1 reply state 000000000687c9d1 transno 68719477352 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408574:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.408580:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xecedf1db (ffff8a13fa4adb00) 00010000:00010000:0.0:1788876623.408582:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.408585:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.408693:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+126:33371:x1875771511196672:12345-192.168.203.11@tcp:36:rm.0 Request processed in 904us (3500us total) trans 68719477352 rc 0/0 00000100:00100000:0.0:1788876623.408701:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2308 00010000:00010000:1.0:1788876623.408887:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.408895:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.408901:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.408904:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.408911:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.408919:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x65:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:1.0:1788876623.408922:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.408925:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.408931:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ade79 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.408946:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.408948:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.408950:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.423309:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.426403:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511196800 00000100:00100000:1.0:1788876623.426419:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511196800 00000100:00100000:1.0:1788876623.426556:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2309 00000100:00100000:1.0:1788876623.426567:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+126:33371:x1875771511196800:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876623.426592:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876623.426646:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ade80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370486fe expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426712:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426726:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426739:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876623.426782:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876623.426786:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876623.426804:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426830:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ade80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486fe expref: 128 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426849:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486fe expref: 127 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.426857:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876623.426860:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876623.426864:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a86400, rc 0) 00000100:00100000:1.0:1788876623.426928:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+127:33371:x1875771511196800:12345-192.168.203.11@tcp:101:rm.0 Request processed in 363us (3629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876623.426948:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2309 00000100:00100000:0.0:1788876623.434624:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.434739:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197056 00000100:00100000:2.0:1788876623.434750:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197056 00000100:00100000:2.0:1788876623.434809:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2310 00000100:00100000:2.0:1788876623.434819:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+127:33371:x1875771511197056:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.434872:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.434899:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed0c00/0xf5bf0f7e313aa11d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c1c expref: 127 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.434920:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:2.0:1788876623.434946:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313ade87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370486fe expref: 126 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.434958:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:2.0:1788876623.434965:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.434990:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435003:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435013:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435025:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435034:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435040:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435147:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435155:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435162:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.435383:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].90, 64 off13952 00010000:00010000:2.0:1788876623.435429:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435439:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435447:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435453:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435459:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435464:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435491:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.435509:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435515:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435520:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435526:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.435530:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435538:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435547:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.435550:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.435553:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435559:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313ade9c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435578:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435584:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435593:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435597:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.435640:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435648:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435655:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876623.435658:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.435661:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435667:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313ade8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.435680:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d9b123b reply state 000000005e84c950 transno 68719477353 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435692:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.435698:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7d261ae4 (ffff8a13ff5bba00) 00010000:00010000:2.0:1788876623.435700:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.435703:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.435769:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+127:33371:x1875771511197056:12345-192.168.203.11@tcp:36:rm.0 Request processed in 949us (1177us total) trans 68719477353 rc 0/0 00000100:00100000:2.0:1788876623.435776:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2310 00010000:00010000:1.0:1788876623.436022:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.436030:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.436036:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.436040:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.436048:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.436057:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:1.0:1788876623.436070:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.436074:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.436080:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adea3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.436094:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.436095:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.436097:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.442151:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.442242:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197184 00000100:00100000:2.0:1788876623.442251:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197184 00000100:00100000:2.0:1788876623.442318:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2311 00000100:00100000:2.0:1788876623.442328:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+127:33371:x1875771511197184:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.442352:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.442372:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adeaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048705 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442435:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442449:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442460:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.442511:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.442514:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.442532:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442555:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adeaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048705 expref: 129 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442573:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048705 expref: 128 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.442583:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876623.442586:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.442590:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:2.0:1788876623.443255:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+128:33371:x1875771511197184:12345-192.168.203.11@tcp:101:rm.0 Request processed in 925us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.443264:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2311 00000100:00100000:0.0:1788876623.451362:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.456242:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197440 00000100:00100000:1.0:1788876623.456257:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197440 00000100:00100000:1.0:1788876623.456810:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2312 00000100:00100000:1.0:1788876623.456823:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+128:33371:x1875771511197440:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.456876:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.456906:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d0200/0xf5bf0f7e313aa966 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dce expref: 128 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.456942:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x66:0x0].0x0 (ffff8a13e7962500) 00010000:00010000:1.0:1788876623.456962:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adeb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048705 expref: 127 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.456973:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb500) 00010000:00010000:1.0:1788876623.456979:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.457002:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457014:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457023:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457037:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdc580966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457044:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457051:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457161:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457169:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457177:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.457402:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].91, 64 off14016 00010000:00010000:1.0:1788876623.457450:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457460:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457468:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457476:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457481:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457487:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457509:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.457525:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457531:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457537:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457547:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.457551:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457558:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457565:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x66:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876623.457568:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.457572:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457577:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313adec6 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457591:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457596:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457632:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457637:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.457640:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457646:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457658:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.457660:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.457663:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457669:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313adeb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.457682:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082346d4b reply state 0000000015b53566 transno 68719477354 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457692:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.457697:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdc580966 (ffff8a13ff372e00) 00010000:00010000:1.0:1788876623.457699:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.457701:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.457770:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+128:33371:x1875771511197440:12345-192.168.203.11@tcp:36:rm.0 Request processed in 948us (6418us total) trans 68719477354 rc 0/0 00000100:00100000:1.0:1788876623.457777:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2312 00010000:00010000:3.0:1788876623.457838:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.457846:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.457857:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.457861:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.457867:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.457876:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x66:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:3.0:1788876623.457878:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.457881:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.457886:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313adecd lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.457901:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.457903:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.457904:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.462052:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.470061:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197568 00000100:00100000:2.0:1788876623.470088:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197568 00000100:00100000:2.0:1788876623.470180:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2313 00000100:00100000:2.0:1788876623.470191:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+128:33371:x1875771511197568:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.470215:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.470250:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313aded4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704870c expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470663:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470679:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470692:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.470739:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.470743:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.470761:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470789:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313aded4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704870c expref: 130 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470808:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704870c expref: 129 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.470818:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876623.470821:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.470825:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8400, rc 0) 00000100:00100000:2.0:1788876623.470884:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+129:33371:x1875771511197568:12345-192.168.203.11@tcp:101:rm.0 Request processed in 694us (8842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.470891:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2313 00000100:00100000:1.0:1788876623.480022:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.480198:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197824 00000100:00100000:0.0:1788876623.480209:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197824 00000100:00100000:0.0:1788876623.480279:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2314 00000100:00100000:0.0:1788876623.480291:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+129:33371:x1875771511197824:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.480344:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.480369:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa787000/0xf5bf0f7e313aa989 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dd5 expref: 129 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480391:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x67:0x0].0x0 (ffff8a13f35d9a00) 00010000:00010000:0.0:1788876623.480406:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adedb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704870c expref: 128 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480417:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:0.0:1788876623.480424:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.480446:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480459:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480469:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480481:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480488:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480495:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480586:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480596:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480643:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.480834:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].90, 64 off13952 00010000:00010000:0.0:1788876623.480878:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480888:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480896:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480904:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480912:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.480919:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481180:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.481200:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481208:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481215:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481221:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.481235:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481243:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481252:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x67:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:0.0:1788876623.481255:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.481259:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481264:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adef0 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481377:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481384:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481393:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481398:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.481400:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481405:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481412:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876623.481415:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.481417:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481422:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adee2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.481436:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b0150c1 reply state 00000000f5128525 transno 68719477355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481445:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.481451:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbeafb14 (ffff8a13fa4ad800) 00010000:00010000:0.0:1788876623.481453:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.481455:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.481526:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+129:33371:x1875771511197824:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1236us (1511us total) trans 68719477355 rc 0/0 00000100:00100000:0.0:1788876623.481534:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2314 00010000:00010000:1.0:1788876623.481763:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.481770:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.481776:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.481779:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.481784:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.481794:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x67:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:1.0:1788876623.481796:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.481799:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.481804:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313adef7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x67:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.481816:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.481819:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.481820:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.488455:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.490764:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511197952 00000100:00100000:2.0:1788876623.490778:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511197952 00000100:00100000:0.0:1788876623.492377:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2315 00000100:00100000:0.0:1788876623.492390:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+129:33371:x1875771511197952:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.492421:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.492447:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048713 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.492514:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.492529:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.493637:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.493702:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.493706:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.493728:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.493764:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313adefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048713 expref: 131 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.493782:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048713 expref: 130 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.493791:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:0.0:1788876623.493794:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.493799:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0200, rc 0) 00000100:00100000:0.0:1788876623.494038:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+130:33371:x1875771511197952:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1649us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.494047:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2315 00000100:00100000:0.0:1788876623.500673:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.500987:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511198208 00000100:00100000:2.0:1788876623.500999:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511198208 00000100:00100000:2.0:1788876623.501057:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2316 00000100:00100000:2.0:1788876623.501067:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+130:33371:x1875771511198208:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.501118:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.501144:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0e400/0xf5bf0f7e313aa9ac lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ddc expref: 130 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501163:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x68:0x0].0x0 (ffff8a13cff8b300) 00010000:00010000:2.0:1788876623.501178:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313adf05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048713 expref: 129 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501187:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad100) 00010000:00010000:2.0:1788876623.501194:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.501215:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501240:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501250:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501264:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501271:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501287:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501376:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501385:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501392:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.501579:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].92, 64 off14080 00010000:00010000:2.0:1788876623.501853:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501864:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501872:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501880:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501888:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501894:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501907:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.501924:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501930:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501937:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501943:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.501948:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501956:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501964:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x68:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:2.0:1788876623.501967:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.501971:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501977:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf1a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x68:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.501995:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502002:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502010:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502016:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.502019:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502025:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502032:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.502034:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.502037:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502042:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.502054:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027b649ec reply state 00000000d74ecf50 transno 68719477356 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502065:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.502071:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x36cd9303 (ffff8a13ff5bb600) 00010000:00010000:2.0:1788876623.502074:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.502076:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.502143:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+130:33371:x1875771511198208:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1075us (1478us total) trans 68719477356 rc 0/0 00000100:00100000:2.0:1788876623.502149:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2316 00010000:00010000:1.0:1788876623.504597:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.504646:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.504656:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.504660:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.504670:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.504687:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x68:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:1.0:1788876623.504690:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.504695:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.504702:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf21 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x68:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.504725:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.504728:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.504730:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.506440:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.506545:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511198336 00000100:00100000:0.0:1788876623.506553:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511198336 00000100:00100000:0.0:1788876623.506642:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2317 00000100:00100000:0.0:1788876623.506654:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+130:33371:x1875771511198336:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.506676:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.506698:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adf28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704871a expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506762:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506775:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506787:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.506828:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.506832:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.506849:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506871:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313adf28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704871a expref: 132 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506892:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704871a expref: 131 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.506900:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876623.506903:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.506906:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0400, rc 0) 00000100:00100000:0.0:1788876623.507549:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+131:33371:x1875771511198336:12345-192.168.203.11@tcp:101:rm.0 Request processed in 892us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.507559:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2317 00000100:00100000:0.0:1788876623.518168:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.518325:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511198592 00000100:00100000:2.0:1788876623.518335:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511198592 00000100:00100000:2.0:1788876623.518391:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2318 00000100:00100000:2.0:1788876623.518401:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+131:33371:x1875771511198592:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.518449:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.518473:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402045400/0xf5bf0f7e313aa9cf lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047de3 expref: 131 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518493:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x69:0x0].0x0 (ffff8a13f35d9e00) 00010000:00010000:2.0:1788876623.518508:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704871a expref: 130 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518517:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:2.0:1788876623.518523:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.518544:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518556:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518565:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518576:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518583:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518589:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518795:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518804:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.518811:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.519012:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].91, 64 off14016 00010000:00010000:2.0:1788876623.519057:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519066:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519075:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519083:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519090:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519096:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519122:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.519138:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519145:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519151:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519157:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.519161:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519170:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519179:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x69:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:2.0:1788876623.519182:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.519186:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519192:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf44 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519208:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519214:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519239:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519244:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.519247:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519253:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519261:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.519263:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.519266:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.519272:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519490:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.519497:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519503:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.519506:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519513:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519522:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x69:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:3.0:1788876623.519524:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.519527:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519533:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf4b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.519557:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.519559:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.519560:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788876623.520417:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdc8fb26 reply state 0000000028da8740 transno 68719477357 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.520429:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.520436:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46c12da2 (ffff8a13ff5bbc00) 00010000:00010000:2.0:1788876623.520439:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.520442:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.520517:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+131:33371:x1875771511198592:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2116us (2357us total) trans 68719477357 rc 0/0 00000100:00100000:2.0:1788876623.520536:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2318 00000100:00100000:2.0:1788876623.528307:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.528411:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511198720 00000100:00100000:3.0:1788876623.528422:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511198720 00000100:00100000:3.0:1788876623.528485:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2319 00000100:00100000:3.0:1788876623.528495:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+131:33371:x1875771511198720:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.528518:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.528542:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adf52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048721 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528632:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528647:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528661:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.528704:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.528707:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.528725:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528754:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313adf52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048721 expref: 133 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528773:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048721 expref: 132 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.528781:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.528783:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.528787:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873e00, rc 0) 00000100:00100000:3.0:1788876623.528847:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+132:33371:x1875771511198720:12345-192.168.203.11@tcp:101:rm.0 Request processed in 354us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.528854:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2319 00000100:00100000:0.0:1788876623.532110:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.535050:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511198976 00000100:00100000:2.0:1788876623.535065:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511198976 00000100:00100000:2.0:1788876623.535164:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2320 00000100:00100000:2.0:1788876623.535175:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+132:33371:x1875771511198976:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.535237:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.535263:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca000/0xf5bf0f7e313aa9f2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dea expref: 132 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535294:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6a:0x0].0x0 (ffff8a13f35d9800) 00010000:00010000:2.0:1788876623.535313:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313adf59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048721 expref: 131 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535323:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:2.0:1788876623.535329:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.535352:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535365:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535374:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535386:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535392:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535402:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535495:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535504:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.535511:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.535901:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].93, 64 off14144 00010000:00010000:2.0:1788876623.536766:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536781:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536790:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536799:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536806:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536812:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536839:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.536860:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536867:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536873:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536880:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.536884:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536892:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536903:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6a:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876623.536906:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.536910:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536915:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adf6e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.536932:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537390:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537398:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537403:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.537408:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537415:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537423:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.537427:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.537430:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537437:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adf60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.537454:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3d1f0b5 reply state 00000000986dd6c5 transno 68719477358 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537466:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.537473:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x89cf8cc4 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876623.537476:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.537479:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788876623.537673:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.537680:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.537687:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.537691:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.537697:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.537707:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6a:0x0].0x0 (ffff8a13ff5bbd00) 00010000:00010000:1.0:1788876623.537709:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.537713:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.537718:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adf75 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.537731:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.537733:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.537735:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876623.537799:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+132:33371:x1875771511198976:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2623us (5695us total) trans 68719477358 rc 0/0 00000100:00100000:2.0:1788876623.537809:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2320 00000100:00100000:2.0:1788876623.542548:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.542651:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511199104 00000100:00100000:0.0:1788876623.542662:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511199104 00000100:00100000:0.0:1788876623.542724:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2321 00000100:00100000:0.0:1788876623.542734:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+132:33371:x1875771511199104:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.542757:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.542779:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313adf7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048728 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542840:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542854:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542866:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.542914:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.542918:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.542948:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542973:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313adf7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048728 expref: 134 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542990:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048728 expref: 133 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.542999:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876623.543002:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.543005:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0400, rc 0) 00000100:00100000:0.0:1788876623.543326:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+133:33371:x1875771511199104:12345-192.168.203.11@tcp:101:rm.0 Request processed in 591us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.543334:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2321 00000100:00100000:3.0:1788876623.549996:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.550087:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511199360 00000100:00100000:1.0:1788876623.550096:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511199360 00000100:00100000:1.0:1788876623.550151:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2322 00000100:00100000:1.0:1788876623.550160:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+133:33371:x1875771511199360:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.550208:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.550243:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d9000/0xf5bf0f7e313aaa15 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047df1 expref: 133 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550265:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6b:0x0].0x0 (ffff8a13e7962b00) 00010000:00010000:1.0:1788876623.550294:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313adf83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048728 expref: 132 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550304:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:1.0:1788876623.550311:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.550333:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550346:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550355:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550367:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x951cee31 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550373:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550379:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550463:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550471:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550482:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.550715:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].92, 64 off14080 00010000:00010000:1.0:1788876623.550757:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550766:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550774:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550782:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550788:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550794:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550809:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.550823:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550829:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550835:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550844:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.550849:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550857:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550865:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6b:0x0].0x0 (ffff8a13ff372500) 00010000:00010000:1.0:1788876623.550867:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.550871:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550876:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313adf98 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550891:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550896:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550902:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550907:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.550910:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550915:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550925:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.550928:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.550930:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550936:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313adf8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.550947:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036a1f847 reply state 000000008baa9ee4 transno 68719477359 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550956:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.550962:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x951cee31 (ffff8a13ff372f00) 00010000:00010000:1.0:1788876623.550964:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.550967:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.551030:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+133:33371:x1875771511199360:12345-192.168.203.11@tcp:36:rm.0 Request processed in 870us (1042us total) trans 68719477359 rc 0/0 00000100:00100000:1.0:1788876623.551037:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2322 00010000:00010000:3.0:1788876623.551288:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.551295:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.551301:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.551305:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.551312:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.551322:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6b:0x0].0x0 (ffff8a13ff372500) 00010000:00010000:3.0:1788876623.551324:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.551327:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.551337:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313adf9f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.551352:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.551354:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.551356:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.562414:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.562515:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511199488 00000100:00100000:2.0:1788876623.562525:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511199488 00000100:00100000:2.0:1788876623.562582:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2323 00000100:00100000:2.0:1788876623.562592:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+133:33371:x1875771511199488:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.562712:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.562736:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704872f expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.562797:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.562811:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.562823:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.562863:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.562867:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.562884:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.562906:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704872f expref: 135 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.563078:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704872f expref: 134 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.563088:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.563090:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.563094:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:2.0:1788876623.564053:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+134:33371:x1875771511199488:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1458us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.564062:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2323 00000100:00100000:0.0:1788876623.574198:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.575262:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511199744 00000100:00100000:2.0:1788876623.575274:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511199744 00000100:00100000:2.0:1788876623.575345:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2324 00000100:00100000:2.0:1788876623.575355:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+134:33371:x1875771511199744:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.575410:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.575436:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313aaa38 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047df8 expref: 134 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575457:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6c:0x0].0x0 (ffff8a13f35d9500) 00010000:00010000:2.0:1788876623.575474:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704872f expref: 133 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575485:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876623.575490:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.575513:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575527:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575537:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575550:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575557:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575563:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575700:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575709:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575716:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.575922:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].94, 64 off14208 00010000:00010000:2.0:1788876623.575970:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575979:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575987:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575993:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.575999:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576004:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576029:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.576046:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576055:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576060:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576065:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.576069:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576076:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576083:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6c:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:2.0:1788876623.576086:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.576090:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576095:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313adfc2 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576110:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576116:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576121:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576126:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.576129:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576135:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576142:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.576145:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.576147:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576152:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.576165:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000425f36f8 reply state 000000000c62e0d3 transno 68719477360 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576175:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.576181:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc082bfb3 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876623.576183:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.576186:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.576263:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+134:33371:x1875771511199744:12345-192.168.203.11@tcp:36:rm.0 Request processed in 908us (2074us total) trans 68719477360 rc 0/0 00010000:00010000:0.0:1788876623.576265:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788876623.576275:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2324 00010000:00010000:0.0:1788876623.576286:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.576295:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.576299:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.576306:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.576321:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6c:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:0.0:1788876623.576324:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.576327:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.576333:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313adfc9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.576349:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.576351:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.576354:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.580060:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.580239:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511199872 00000100:00100000:2.0:1788876623.580249:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511199872 00000100:00100000:2.0:1788876623.580317:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2325 00000100:00100000:2.0:1788876623.580327:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+134:33371:x1875771511199872:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.580351:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.580772:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adfd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048736 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.580841:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.580855:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.580867:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.580909:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.580912:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.581037:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.581062:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313adfd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048736 expref: 136 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.581080:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048736 expref: 135 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.581088:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83200) 00010000:00010000:2.0:1788876623.581091:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.581094:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8400, rc 0) 00000100:00100000:2.0:1788876623.581143:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+135:33371:x1875771511199872:12345-192.168.203.11@tcp:101:rm.0 Request processed in 818us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.581151:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2325 00000100:00100000:1.0:1788876623.592042:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.592185:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511200128 00000100:00100000:2.0:1788876623.592195:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511200128 00000100:00100000:2.0:1788876623.592266:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2326 00000100:00100000:2.0:1788876623.592275:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+135:33371:x1875771511200128:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.592334:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.592361:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d1800/0xf5bf0f7e313aaa5b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047dff expref: 135 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592380:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6d:0x0].0x0 (ffff8a13d9f51200) 00010000:00010000:2.0:1788876623.592395:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313adfd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048736 expref: 134 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592405:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83200) 00010000:00010000:2.0:1788876623.592411:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.592432:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592444:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592454:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592466:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x50199b77 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592473:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592480:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592574:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592584:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.592592:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.592908:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].93, 64 off14144 00010000:00010000:2.0:1788876623.593132:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593143:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593152:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593159:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593166:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593171:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593196:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.593212:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593234:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593240:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593246:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.593251:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593259:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593268:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6d:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876623.593271:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.593275:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593281:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313adfec lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593295:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593302:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593308:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593313:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.593317:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593323:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593329:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876623.593331:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.593334:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593339:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313adfde lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.593351:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa3e40c7 reply state 000000005728487a transno 68719477361 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593360:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.593366:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50199b77 (ffff8a13fae83400) 00010000:00010000:2.0:1788876623.593368:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.593370:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876623.593499:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.593506:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.593512:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cba00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.593515:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.593521:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.593529:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6d:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:3.0:1788876623.593531:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.593533:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.593538:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313adff3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.593550:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.593552:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.593554:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876623.594284:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+135:33371:x1875771511200128:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2005us (2247us total) trans 68719477361 rc 0/0 00000100:00100000:2.0:1788876623.594293:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2326 00000100:00100000:0.0:1788876623.610709:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.610969:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511200256 00000100:00100000:3.0:1788876623.610979:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511200256 00000100:00100000:3.0:1788876623.611037:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2327 00000100:00100000:3.0:1788876623.611046:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+135:33371:x1875771511200256:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.611079:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.611101:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704873d expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611167:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611182:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611194:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.611247:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.611251:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.611269:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611292:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313adffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704873d expref: 137 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611310:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704873d expref: 136 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.611319:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:3.0:1788876623.611322:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.611325:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873800, rc 0) 00000100:00100000:3.0:1788876623.611388:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+136:33371:x1875771511200256:12345-192.168.203.11@tcp:101:rm.0 Request processed in 342us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.611398:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2327 00000100:00100000:1.0:1788876623.624081:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.624491:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511200512 00000100:00100000:2.0:1788876623.624502:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511200512 00000100:00100000:2.0:1788876623.624565:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2328 00000100:00100000:2.0:1788876623.624575:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+136:33371:x1875771511200512:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.624670:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.624699:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0f600/0xf5bf0f7e313aaa7e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e06 expref: 136 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624720:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6e:0x0].0x0 (ffff8a13cff8b600) 00010000:00010000:2.0:1788876623.624738:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704873d expref: 135 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624749:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:2.0:1788876623.624756:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.624784:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624797:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624807:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624818:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624825:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.624831:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.625680:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.625692:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.625701:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.625911:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].95, 64 off14272 00010000:00010000:2.0:1788876623.626048:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626058:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626066:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626074:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626081:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626087:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626165:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.626185:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626192:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626198:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626208:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.626212:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626219:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626238:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6e:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876623.626241:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.626245:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626251:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae016 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626265:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626270:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626285:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626290:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.626293:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626299:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626310:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876623.626313:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.626316:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626321:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae008 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.626334:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086948874 reply state 000000005ad7404e transno 68719477362 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626344:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.626351:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5eae1855 (ffff8a13fae83200) 00010000:00010000:2.0:1788876623.626353:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.626355:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.626483:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+136:33371:x1875771511200512:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1907us (2406us total) trans 68719477362 rc 0/0 00000100:00100000:2.0:1788876623.626491:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2328 00010000:00010000:3.0:1788876623.630875:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.630889:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.630899:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.630904:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.630915:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.630986:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6e:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:3.0:1788876623.630990:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.630995:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.631002:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae01d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.633107:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.633113:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.633115:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.653535:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.654039:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511200640 00000100:00100000:0.0:1788876623.654049:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511200640 00000100:00100000:0.0:1788876623.654106:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2329 00000100:00100000:0.0:1788876623.654117:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+136:33371:x1875771511200640:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.654140:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.654164:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048744 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654242:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654255:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654267:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.654315:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.654319:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.654334:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654357:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048744 expref: 138 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654375:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048744 expref: 137 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.654383:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876623.654386:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.654389:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0c00, rc 0) 00000100:00100000:0.0:1788876623.654456:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511200640:12345-192.168.203.11@tcp:101:rm.0 Request processed in 341us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.654464:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2329 00000100:00100000:1.0:1788876623.661432:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.663063:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511200896 00000100:00100000:0.0:1788876623.663076:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511200896 00000100:00100000:0.0:1788876623.663142:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2330 00000100:00100000:0.0:1788876623.663153:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511200896:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.663208:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.663242:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1caa00/0xf5bf0f7e313aaaa1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e0d expref: 137 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663263:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6f:0x0].0x0 (ffff8a13d355c400) 00010000:00010000:0.0:1788876623.663280:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae02b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048744 expref: 136 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663289:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876623.663296:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.663319:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663331:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663342:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663355:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x18b2154c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663362:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.663372:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.663730:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.663741:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.663750:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.664374:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].94, 64 off14208 00010000:00010000:1.0:1788876623.664428:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664439:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664447:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664455:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664462:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664467:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664493:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.664513:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664520:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664526:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664536:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.664541:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664548:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664557:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6f:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.664560:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.664564:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.664571:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae040 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664833:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.664841:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664848:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.664852:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664859:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664869:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x6f:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:0.0:1788876623.664872:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.664875:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664881:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae047 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.664896:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.664897:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.664899:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.665055:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665062:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665068:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665074:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.665077:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665083:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665095:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:1.0:1788876623.665098:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.665102:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665108:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae032 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.665122:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037423495 reply state 00000000a4078c0b transno 68719477363 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665133:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.665140:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x18b2154c (ffff8a13fa4ad100) 00010000:00010000:1.0:1788876623.665142:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.665145:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.665747:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511200896:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2589us (4316us total) trans 68719477363 rc 0/0 00000100:00100000:1.0:1788876623.665756:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2330 00000100:00100000:1.0:1788876623.675176:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.675268:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511201024 00000100:00100000:2.0:1788876623.675279:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511201024 00000100:00100000:2.0:1788876623.675342:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2331 00000100:00100000:2.0:1788876623.675351:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+137:33371:x1875771511201024:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.675372:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.675393:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae04e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704874b expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675456:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675469:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675481:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.675526:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.675530:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.675549:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675588:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae04e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704874b expref: 139 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675647:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704874b expref: 138 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.675656:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876623.675659:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.675662:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb400, rc 0) 00000100:00100000:2.0:1788876623.675720:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+138:33371:x1875771511201024:12345-192.168.203.11@tcp:101:rm.0 Request processed in 370us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.675727:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2331 00000100:00100000:0.0:1788876623.686541:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.687280:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511201280 00000100:00100000:3.0:1788876623.687291:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511201280 00000100:00100000:3.0:1788876623.687354:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2332 00000100:00100000:3.0:1788876623.687366:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+138:33371:x1875771511201280:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.687439:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.687468:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed1400/0xf5bf0f7e313aa139 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c23 expref: 138 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687490:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff8a13e7962f00) 00010000:00010000:3.0:1788876623.687510:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704874b expref: 137 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687519:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:3.0:1788876623.687526:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.687555:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687568:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687578:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687598:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x223991a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687645:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687653:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687751:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687760:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.687767:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.687966:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].95, 64 off14272 00010000:00010000:3.0:1788876623.688019:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688028:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688036:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688044:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688050:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688057:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688082:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.688100:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688106:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688112:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688118:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.688123:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688131:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688139:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:3.0:1788876623.688142:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.688145:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688151:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae06a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688166:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688172:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688178:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688183:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.688186:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688192:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688198:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965a00) 00010000:00010000:3.0:1788876623.688201:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.688203:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688209:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae05c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.688237:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cb84ce0 reply state 0000000096435527 transno 68719477364 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688249:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.688255:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x223991a9 (ffff8a13e7965e00) 00010000:00010000:3.0:1788876623.688257:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.688259:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.688355:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+138:33371:x1875771511201280:12345-192.168.203.11@tcp:36:rm.0 Request processed in 990us (1821us total) trans 68719477364 rc 0/0 00000100:00100000:3.0:1788876623.688363:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2332 00010000:00010000:1.0:1788876623.688643:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.688651:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.688658:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.688661:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.688668:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.688689:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff8a13e7965f00) 00010000:00010000:1.0:1788876623.688691:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.688695:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.688701:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae071 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.688715:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.688717:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.688719:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.693069:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.693286:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511201408 00000100:00100000:3.0:1788876623.693296:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511201408 00000100:00100000:3.0:1788876623.693352:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2333 00000100:00100000:3.0:1788876623.693362:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+138:33371:x1875771511201408:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.693385:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.693406:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048752 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693466:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693479:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693491:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.693537:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.693541:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.693559:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693580:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048752 expref: 140 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693596:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048752 expref: 139 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.693806:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:3.0:1788876623.693810:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.693813:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:3.0:1788876623.693914:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+139:33371:x1875771511201408:12345-192.168.203.11@tcp:101:rm.0 Request processed in 553us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.693922:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2333 00000100:00100000:2.0:1788876623.711594:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.711738:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511201664 00000100:00100000:0.0:1788876623.711748:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511201664 00000100:00100000:0.0:1788876623.711806:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2334 00000100:00100000:0.0:1788876623.711816:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+139:33371:x1875771511201664:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.711870:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.711896:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed1c00/0xf5bf0f7e313aaac4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e14 expref: 139 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.711919:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x70:0x0].0x0 (ffff8a13c4c77300) 00010000:00010000:0.0:1788876623.711938:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae07f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048752 expref: 138 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.711949:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:0.0:1788876623.711957:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.711982:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.711998:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.712009:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.712022:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.712029:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.712036:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712231:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712242:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712251:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.712477:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].96, 64 off14336 00010000:00010000:1.0:1788876623.712521:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712531:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712540:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712548:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712556:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712564:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712588:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.712631:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712637:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712643:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712649:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.712653:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712660:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712669:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x70:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.712672:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.712686:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712692:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae094 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712706:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712712:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712717:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712722:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.712725:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712731:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712738:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ade00) 00010000:00010000:1.0:1788876623.712741:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.712743:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712748:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae086 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.712761:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056fe3ea7 reply state 0000000006ab7dec transno 68719477365 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712770:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.712776:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fd51cfa (ffff8a13fa4ad300) 00010000:00010000:1.0:1788876623.712778:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.712781:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.712862:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+139:33371:x1875771511201664:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1045us (1276us total) trans 68719477365 rc 0/0 00000100:00100000:1.0:1788876623.712870:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2334 00010000:00010000:2.0:1788876623.715283:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.715297:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.715309:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.715313:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.715323:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.715341:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x70:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:2.0:1788876623.715344:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876623.715348:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.715354:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae09b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.715378:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.715380:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.715382:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.720542:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.720640:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511201792 00000100:00100000:3.0:1788876623.720649:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511201792 00000100:00100000:3.0:1788876623.720715:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2335 00000100:00100000:3.0:1788876623.720725:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+139:33371:x1875771511201792:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.720752:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.720778:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae0a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048759 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.720845:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.720864:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.720877:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.720920:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.720924:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.720952:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.720978:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae0a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048759 expref: 141 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.720996:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048759 expref: 140 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.721005:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:3.0:1788876623.721008:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.721012:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8d800, rc 0) 00000100:00100000:3.0:1788876623.721069:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+140:33371:x1875771511201792:12345-192.168.203.11@tcp:101:rm.0 Request processed in 346us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.721076:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2335 00010000:00010000:0.0:1788876623.721773:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.724680:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.725392:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202048 00000100:00100000:3.0:1788876623.725402:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202048 00000100:00100000:3.0:1788876623.725460:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2336 00000100:00100000:3.0:1788876623.725470:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+140:33371:x1875771511202048:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.725520:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.725547:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed0200/0xf5bf0f7e313aaae7 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x71:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e1b expref: 140 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725566:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x71:0x0].0x0 (ffff8a13c4c77600) 00010000:00010000:3.0:1788876623.725581:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae0a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048759 expref: 139 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725590:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:3.0:1788876623.725597:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.725653:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725666:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725808:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725826:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725834:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725842:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725931:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725941:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.725949:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.726130:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].96, 64 off14336 00010000:00010000:3.0:1788876623.726172:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726183:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726191:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726199:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726206:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726212:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726285:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.726302:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726309:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726315:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726325:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.726330:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726337:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726346:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x71:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:3.0:1788876623.726349:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.726353:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726360:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae0be lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726373:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726380:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726386:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726391:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.726394:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726400:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726411:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:3.0:1788876623.726413:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.726416:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726422:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae0b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.726434:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e4e7fdd reply state 00000000229b9bfe transno 68719477366 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726444:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.726450:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cb3c8c7 (ffff8a13fa77b700) 00010000:00010000:3.0:1788876623.726453:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.726455:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.726525:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+140:33371:x1875771511202048:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1056us (1852us total) trans 68719477366 rc 0/0 00000100:00100000:3.0:1788876623.726534:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2336 00000100:00100000:2.0:1788876623.734871:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876623.735093:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.735103:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.735113:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.735117:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.735127:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.735144:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x71:0x0].0x0 (ffff8a13fa77be00) 00010000:00010000:1.0:1788876623.735148:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.735152:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.735159:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae0c5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.735193:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.735195:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.735197:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.735375:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202176 00000100:00100000:3.0:1788876623.735385:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202176 00000100:00100000:3.0:1788876623.735448:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2337 00000100:00100000:3.0:1788876623.735458:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+140:33371:x1875771511202176:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.735479:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.735498:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048760 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735555:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735570:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735581:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.735644:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.735649:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.735666:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735702:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048760 expref: 142 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735718:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048760 expref: 141 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.735725:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:3.0:1788876623.735730:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.735733:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873400, rc 0) 00000100:00100000:1.0:1788876623.736212:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+141:33371:x1875771511202176:12345-192.168.203.11@tcp:101:rm.0 Request processed in 754us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876623.736220:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2337 00000100:00100000:2.0:1788876623.742522:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.742599:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202432 00000100:00100000:3.0:1788876623.742636:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202432 00000100:00100000:3.0:1788876623.742696:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2338 00000100:00100000:3.0:1788876623.742705:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+141:33371:x1875771511202432:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.742762:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.742788:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cac00/0xf5bf0f7e313aab0a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x72:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e22 expref: 141 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742812:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x72:0x0].0x0 (ffff8a13efc7ee00) 00010000:00010000:3.0:1788876623.742826:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313ae0d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048760 expref: 140 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742835:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:3.0:1788876623.742841:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.742862:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742875:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742884:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742894:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe703e79e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742901:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742907:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.742996:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743005:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743017:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.743209:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].97, 64 off14400 00010000:00010000:3.0:1788876623.743268:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743278:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743286:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743293:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743299:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743305:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743338:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.743358:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743364:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743370:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743380:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.743385:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743392:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743401:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x72:0x0].0x0 (ffff8a13c133e600) 00010000:00010000:3.0:1788876623.743404:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.743407:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743413:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae0e8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743429:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743435:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743441:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743446:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.743448:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743454:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743465:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ee00) 00010000:00010000:3.0:1788876623.743468:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.743471:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743476:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313ae0da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.743489:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4a0dadf reply state 0000000069bb1045 transno 68719477367 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743499:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.743505:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe703e79e (ffff8a13c133ed00) 00010000:00010000:3.0:1788876623.743507:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.743509:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876623.743579:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+141:33371:x1875771511202432:12345-192.168.203.11@tcp:36:rm.0 Request processed in 874us (1065us total) trans 68719477367 rc 0/0 00000100:00100000:3.0:1788876623.743587:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2338 00010000:00010000:1.0:1788876623.743832:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.743838:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.743849:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.743852:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.743859:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.743868:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x72:0x0].0x0 (ffff8a13c133e600) 00010000:00010000:1.0:1788876623.743870:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.743873:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.743879:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34c00/0xf5bf0f7e313ae0ef lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.743893:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.743895:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.743897:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.749996:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.750070:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202560 00000100:00100000:3.0:1788876623.750080:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202560 00000100:00100000:3.0:1788876623.750137:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2339 00000100:00100000:3.0:1788876623.750147:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+141:33371:x1875771511202560:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.750170:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.750192:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae0f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048767 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750266:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750289:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750301:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.750346:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.750350:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.750367:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750391:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae0f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048767 expref: 143 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750408:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048767 expref: 142 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.750416:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133e700) 00010000:00010000:3.0:1788876623.750419:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.750422:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34e00, rc 0) 00000100:00100000:3.0:1788876623.750485:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+142:33371:x1875771511202560:12345-192.168.203.11@tcp:101:rm.0 Request processed in 340us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.750492:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2339 00000100:00100000:0.0:1788876623.759459:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.759548:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202816 00000100:00100000:1.0:1788876623.759558:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202816 00000100:00100000:1.0:1788876623.759633:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2340 00000100:00100000:1.0:1788876623.759643:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+142:33371:x1875771511202816:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.759813:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.759839:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed1e00/0xf5bf0f7e313aab2d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e29 expref: 142 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759860:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x73:0x0].0x0 (ffff8a13c4c77700) 00010000:00010000:1.0:1788876623.759875:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313ae0fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048767 expref: 141 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759884:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133e700) 00010000:00010000:1.0:1788876623.759891:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.759915:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759928:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759936:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759949:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759956:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.759963:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760054:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760063:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760070:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.760269:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].97, 64 off14400 00010000:00010000:1.0:1788876623.760871:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760883:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760892:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760900:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760908:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760915:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760940:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.760957:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760964:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760971:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760977:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.760982:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.760990:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761005:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x73:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876623.761008:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.761012:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761018:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae112 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x73:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761034:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761041:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761046:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761052:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.761055:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761061:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761068:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876623.761071:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.761074:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761081:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae104 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.761098:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000293c26a0 reply state 0000000040a080cf transno 68719477368 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761108:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.761115:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde7f3e2c (ffff8a13ff372d00) 00010000:00010000:1.0:1788876623.761117:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.761120:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.761197:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+142:33371:x1875771511202816:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1554us (1745us total) trans 68719477368 rc 0/0 00000100:00100000:1.0:1788876623.761206:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2340 00010000:00010000:3.0:1788876623.762649:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.762659:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.762669:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.762683:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.762694:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.762708:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x73:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:3.0:1788876623.762711:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.762715:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.762720:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae119 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x73:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.762737:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.762739:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.762741:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.766172:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.766316:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511202944 00000100:00100000:2.0:1788876623.766325:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511202944 00000100:00100000:2.0:1788876623.766386:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2341 00000100:00100000:2.0:1788876623.766397:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+142:33371:x1875771511202944:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.766421:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.766444:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704876e expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.766521:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.766536:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.766548:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.766592:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.766596:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.767027:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.767053:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704876e expref: 144 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.767070:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704876e expref: 143 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.767080:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876623.767083:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.767086:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb600, rc 0) 00000100:00100000:2.0:1788876623.767145:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+143:33371:x1875771511202944:12345-192.168.203.11@tcp:101:rm.0 Request processed in 749us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.767152:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2341 00000100:00100000:2.0:1788876623.773728:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.773876:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511203200 00000100:00100000:0.0:1788876623.773886:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511203200 00000100:00100000:0.0:1788876623.773951:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2342 00000100:00100000:0.0:1788876623.773960:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+143:33371:x1875771511203200:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.774016:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.774043:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f41d0c00/0xf5bf0f7e313aab50 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e30 expref: 143 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774062:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x74:0x0].0x0 (ffff8a13c4c77e00) 00010000:00010000:0.0:1788876623.774077:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae127 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704876e expref: 142 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774086:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:0.0:1788876623.774092:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.774115:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774128:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774139:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774151:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6335057 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774159:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774166:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774270:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774289:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774297:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.774519:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].98, 64 off14464 00010000:00010000:0.0:1788876623.774565:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774576:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774585:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774593:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774904:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774914:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774938:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.774958:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774965:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774972:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774978:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.774983:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.774992:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775006:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x74:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:0.0:1788876623.775009:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.775013:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775019:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae13c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x74:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775034:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775041:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775047:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775053:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.775056:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775062:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775069:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:0.0:1788876623.775072:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.775075:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775082:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae12e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.775100:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af96572e reply state 0000000019220ee3 transno 68719477369 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775111:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.775118:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6335057 (ffff8a13fa4ade00) 00010000:00010000:0.0:1788876623.775120:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.775123:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.775198:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+143:33371:x1875771511203200:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1237us (1479us total) trans 68719477369 rc 0/0 00000100:00100000:0.0:1788876623.775208:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2342 00010000:00010000:3.0:1788876623.775379:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.775386:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.775392:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.775397:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.775404:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.775415:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x74:0x0].0x0 (ffff8a13fa4ad400) 00010000:00010000:3.0:1788876623.775417:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.775420:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.775426:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae143 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x74:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.775441:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.775443:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.775444:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.779969:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.780060:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511203328 00000100:00100000:1.0:1788876623.780070:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511203328 00000100:00100000:1.0:1788876623.780129:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2343 00000100:00100000:1.0:1788876623.780140:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+143:33371:x1875771511203328:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876623.780163:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876623.780185:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048775 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.780256:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.780271:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.780924:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876623.780972:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876623.780976:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876623.780994:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.781019:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048775 expref: 145 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.781038:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048775 expref: 144 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.781046:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876623.781049:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876623.781052:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a87e00, rc 0) 00000100:00100000:1.0:1788876623.781116:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+144:33371:x1875771511203328:12345-192.168.203.11@tcp:101:rm.0 Request processed in 977us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876623.781126:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2343 00000100:00100000:2.0:1788876623.786871:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.787173:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511203584 00000100:00100000:0.0:1788876623.787184:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511203584 00000100:00100000:0.0:1788876623.787253:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2344 00000100:00100000:0.0:1788876623.787265:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+144:33371:x1875771511203584:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.787323:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.787350:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415fe00/0xf5bf0f7e313aab73 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e37 expref: 144 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787368:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x75:0x0].0x0 (ffff8a13cff8bb00) 00010000:00010000:0.0:1788876623.787383:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048775 expref: 143 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787393:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:0.0:1788876623.787400:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.787425:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787438:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787447:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787459:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787466:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787472:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787569:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787576:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.787583:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.788567:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].98, 64 off14464 00010000:00010000:2.0:1788876623.788652:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788664:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788732:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788743:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788750:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788757:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788775:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.788795:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788800:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788806:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788810:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.788814:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788821:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788831:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x75:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876623.788834:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.788838:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788843:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae166 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788861:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788867:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788872:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788877:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.788879:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788885:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788892:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:2.0:1788876623.788894:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.788897:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788903:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae158 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.788922:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7334254 reply state 00000000661ecfb5 transno 68719477370 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788932:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.788938:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbe2a6e5 (ffff8a13fa4ad400) 00010000:00010000:2.0:1788876623.788940:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.788942:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788876623.789096:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.789103:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.789109:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876623.789113:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.789120:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.789129:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x75:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:1.0:1788876623.789132:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.789135:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.789141:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae16d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x75:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.789154:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.789156:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.789158:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876623.789195:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+144:33371:x1875771511203584:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1930us (2332us total) trans 68719477370 rc 0/0 00000100:00100000:2.0:1788876623.789204:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2344 00000100:00100000:2.0:1788876623.796905:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.796968:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511203712 00000100:00100000:0.0:1788876623.796983:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511203712 00000100:00100000:0.0:1788876623.797051:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2345 00000100:00100000:0.0:1788876623.797061:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+144:33371:x1875771511203712:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.797389:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.797413:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704877c expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797472:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797486:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797498:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.797539:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.797543:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.797559:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797582:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704877c expref: 146 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797599:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704877c expref: 145 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.797680:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:0.0:1788876623.797683:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.797687:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53c00, rc 0) 00000100:00100000:0.0:1788876623.797749:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+145:33371:x1875771511203712:12345-192.168.203.11@tcp:101:rm.0 Request processed in 690us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.797757:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2345 00000100:00100000:2.0:1788876623.806253:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.806520:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511203968 00000100:00100000:3.0:1788876623.806531:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511203968 00000100:00100000:3.0:1788876623.806596:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2346 00000100:00100000:3.0:1788876623.806637:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+145:33371:x1875771511203968:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876623.806691:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876623.806731:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eff0e800/0xf5bf0f7e313aab96 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e3e expref: 145 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806752:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x76:0x0].0x0 (ffff8a13cff8ba00) 00010000:00010000:3.0:1788876623.806770:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae17b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704877c expref: 144 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806779:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb300) 00010000:00010000:3.0:1788876623.806784:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876623.806809:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806823:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806831:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806842:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806850:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.806857:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807381:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807393:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807401:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876623.807597:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].99, 64 off14528 00010000:00010000:3.0:1788876623.807773:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807783:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807792:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807800:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807807:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807813:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807832:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876623.807849:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807856:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807862:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807868:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.807872:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807879:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.807887:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x76:0x0].0x0 (ffff8a13c133ea00) 00010000:00010000:3.0:1788876623.807890:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876623.807894:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808092:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876623.808099:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808107:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876623.808111:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808118:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808128:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x76:0x0].0x0 (ffff8a13c133ea00) 00010000:00010000:0.0:1788876623.808130:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876623.808132:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808137:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313ae197 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x76:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.808149:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.808151:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876623.808152:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.808236:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae190 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x76:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808258:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808267:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808276:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808281:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.808284:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808289:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808298:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ee00) 00010000:00010000:3.0:1788876623.808361:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.808365:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808371:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae182 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876623.808384:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007877a79e reply state 000000000cc29b74 transno 68719477371 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808395:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.808401:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf9a272a (ffff8a13c133eb00) 00010000:00010000:3.0:1788876623.808403:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876623.808406:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.812245:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+145:33371:x1875771511203968:12345-192.168.203.11@tcp:36:rm.0 Request processed in 5601us (5989us total) trans 68719477371 rc 0/0 00000100:00100000:2.0:1788876623.812258:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2346 00000100:00100000:1.0:1788876623.815747:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.815888:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511204096 00000100:00100000:2.0:1788876623.815897:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511204096 00000100:00100000:2.0:1788876623.815959:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2347 00000100:00100000:2.0:1788876623.815968:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+145:33371:x1875771511204096:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.815991:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.816014:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae19e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048783 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816083:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816103:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816116:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.816166:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.816169:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.816189:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816214:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae19e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048783 expref: 147 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816240:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048783 expref: 146 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.816249:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876623.816253:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.816257:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cbe00, rc 0) 00000100:00100000:2.0:1788876623.816334:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+146:33371:x1875771511204096:12345-192.168.203.11@tcp:101:rm.0 Request processed in 366us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.816342:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2347 00000100:00100000:0.0:1788876623.828808:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.829276:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511204352 00000100:00100000:2.0:1788876623.829288:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511204352 00000100:00100000:2.0:1788876623.829353:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2348 00000100:00100000:2.0:1788876623.829363:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+146:33371:x1875771511204352:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.829423:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.829453:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aabb9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e45 expref: 146 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829472:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x77:0x0].0x0 (ffff8a13ff372300) 00010000:00010000:2.0:1788876623.829495:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae1a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048783 expref: 145 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829504:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876623.829511:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.829538:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829550:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829560:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829573:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829581:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829587:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829741:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829750:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.829757:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.829963:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].99, 64 off14528 00010000:00010000:2.0:1788876623.830014:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830022:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830030:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830036:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830043:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830049:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830076:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.830095:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830101:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830108:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830118:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.830123:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830132:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830141:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x77:0x0].0x0 (ffff8a13cfee7d00) 00010000:00010000:2.0:1788876623.830144:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.830147:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830153:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae1ba lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x77:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830168:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830174:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830180:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830185:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.830188:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830193:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830204:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876623.830206:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.830209:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830213:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae1ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.830234:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f123b70d reply state 00000000697a46de transno 68719477372 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830244:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.830250:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x63e3f2a (ffff8a13fa4ad000) 00010000:00010000:2.0:1788876623.830252:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.830255:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876623.830314:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.830324:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.830337:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.830341:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.830349:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876623.830351:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+146:33371:x1875771511204352:12345-192.168.203.11@tcp:36:rm.0 Request processed in 987us (1549us total) trans 68719477372 rc 0/0 00000100:00100000:2.0:1788876623.830368:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2348 00010000:00010000:3.0:1788876623.830370:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x77:0x0].0x0 (ffff8a13cfee7d00) 00010000:00010000:3.0:1788876623.830374:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.830378:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.830384:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae1c1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x77:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.830400:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.830402:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.830404:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.833184:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.833355:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511204480 00000100:00100000:2.0:1788876623.833365:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511204480 00000100:00100000:2.0:1788876623.833434:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2349 00000100:00100000:2.0:1788876623.833444:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+146:33371:x1875771511204480:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.833466:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.833486:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704878a expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833550:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833564:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833575:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.833646:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.833650:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.833669:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833693:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704878a expref: 148 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833711:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704878a expref: 147 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.833720:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7a00) 00010000:00010000:2.0:1788876623.833723:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.833727:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb000, rc 0) 00000100:00100000:2.0:1788876623.833777:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+147:33371:x1875771511204480:12345-192.168.203.11@tcp:101:rm.0 Request processed in 334us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.833784:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2349 00000100:00100000:0.0:1788876623.837024:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.837280:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511204736 00000100:00100000:1.0:1788876623.837290:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511204736 00000100:00100000:1.0:1788876623.837344:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2350 00000100:00100000:1.0:1788876623.837354:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+147:33371:x1875771511204736:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.837407:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.837434:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313aabdc lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e4c expref: 147 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837699:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x78:0x0].0x0 (ffff8a13ff372a00) 00010000:00010000:1.0:1788876623.837721:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae1cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704878a expref: 146 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837733:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7a00) 00010000:00010000:1.0:1788876623.837740:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.837762:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837776:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837786:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837798:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x248301e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837804:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837811:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837912:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837920:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.837925:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.838144:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].100, 64 off14592 00010000:00010000:1.0:1788876623.838196:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838205:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838213:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838232:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838239:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838245:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838273:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.838293:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838298:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838304:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838311:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.838315:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838322:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838331:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x78:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876623.838333:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.838337:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838343:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae1e4 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x78:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838358:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838366:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838372:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838377:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.838380:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838385:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838393:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876623.838396:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.838397:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876623.838399:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.838406:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838408:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae1d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.838425:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.838430:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.838435:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea71528a reply state 0000000061fa0038 transno 68719477373 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.838437:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.838458:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.838461:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x78:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:3.0:1788876623.838468:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876623.838469:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x248301e8 (ffff8a13ff372100) 00010000:00010000:1.0:1788876623.838474:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.838474:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876623.838479:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876623.838485:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae1eb lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x78:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.838501:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.838503:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.838505:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.838555:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+147:33371:x1875771511204736:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1201us (1538us total) trans 68719477373 rc 0/0 00000100:00100000:1.0:1788876623.838569:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2350 00000100:00100000:1.0:1788876623.842788:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876623.844839:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511204864 00000100:00100000:3.0:1788876623.844855:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511204864 00000100:00100000:3.0:1788876623.844941:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2351 00000100:00100000:3.0:1788876623.844953:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+147:33371:x1875771511204864:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876623.844979:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876623.845002:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae1f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048791 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845083:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845099:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845112:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876623.845154:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876623.845159:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876623.845177:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845204:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae1f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048791 expref: 149 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845234:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048791 expref: 148 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.845244:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ee00) 00010000:00010000:3.0:1788876623.845247:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876623.845251:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35400, rc 0) 00000100:00100000:3.0:1788876623.848006:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+148:33371:x1875771511204864:12345-192.168.203.11@tcp:101:rm.0 Request processed in 653us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876623.848023:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2351 00000100:00100000:3.0:1788876623.850422:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.850510:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511205120 00000100:00100000:0.0:1788876623.850521:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511205120 00000100:00100000:0.0:1788876623.850581:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2352 00000100:00100000:0.0:1788876623.850592:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+148:33371:x1875771511205120:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.850679:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.850709:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d9800/0xf5bf0f7e313aabff lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e53 expref: 148 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850730:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x79:0x0].0x0 (ffff8a13c4c77800) 00010000:00010000:0.0:1788876623.850748:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313ae1f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048791 expref: 147 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850757:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ee00) 00010000:00010000:0.0:1788876623.850763:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.850791:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850805:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850817:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850829:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850835:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850841:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850950:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850958:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.850965:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.851173:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].100, 64 off14592 00010000:00010000:0.0:1788876623.851235:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851245:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851252:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851260:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851266:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851272:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851290:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.851307:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851313:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851318:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851324:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.851329:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851335:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851343:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x79:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:0.0:1788876623.851346:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.851350:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851356:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae20e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851369:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851375:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851381:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851387:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.851389:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851395:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851402:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:0.0:1788876623.851404:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.851407:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851413:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae200 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.851430:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e146751d reply state 000000001d45db07 transno 68719477374 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851441:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.851447:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd91ac688 (ffff8a13ff5bb300) 00010000:00010000:0.0:1788876623.851450:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.851452:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.851525:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+148:33371:x1875771511205120:12345-192.168.203.11@tcp:36:rm.0 Request processed in 934us (1112us total) trans 68719477374 rc 0/0 00000100:00100000:0.0:1788876623.851533:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2352 00010000:00010000:3.0:1788876623.851760:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.851767:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.851774:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.851778:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.851786:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.851796:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x79:0x0].0x0 (ffff8a13ff5bb900) 00010000:00010000:3.0:1788876623.851799:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.851802:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.851813:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae215 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x79:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.851826:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.851828:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.851830:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876623.854775:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.854874:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511205248 00000100:00100000:2.0:1788876623.854885:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511205248 00000100:00100000:2.0:1788876623.854955:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2353 00000100:00100000:2.0:1788876623.854965:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+148:33371:x1875771511205248:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.854989:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.855014:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae21c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048798 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855096:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855110:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855123:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.855168:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.855172:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.855192:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855216:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae21c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048798 expref: 150 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855246:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048798 expref: 149 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.855255:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.855257:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.855261:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5ca600, rc 0) 00000100:00100000:2.0:1788876623.855334:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+149:33371:x1875771511205248:12345-192.168.203.11@tcp:101:rm.0 Request processed in 370us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.855341:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2353 00000100:00100000:1.0:1788876623.859350:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.859440:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511205504 00000100:00100000:2.0:1788876623.859450:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511205504 00000100:00100000:2.0:1788876623.859506:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2354 00000100:00100000:2.0:1788876623.859517:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+149:33371:x1875771511205504:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.859567:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.859593:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed1200/0xf5bf0f7e313aa155 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c2a expref: 149 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859638:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff8a13d9f51300) 00010000:00010000:2.0:1788876623.859656:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae223 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048798 expref: 148 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859665:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.859673:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.859696:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859707:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859718:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859731:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859737:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859742:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859843:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859852:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.859860:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.861289:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].101, 64 off14656 00010000:00010000:2.0:1788876623.861348:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.861363:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.861374:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.861383:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.861390:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.861397:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863481:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.863524:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863541:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863549:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863555:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cba00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.863560:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863567:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863587:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff8a13cfee7100) 00010000:00010000:2.0:1788876623.863593:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.863597:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863635:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae238 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863660:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863667:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863673:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863677:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.863681:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863691:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863699:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.863702:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.863705:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863711:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae22a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.863729:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a71d551a reply state 000000007e2971f7 transno 68719477375 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863741:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.863748:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1133e6 (ffff8a13cfee7f00) 00010000:00010000:2.0:1788876623.863751:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.863753:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.863862:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+149:33371:x1875771511205504:12345-192.168.203.11@tcp:36:rm.0 Request processed in 4342us (4515us total) trans 68719477375 rc 0/0 00000100:00100000:2.0:1788876623.863870:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2354 00010000:00010000:3.0:1788876623.867382:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.867397:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.867410:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.867414:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.867425:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.867444:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff8a13cfee7100) 00010000:00010000:3.0:1788876623.867448:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.867453:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.867459:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae23f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.867778:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.867781:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.867783:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.877499:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.877579:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511205632 00000100:00100000:0.0:1788876623.877589:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511205632 00000100:00100000:0.0:1788876623.877678:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2355 00000100:00100000:0.0:1788876623.877688:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+149:33371:x1875771511205632:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876623.877713:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876623.877739:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704879f expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877814:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877830:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877843:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876623.877893:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876623.877897:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876623.877918:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877944:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704879f expref: 151 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877963:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704879f expref: 150 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.877972:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:0.0:1788876623.877975:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876623.877979:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb10b800, rc 0) 00000100:00100000:0.0:1788876623.878046:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+150:33371:x1875771511205632:12345-192.168.203.11@tcp:101:rm.0 Request processed in 360us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876623.878054:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2355 00000100:00100000:0.0:1788876623.885584:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.885785:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511205888 00000100:00100000:1.0:1788876623.885794:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511205888 00000100:00100000:1.0:1788876623.885854:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2356 00000100:00100000:1.0:1788876623.885864:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+150:33371:x1875771511205888:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.885922:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.885950:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb800/0xf5bf0f7e313aac22 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e5a expref: 150 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.885970:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7a:0x0].0x0 (ffff8a13efc7e400) 00010000:00010000:1.0:1788876623.885987:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae24d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704879f expref: 149 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.885997:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:1.0:1788876623.886003:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.886029:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886042:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886053:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886066:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x13537268 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886074:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886080:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886184:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886193:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886200:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.886413:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].102, 64 off14720 00010000:00010000:1.0:1788876623.886459:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886469:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886477:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886485:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886491:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886498:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886524:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.886539:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886546:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886553:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886559:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.886563:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886571:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886579:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7a:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876623.886582:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.886586:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886592:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae262 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886633:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886640:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886650:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886655:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.886658:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886664:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886672:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876623.886675:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.886678:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886684:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae254 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.886697:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce7160f5 reply state 000000007dfd75b0 transno 68719477376 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886708:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.886714:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x13537268 (ffff8a13ff372a00) 00010000:00010000:1.0:1788876623.886717:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.886719:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.886784:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+150:33371:x1875771511205888:12345-192.168.203.11@tcp:36:rm.0 Request processed in 920us (1210us total) trans 68719477376 rc 0/0 00000100:00100000:1.0:1788876623.886791:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2356 00010000:00010000:3.0:1788876623.887024:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.887032:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.887039:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.887042:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.887106:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.887116:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7a:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:3.0:1788876623.887119:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.887122:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.887128:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae269 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.887143:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.887145:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.887147:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876623.890122:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.890201:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511206016 00000100:00100000:2.0:1788876623.890211:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511206016 00000100:00100000:2.0:1788876623.890278:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2357 00000100:00100000:2.0:1788876623.890292:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+150:33371:x1875771511206016:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.890318:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.890341:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487a6 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890414:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890430:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890444:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.890497:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.890502:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.890524:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890553:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487a6 expref: 152 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890576:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487a6 expref: 151 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.890587:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.890589:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.890593:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cba00, rc 0) 00000100:00100000:2.0:1788876623.890684:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+151:33371:x1875771511206016:12345-192.168.203.11@tcp:101:rm.0 Request processed in 395us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.890695:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2357 00000100:00100000:1.0:1788876623.894352:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.894811:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511206272 00000100:00100000:2.0:1788876623.894821:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511206272 00000100:00100000:2.0:1788876623.894882:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2358 00000100:00100000:2.0:1788876623.894892:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+151:33371:x1875771511206272:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.894948:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.894975:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cbe00/0xf5bf0f7e313aac45 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e61 expref: 151 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.894997:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7b:0x0].0x0 (ffff8a13efc7eb00) 00010000:00010000:2.0:1788876623.895013:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae277 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487a6 expref: 150 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895022:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.895028:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.895052:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895065:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895076:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895088:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe60214dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895346:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895357:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895459:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895468:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.895475:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.896520:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].101, 64 off14656 00010000:00010000:2.0:1788876623.897884:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897913:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897928:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897940:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897946:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897952:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.897975:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.898000:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898006:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898011:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876623.898013:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898019:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898022:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.898029:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898031:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.898038:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898041:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898049:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898057:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7b:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876623.898061:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.898066:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898245:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7b:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876623.898254:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae28c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898260:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.898266:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898273:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae293 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898281:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898289:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898292:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.898295:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.898297:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.898298:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.898305:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.898309:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898316:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898325:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.898328:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.898331:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898338:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae27e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.898353:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026f12a51 reply state 00000000e25c3970 transno 68719477377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898363:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.898370:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe60214dd (ffff8a13cfee7b00) 00010000:00010000:2.0:1788876623.898372:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.898375:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.898479:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+151:33371:x1875771511206272:12345-192.168.203.11@tcp:36:rm.0 Request processed in 3581us (4129us total) trans 68719477377 rc 0/0 00000100:00100000:2.0:1788876623.898487:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2358 00000100:00100000:1.0:1788876623.903978:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.904062:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511206400 00000100:00100000:2.0:1788876623.904071:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511206400 00000100:00100000:2.0:1788876623.904130:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2359 00000100:00100000:2.0:1788876623.904140:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+151:33371:x1875771511206400:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.904163:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.904186:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae29a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487ad expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904266:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904281:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904293:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.904336:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.904340:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.904360:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904383:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae29a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ad expref: 153 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904405:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ad expref: 152 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.904414:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7700) 00010000:00010000:2.0:1788876623.904417:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.904420:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5caa00, rc 0) 00000100:00100000:2.0:1788876623.904488:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+152:33371:x1875771511206400:12345-192.168.203.11@tcp:101:rm.0 Request processed in 349us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.904495:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2359 00000100:00100000:1.0:1788876623.916193:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876623.916292:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511206656 00000100:00100000:0.0:1788876623.916302:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511206656 00000100:00100000:0.0:1788876623.916367:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2360 00000100:00100000:0.0:1788876623.916376:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+152:33371:x1875771511206656:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876623.916433:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876623.916460:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed0400/0xf5bf0f7e313aac68 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e68 expref: 152 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916483:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7c:0x0].0x0 (ffff8a13e7962a00) 00010000:00010000:0.0:1788876623.916502:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ad expref: 151 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916510:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7700) 00010000:00010000:0.0:1788876623.916516:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876623.916543:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916558:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916567:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916580:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916587:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916594:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916737:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916747:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.916755:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788876623.916970:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].103, 64 off14784 00000004:00080000:0.0:1788876623.916979:0:15659:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1611812376254ns, next at 1612812373872ns, rc = 0 00010000:00010000:0.0:1788876623.917023:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917033:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917042:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917050:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917056:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917063:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917090:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876623.917108:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917116:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917123:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917130:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.917135:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917149:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917157:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7c:0x0].0x0 (ffff8a13f35d9500) 00010000:00010000:0.0:1788876623.917160:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876623.917164:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917170:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae2b6 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917186:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917192:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917199:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917204:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876623.917207:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917213:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917230:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb100) 00010000:00010000:0.0:1788876623.917233:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876623.917238:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917248:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae2a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876623.917260:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eefd1bf reply state 000000009cb9951c transno 68719477378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917269:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876623.917274:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d23cb57 (ffff8a13ff5bb900) 00010000:00010000:0.0:1788876623.917276:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876623.917279:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876623.917356:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+152:33371:x1875771511206656:12345-192.168.203.11@tcp:36:rm.0 Request processed in 979us (1170us total) trans 68719477378 rc 0/0 00000100:00100000:0.0:1788876623.917364:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2360 00010000:00010000:3.0:1788876623.917507:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.917514:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.917521:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.917524:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.917531:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.917541:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7c:0x0].0x0 (ffff8a13f35d9500) 00010000:00010000:3.0:1788876623.917544:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.917546:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.917552:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae2bd lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.917566:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.917568:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.917570:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876623.937513:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.937645:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511206784 00000100:00100000:2.0:1788876623.937656:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511206784 00000100:00100000:2.0:1788876623.937715:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2361 00000100:00100000:2.0:1788876623.937726:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+152:33371:x1875771511206784:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.937751:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.937776:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487b4 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937841:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937855:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937867:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.937907:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.937910:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.937928:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937950:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487b4 expref: 154 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937968:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487b4 expref: 153 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.937977:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.937980:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.937983:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5ca400, rc 0) 00000100:00100000:2.0:1788876623.938040:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+153:33371:x1875771511206784:12345-192.168.203.11@tcp:101:rm.0 Request processed in 316us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.938048:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2361 00000100:00100000:1.0:1788876623.941358:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.941455:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207040 00000100:00100000:2.0:1788876623.941467:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207040 00000100:00100000:2.0:1788876623.941531:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2362 00000100:00100000:2.0:1788876623.941541:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+153:33371:x1875771511207040:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.941595:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.941650:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313aac8b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e6f expref: 153 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941671:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7d:0x0].0x0 (ffff8a13efc7e100) 00010000:00010000:2.0:1788876623.941687:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae2cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487b4 expref: 152 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941697:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.941703:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.941727:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941740:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941749:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941763:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941775:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941782:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941872:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941882:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.941889:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.942086:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].102, 64 off14720 00000004:00080000:2.0:1788876623.942094:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1611837491827ns, next at 1612837489432ns, rc = 0 00010000:00010000:2.0:1788876623.942135:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942145:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942153:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942161:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942168:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942179:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942209:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.942236:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942243:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942250:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942257:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.942262:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942271:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942273:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.942283:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942284:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7d:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876623.942290:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.942295:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942297:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876623.942305:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae2e0 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942315:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942323:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942324:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942340:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942346:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7d:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876623.942348:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942351:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.942357:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942358:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.942364:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942370:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae2e7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942374:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942387:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.942390:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876623.942392:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.942394:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.942395:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.942400:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.942405:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae2d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.942419:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023743056 reply state 00000000460fce65 transno 68719477379 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942428:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.942435:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2673cbdb (ffff8a13cfee7700) 00010000:00010000:2.0:1788876623.942437:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.942440:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.944341:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+153:33371:x1875771511207040:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2788us (2981us total) trans 68719477379 rc 0/0 00000100:00100000:2.0:1788876623.944355:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2362 00000100:00100000:3.0:1788876623.951104:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.951276:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207168 00000100:00100000:1.0:1788876623.951286:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207168 00000100:00100000:1.0:1788876623.951342:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2363 00000100:00100000:1.0:1788876623.951353:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+153:33371:x1875771511207168:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876623.951376:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876623.951400:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487bb expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951462:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951477:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951488:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876623.951530:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876623.951533:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876623.951550:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951572:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487bb expref: 155 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951595:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487bb expref: 154 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.951647:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876623.951650:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876623.951653:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c4a86800, rc 0) 00000100:00100000:1.0:1788876623.951719:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+154:33371:x1875771511207168:12345-192.168.203.11@tcp:101:rm.0 Request processed in 367us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876623.951726:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2363 00000100:00100000:3.0:1788876623.963690:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876623.963822:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207424 00000100:00100000:1.0:1788876623.963831:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207424 00000100:00100000:1.0:1788876623.963879:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2364 00000100:00100000:1.0:1788876623.963889:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+154:33371:x1875771511207424:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876623.963939:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876623.963965:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3800/0xf5bf0f7e313aacae lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e76 expref: 154 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.963985:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7e:0x0].0x0 (ffff8a13c66cf200) 00010000:00010000:1.0:1788876623.964001:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae2f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487bb expref: 153 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964010:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372400) 00010000:00010000:1.0:1788876623.964016:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876623.964040:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964059:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964069:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964082:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8524b10d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964089:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964095:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964183:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964192:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964199:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876623.964407:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].104, 64 off14848 00010000:00010000:1.0:1788876623.964451:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964461:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964469:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964477:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964484:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964490:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964516:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876623.964531:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964537:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964543:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964550:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876623.964555:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964563:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964571:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7e:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876623.964574:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876623.964578:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964590:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae30a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964682:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.964699:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964708:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.964712:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964721:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964732:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7e:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:3.0:1788876623.964736:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.964740:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964744:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964749:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae311 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964757:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964765:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.964768:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.964772:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876623.964773:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.964777:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876623.964778:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964786:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964796:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876623.964798:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876623.964801:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964807:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae2fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876623.964820:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdf376b5 reply state 0000000002b1aa7b transno 68719477380 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964830:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876623.964836:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8524b10d (ffff8a13ff372500) 00010000:00010000:1.0:1788876623.964838:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876623.964841:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876623.964915:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+154:33371:x1875771511207424:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1026us (1232us total) trans 68719477380 rc 0/0 00000100:00100000:1.0:1788876623.964923:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2364 00000100:00100000:3.0:1788876623.978872:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.979123:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207552 00000100:00100000:2.0:1788876623.979134:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207552 00000100:00100000:2.0:1788876623.979199:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2365 00000100:00100000:2.0:1788876623.979209:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+154:33371:x1875771511207552:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876623.979243:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876623.979276:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487c2 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979348:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979364:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979375:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876623.979418:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876623.979422:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876623.979440:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979462:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c2 expref: 156 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979480:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c2 expref: 155 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.979489:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.979491:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876623.979495:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb600, rc 0) 00000100:00100000:2.0:1788876623.979559:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+155:33371:x1875771511207552:12345-192.168.203.11@tcp:101:rm.0 Request processed in 352us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876623.979567:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2365 00000100:00100000:3.0:1788876623.984728:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876623.984835:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207808 00000100:00100000:2.0:1788876623.984845:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207808 00000100:00100000:2.0:1788876623.984906:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2366 00000100:00100000:2.0:1788876623.984916:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+155:33371:x1875771511207808:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876623.985140:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876623.985167:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb400/0xf5bf0f7e313aacd1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e7d expref: 155 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985199:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7f:0x0].0x0 (ffff8a13f35d9c00) 00010000:00010000:2.0:1788876623.985216:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae31f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c2 expref: 154 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985236:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876623.985242:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876623.985264:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985278:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985288:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985299:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5714b191 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985384:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985393:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985487:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985496:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985516:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876623.985755:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].103, 64 off14784 00010000:00010000:2.0:1788876623.985802:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985812:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985820:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985827:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985835:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985841:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.985866:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876623.985883:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.986016:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876623.986023:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.986563:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.986570:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.988749:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876623.988761:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.988776:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.988796:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7f:0x0].0x0 (ffff8a13cfee7d00) 00010000:00010000:3.0:1788876623.988799:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876623.988803:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.988810:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae33b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876623.988831:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.988833:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876623.988836:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876623.993349:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.993363:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993379:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993401:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7f:0x0].0x0 (ffff8a13cfee7d00) 00010000:00010000:2.0:1788876623.993405:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876623.993411:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993419:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae334 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993458:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993466:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993478:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993483:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876623.993486:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993491:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993508:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876623.993512:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876623.993515:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993521:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae326 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876623.993536:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e52089f reply state 000000009892fc3e transno 68719477381 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993547:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876623.993556:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5714b191 (ffff8a13cfee7100) 00010000:00010000:2.0:1788876623.993558:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876623.993562:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876623.993693:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+155:33371:x1875771511207808:12345-192.168.203.11@tcp:36:rm.0 Request processed in 8774us (8970us total) trans 68719477381 rc 0/0 00000100:00100000:2.0:1788876623.993702:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2366 00000100:00100000:2.0:1788876624.003465:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876624.003741:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511207936 00000100:00100000:0.0:1788876624.003751:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511207936 00000100:00100000:0.0:1788876624.003833:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2367 00000100:00100000:0.0:1788876624.003844:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+155:33371:x1875771511207936:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876624.003866:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876624.003888:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487c9 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.003963:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788876624.003967:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788876624.003977:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.003994:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876624.004037:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876624.004041:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876624.004061:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.004086:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313ae342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c9 expref: 157 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.004105:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c9 expref: 156 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.004114:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f35d9800) 00010000:00010000:0.0:1788876624.004118:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876624.004122:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53a00, rc 0) 00000100:00100000:0.0:1788876624.004184:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+156:33371:x1875771511207936:12345-192.168.203.11@tcp:101:rm.0 Request processed in 342us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876624.004191:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2367 00000100:00100000:1.0:1788876624.006995:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.007092:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511208192 00000100:00100000:2.0:1788876624.007103:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511208192 00000100:00100000:2.0:1788876624.007162:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2368 00000100:00100000:2.0:1788876624.007173:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+156:33371:x1875771511208192:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.007240:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.007269:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3400/0xf5bf0f7e313aacf4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e84 expref: 156 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007289:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x80:0x0].0x0 (ffff8a13c66cf500) 00010000:00010000:2.0:1788876624.007305:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae349 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487c9 expref: 155 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007315:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f35d9800) 00010000:00010000:2.0:1788876624.007321:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.007346:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007359:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007369:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007382:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd925180b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007388:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007398:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007497:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007506:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007512:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.007760:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].105, 64 off14912 00010000:00010000:2.0:1788876624.007806:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007816:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007824:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007831:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007837:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007843:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007868:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.007885:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007892:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007898:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007903:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.007907:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007914:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007923:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x80:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:2.0:1788876624.007926:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.007930:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007936:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae35e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007951:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007957:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007962:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007967:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.007970:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007975:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007983:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876624.007985:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.007988:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.007994:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae350 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.008006:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f4d6d7b reply state 0000000035bfaa1d transno 68719477382 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.008016:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.008023:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd925180b (ffff8a13cfee7d00) 00010000:00010000:2.0:1788876624.008025:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.008028:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.008103:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+156:33371:x1875771511208192:12345-192.168.203.11@tcp:36:rm.0 Request processed in 930us (1116us total) trans 68719477382 rc 0/0 00000100:00100000:2.0:1788876624.008111:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2368 00010000:00010000:3.0:1788876624.008302:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.008309:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.008315:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.008318:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.008325:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.008334:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x80:0x0].0x0 (ffff8a13cfee7300) 00010000:00010000:3.0:1788876624.008336:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.008339:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.008344:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae365 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x80:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.008358:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.008360:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.008362:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876624.015091:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.015168:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511208320 00000100:00100000:2.0:1788876624.015180:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511208320 00000100:00100000:2.0:1788876624.015250:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2369 00000100:00100000:2.0:1788876624.015261:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+156:33371:x1875771511208320:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.015287:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.015314:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487d0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015377:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015391:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015403:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.015446:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.015449:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.015466:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015489:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d0 expref: 158 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015507:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d0 expref: 157 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.015516:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7a00) 00010000:00010000:2.0:1788876624.015519:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.015523:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb000, rc 0) 00000100:00100000:2.0:1788876624.015588:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+157:33371:x1875771511208320:12345-192.168.203.11@tcp:101:rm.0 Request processed in 329us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.015596:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2369 00000100:00100000:0.0:1788876624.019780:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.019870:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511208576 00000100:00100000:1.0:1788876624.019880:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511208576 00000100:00100000:1.0:1788876624.019935:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2370 00000100:00100000:1.0:1788876624.019956:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+157:33371:x1875771511208576:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876624.020009:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876624.020036:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c2800/0xf5bf0f7e313aad17 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e8b expref: 157 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020056:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x81:0x0].0x0 (ffff8a13c66cf600) 00010000:00010000:1.0:1788876624.020073:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae373 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d0 expref: 156 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020083:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7a00) 00010000:00010000:1.0:1788876624.020090:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876624.020115:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020127:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020137:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020151:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6585166e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020159:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020165:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020276:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020285:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020292:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876624.020503:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].104, 64 off14848 00010000:00010000:1.0:1788876624.020554:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020565:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020573:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020581:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020588:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020596:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020899:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876624.020921:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020929:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020936:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020942:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.020946:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020954:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020965:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x81:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876624.020968:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876624.020972:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020979:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae388 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x81:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.020996:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021002:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021008:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021013:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.021016:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021022:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021030:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.021033:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876624.021036:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021043:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae37a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876624.021057:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b76267a0 reply state 0000000062f3218e transno 68719477383 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021068:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.021074:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6585166e (ffff8a13ff372400) 00010000:00010000:1.0:1788876624.021077:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876624.021079:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876624.021167:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+157:33371:x1875771511208576:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1221us (1393us total) trans 68719477383 rc 0/0 00000100:00100000:1.0:1788876624.021176:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2370 00010000:00010000:3.0:1788876624.023201:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.023217:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.023240:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.023245:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.023257:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.023277:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x81:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:3.0:1788876624.023280:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.023284:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.023291:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae38f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x81:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.023314:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.023316:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.023318:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.028231:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.028318:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511208704 00000100:00100000:2.0:1788876624.028329:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511208704 00000100:00100000:2.0:1788876624.028389:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2371 00000100:00100000:2.0:1788876624.028400:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+157:33371:x1875771511208704:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.028423:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.028446:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487d7 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028511:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028527:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028541:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.028583:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.028586:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.028645:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028671:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d7 expref: 159 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028688:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d7 expref: 158 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.028696:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876624.028699:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.028703:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fa5cb400, rc 0) 00000100:00100000:2.0:1788876624.028752:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+158:33371:x1875771511208704:12345-192.168.203.11@tcp:101:rm.0 Request processed in 355us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.028759:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2371 00000100:00100000:0.0:1788876624.039919:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.040020:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511208960 00000100:00100000:2.0:1788876624.040029:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511208960 00000100:00100000:2.0:1788876624.040095:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2372 00000100:00100000:2.0:1788876624.040104:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+158:33371:x1875771511208960:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.040154:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.040179:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1402045000/0xf5bf0f7e313aad3a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e92 expref: 158 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040198:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x82:0x0].0x0 (ffff8a13f4518b00) 00010000:00010000:2.0:1788876624.040214:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae39d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487d7 expref: 157 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040235:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876624.040240:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.040264:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040277:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040287:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040298:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040310:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040316:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040428:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040437:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040444:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.040684:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].106, 64 off14976 00010000:00010000:2.0:1788876624.040734:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040744:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040753:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040761:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040768:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040775:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040808:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.040827:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040834:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040840:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040846:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.040850:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040857:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040866:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x82:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876624.040868:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.040871:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040877:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3b2 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x82:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040890:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040896:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040905:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040909:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.040911:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040917:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040925:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7a00) 00010000:00010000:2.0:1788876624.040927:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.040930:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040936:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.040947:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e9a837c reply state 00000000942121e4 transno 68719477384 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040958:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.040964:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbc48c9f (ffff8a13cfee7300) 00010000:00010000:2.0:1788876624.040966:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.040969:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.041039:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+158:33371:x1875771511208960:12345-192.168.203.11@tcp:36:rm.0 Request processed in 935us (1129us total) trans 68719477384 rc 0/0 00000100:00100000:2.0:1788876624.041046:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2372 00010000:00010000:3.0:1788876624.041191:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.041201:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.041207:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.041211:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.041217:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.041238:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x82:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:3.0:1788876624.041240:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.041244:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.041249:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3b9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x82:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.041263:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.041266:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.041268:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876624.044710:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.044801:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511209088 00000100:00100000:2.0:1788876624.044810:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511209088 00000100:00100000:2.0:1788876624.044868:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2373 00000100:00100000:2.0:1788876624.044878:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+158:33371:x1875771511209088:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.044903:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.044938:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487de expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045007:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045020:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045032:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.045086:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.045090:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.045108:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045132:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487de expref: 160 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045151:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487de expref: 159 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.045160:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876624.045163:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.045168:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c86b0400, rc 0) 00000100:00100000:2.0:1788876624.045215:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+159:33371:x1875771511209088:12345-192.168.203.11@tcp:101:rm.0 Request processed in 339us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.045234:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2373 00000100:00100000:1.0:1788876624.063460:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.063563:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511209344 00000100:00100000:2.0:1788876624.063574:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511209344 00000100:00100000:2.0:1788876624.063659:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2374 00000100:00100000:2.0:1788876624.063671:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+159:33371:x1875771511209344:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.063722:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.063747:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d8400/0xf5bf0f7e313aad5d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047e99 expref: 159 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063768:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x83:0x0].0x0 (ffff8a13c66cfd00) 00010000:00010000:2.0:1788876624.063783:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae3c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487de expref: 158 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063792:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876624.063797:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.063818:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063830:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063840:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063852:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063863:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063869:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063965:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063974:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.063981:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.064175:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].105, 64 off14912 00010000:00010000:2.0:1788876624.064230:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064240:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064247:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064255:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064261:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064267:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064290:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.064307:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064313:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064319:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064325:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.064329:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064336:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064344:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x83:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876624.064347:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.064350:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064356:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3dc lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x83:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064370:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064376:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064386:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064390:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.064393:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064398:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064404:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876624.064407:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.064409:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064415:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae3ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.064426:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9f35289 reply state 000000003af63275 transno 68719477385 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064435:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.064441:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77f95b4c (ffff8a13cfee7a00) 00010000:00010000:2.0:1788876624.064443:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.064445:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.064522:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+159:33371:x1875771511209344:12345-192.168.203.11@tcp:36:rm.0 Request processed in 852us (1070us total) trans 68719477385 rc 0/0 00000100:00100000:2.0:1788876624.064529:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2374 00010000:00010000:3.0:1788876624.064632:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.064639:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.064645:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.064649:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.064656:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.064665:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x83:0x0].0x0 (ffff8a13cfee7600) 00010000:00010000:3.0:1788876624.064668:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.064670:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.064675:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae3e3 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x83:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.064687:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.064689:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.064690:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876624.076876:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.076970:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511209472 00000100:00100000:1.0:1788876624.076979:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511209472 00000100:00100000:1.0:1788876624.077044:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2375 00000100:00100000:1.0:1788876624.077055:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+159:33371:x1875771511209472:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876624.077078:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876624.077101:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae3ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487e5 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077163:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077179:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077190:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876624.077242:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876624.077246:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876624.077263:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077288:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae3ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487e5 expref: 161 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077306:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487e5 expref: 160 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.077321:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.077324:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876624.077327:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c000, rc 0) 00000100:00100000:1.0:1788876624.077392:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+160:33371:x1875771511209472:12345-192.168.203.11@tcp:101:rm.0 Request processed in 339us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.077399:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2375 00000100:00100000:1.0:1788876624.089901:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.090039:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511209728 00000100:00100000:2.0:1788876624.090048:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511209728 00000100:00100000:2.0:1788876624.090110:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2376 00000100:00100000:2.0:1788876624.090121:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+160:33371:x1875771511209728:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.090179:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.090205:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c29d8200/0xf5bf0f7e313aa171 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047c31 expref: 160 pid: 6545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090236:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff8a13d9f51500) 00010000:00010000:2.0:1788876624.090252:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae3f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487e5 expref: 159 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090261:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:2.0:1788876624.090267:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.090290:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090303:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090313:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090325:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090332:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090339:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090433:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090441:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090448:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.090694:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].106, 64 off14976 00010000:00010000:2.0:1788876624.090739:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090749:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090758:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090766:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090773:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090779:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090802:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.090818:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090827:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090833:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090839:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.090844:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090852:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090860:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:2.0:1788876624.090863:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.090867:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090873:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae406 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090888:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090894:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090900:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090905:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.090908:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090915:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.090923:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876624.090925:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.090928:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091074:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.091081:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091088:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.091091:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091098:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091107:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff8a13fae83100) 00010000:00010000:3.0:1788876624.091110:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.091113:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091118:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae40d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.091131:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.091133:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.091135:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876624.091165:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae3f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.091180:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a489359 reply state 00000000cde971c7 transno 68719477386 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.091191:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.091199:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x737b65d2 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876624.091201:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.091204:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.091288:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+160:33371:x1875771511209728:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1168us (1395us total) trans 68719477386 rc 0/0 00000100:00100000:2.0:1788876624.091297:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2376 00000100:00100000:3.0:1788876624.100007:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876624.100100:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511209856 00000100:00100000:0.0:1788876624.100110:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511209856 00000100:00100000:0.0:1788876624.100169:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2377 00000100:00100000:0.0:1788876624.100184:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+160:33371:x1875771511209856:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876624.100208:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876624.100243:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae414 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487ec expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100310:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100324:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100336:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876624.100391:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876624.100396:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876624.100415:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100440:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b200/0xf5bf0f7e313ae414 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ec expref: 162 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100458:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ec expref: 161 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.100467:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f35d9e00) 00010000:00010000:0.0:1788876624.100470:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876624.100474:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53a00, rc 0) 00000100:00100000:0.0:1788876624.100539:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+161:33371:x1875771511209856:12345-192.168.203.11@tcp:101:rm.0 Request processed in 357us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876624.100547:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2377 00000100:00100000:0.0:1788876624.106787:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.106879:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511210112 00000100:00100000:2.0:1788876624.106889:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511210112 00000100:00100000:2.0:1788876624.106950:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2378 00000100:00100000:2.0:1788876624.106960:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+161:33371:x1875771511210112:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.107015:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.107045:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfed1a00/0xf5bf0f7e313aad80 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ea0 expref: 161 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107072:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x84:0x0].0x0 (ffff8a13c4c77a00) 00010000:00010000:2.0:1788876624.107091:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53a00/0xf5bf0f7e313ae41b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487ec expref: 160 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107100:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f35d9e00) 00010000:00010000:2.0:1788876624.107106:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.107131:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107144:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107154:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107166:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1bda453 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107173:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107179:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107292:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107301:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107308:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.107552:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].107, 64 off15040 00010000:00010000:2.0:1788876624.107656:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107667:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107675:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107682:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107688:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107694:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107718:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.107738:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107744:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107751:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107761:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.107767:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107777:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107786:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x84:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:2.0:1788876624.107789:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.107793:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107800:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae430 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x84:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107817:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107825:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107831:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107837:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.107841:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107847:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107858:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83300) 00010000:00010000:2.0:1788876624.107860:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.107863:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107868:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae422 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.107881:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d950ed5 reply state 000000005a946885 transno 68719477387 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107892:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.107900:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1bda453 (ffff8a13fae83100) 00010000:00010000:2.0:1788876624.107902:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.107905:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.107986:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+161:33371:x1875771511210112:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1025us (1207us total) trans 68719477387 rc 0/0 00000100:00100000:2.0:1788876624.107994:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2378 00010000:00010000:3.0:1788876624.108327:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.108335:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.108342:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.108345:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.108353:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.108363:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x84:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:3.0:1788876624.108365:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.108367:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.108372:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae437 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x84:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.108388:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.108390:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.108392:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876624.111211:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.111302:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511210240 00000100:00100000:1.0:1788876624.111311:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511210240 00000100:00100000:1.0:1788876624.111370:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2379 00000100:00100000:1.0:1788876624.111380:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+161:33371:x1875771511210240:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876624.111403:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876624.111426:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae43e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487f3 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111496:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111513:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111526:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876624.111571:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876624.111575:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876624.111593:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111655:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae43e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487f3 expref: 163 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111672:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487f3 expref: 162 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.111682:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.111685:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876624.111688:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:1.0:1788876624.111745:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+162:33371:x1875771511210240:12345-192.168.203.11@tcp:101:rm.0 Request processed in 366us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.111753:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2379 00000100:00100000:3.0:1788876624.115333:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.115410:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511210496 00000100:00100000:1.0:1788876624.115421:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511210496 00000100:00100000:1.0:1788876624.115488:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2380 00000100:00100000:1.0:1788876624.115500:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+162:33371:x1875771511210496:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876624.115565:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876624.115597:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa786a00/0xf5bf0f7e313aada3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ea7 expref: 162 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115660:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x85:0x0].0x0 (ffff8a13f4518a00) 00010000:00010000:1.0:1788876624.115677:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae445 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487f3 expref: 161 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115687:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.115694:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876624.115720:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115733:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115741:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115753:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115760:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115767:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115869:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115878:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.115885:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876624.116131:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].107, 64 off15040 00010000:00010000:1.0:1788876624.116180:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116191:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116203:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116211:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116217:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116235:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116252:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876624.116270:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116276:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116283:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116289:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.116294:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116301:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116309:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x85:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.116312:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876624.116316:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116322:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86600/0xf5bf0f7e313ae45a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116338:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116345:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116350:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116356:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.116358:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116365:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116373:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876624.116376:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876624.116378:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116384:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae44c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876624.116397:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c84e29e reply state 00000000cd9dd865 transno 68719477388 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116413:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.116419:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1a07d3eb (ffff8a13ff372300) 00010000:00010000:1.0:1788876624.116422:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876624.116424:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876624.116502:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+162:33371:x1875771511210496:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1004us (1177us total) trans 68719477388 rc 0/0 00000100:00100000:1.0:1788876624.116510:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2380 00010000:00010000:3.0:1788876624.117188:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.117196:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.117204:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.117207:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.117215:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.117238:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x85:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:3.0:1788876624.117240:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.117244:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.117250:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87200/0xf5bf0f7e313ae461 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x85:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.117266:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.117268:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.117270:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876624.123356:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.126843:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511210624 00000100:00100000:1.0:1788876624.126859:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511210624 00000100:00100000:1.0:1788876624.126941:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2381 00000100:00100000:1.0:1788876624.126953:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+162:33371:x1875771511210624:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876624.126979:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876624.127001:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370487fa expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127072:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127085:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127096:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876624.127139:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876624.127142:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876624.127160:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127183:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86800/0xf5bf0f7e313ae468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487fa expref: 164 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127198:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487fa expref: 163 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.127206:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:1.0:1788876624.127208:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876624.127211:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c800, rc 0) 00000100:00100000:1.0:1788876624.127290:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+163:33371:x1875771511210624:12345-192.168.203.11@tcp:101:rm.0 Request processed in 339us (3942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.127298:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2381 00000100:00100000:0.0:1788876624.130206:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.130315:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511210880 00000100:00100000:2.0:1788876624.130327:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511210880 00000100:00100000:2.0:1788876624.130389:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2382 00000100:00100000:2.0:1788876624.130403:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+163:33371:x1875771511210880:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.130464:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.130493:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca800/0xf5bf0f7e313aadc6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047eae expref: 163 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130520:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x86:0x0].0x0 (ffff8a13f4518300) 00010000:00010000:2.0:1788876624.130536:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae46f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370487fa expref: 162 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130545:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372200) 00010000:00010000:2.0:1788876624.130552:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.130581:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130593:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130636:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130651:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130660:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130666:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130762:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130771:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.130781:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.130988:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].108, 64 off15104 00010000:00010000:2.0:1788876624.131036:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131046:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131053:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131060:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131066:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131072:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131094:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.131112:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131118:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131124:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131133:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.131137:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131145:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131153:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x86:0x0].0x0 (ffff8a13c2caf400) 00010000:00010000:2.0:1788876624.131156:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.131159:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131165:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae484 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x86:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131177:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876624.131179:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131183:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131185:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131191:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131195:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876624.131196:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876624.131198:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131199:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131205:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131206:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131214:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x86:0x0].0x0 (ffff8a13c2caf400) 00010000:00010000:2.0:1788876624.131216:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfee7900) 00010000:00010000:3.0:1788876624.131217:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876624.131227:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.131230:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131230:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131236:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313ae48b lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x86:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131237:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae476 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.131249:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb0c6706 reply state 00000000a01c3ce6 transno 68719477389 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.131250:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.131251:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.131253:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876624.131259:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.131266:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9395fd43 (ffff8a13fae83300) 00010000:00010000:2.0:1788876624.131268:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.131271:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.131347:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+163:33371:x1875771511210880:12345-192.168.203.11@tcp:36:rm.0 Request processed in 948us (1150us total) trans 68719477389 rc 0/0 00000100:00100000:2.0:1788876624.131355:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2382 00000100:00100000:3.0:1788876624.135200:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.135258:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511211008 00000100:00100000:2.0:1788876624.135268:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511211008 00000100:00100000:2.0:1788876624.135337:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2383 00000100:00100000:2.0:1788876624.135347:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+163:33371:x1875771511211008:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.135376:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.135398:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ae492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048801 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135476:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135493:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135504:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.135560:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.135564:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.135582:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135640:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313ae492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048801 expref: 165 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135659:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048801 expref: 164 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.135667:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf600) 00010000:00010000:2.0:1788876624.135670:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.135673:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c0031c00, rc 0) 00000100:00100000:2.0:1788876624.135724:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+164:33371:x1875771511211008:12345-192.168.203.11@tcp:101:rm.0 Request processed in 374us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.135735:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2383 00000100:00100000:3.0:1788876624.139257:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.139649:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511211264 00000100:00100000:2.0:1788876624.139659:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511211264 00000100:00100000:2.0:1788876624.139722:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2384 00000100:00100000:2.0:1788876624.139733:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+164:33371:x1875771511211264:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.139790:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.139820:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587a00/0xf5bf0f7e313aade9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047eb5 expref: 164 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.139844:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x87:0x0].0x0 (ffff8a13c3e1af00) 00010000:00010000:2.0:1788876624.139863:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048801 expref: 163 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148313:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf600) 00010000:00010000:2.0:1788876624.148346:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.148386:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148405:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148417:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148430:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148435:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148440:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148540:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148549:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148557:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.148772:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].108, 64 off15104 00010000:00010000:2.0:1788876624.148820:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148830:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148838:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148845:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148851:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148858:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148887:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.148909:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148916:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148923:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148932:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.148937:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148944:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148955:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x87:0x0].0x0 (ffff8a13c2caf100) 00010000:00010000:2.0:1788876624.148957:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.148961:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148966:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ae lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x87:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148983:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148989:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.148995:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149000:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.149002:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149007:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149018:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf800) 00010000:00010000:2.0:1788876624.149020:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.149023:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149028:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149038:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:2.0:1788876624.149040:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037d67378 reply state 0000000099b83184 transno 68719477390 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149044:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149050:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149050:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0030a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.149054:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.149057:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9e7acbf1 (ffff8a13c2caf500) 00010000:00010000:2.0:1788876624.149059:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.149061:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876624.149070:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149082:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x87:0x0].0x0 (ffff8a13c2caf100) 00010000:00010000:3.0:1788876624.149084:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.149086:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149091:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae4b5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x87:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.149104:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.149106:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.149107:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876624.149154:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+164:33371:x1875771511211264:12345-192.168.203.11@tcp:36:rm.0 Request processed in 9418us (9900us total) trans 68719477390 rc 0/0 00000100:00100000:2.0:1788876624.149163:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2384 00000100:00100000:0.0:1788876624.151576:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.151685:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511211392 00000100:00100000:1.0:1788876624.151694:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511211392 00000100:00100000:1.0:1788876624.151748:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2385 00000100:00100000:1.0:1788876624.151757:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+164:33371:x1875771511211392:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876624.151780:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876624.151803:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae4bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048808 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.151864:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.151876:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.151887:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876624.151928:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876624.151932:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876624.151953:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.151976:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae4bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048808 expref: 166 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.151995:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048808 expref: 165 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.152002:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876624.152005:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876624.152008:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:1.0:1788876624.152069:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+165:33371:x1875771511211392:12345-192.168.203.11@tcp:101:rm.0 Request processed in 313us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.152075:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2385 00000100:00100000:3.0:1788876624.154855:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.154903:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511211648 00000100:00100000:1.0:1788876624.154912:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511211648 00000100:00100000:1.0:1788876624.154972:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2386 00000100:00100000:1.0:1788876624.154982:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+165:33371:x1875771511211648:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876624.155036:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876624.155063:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10a00/0xf5bf0f7e313aae0c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ebc expref: 165 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155083:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x88:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876624.155099:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae4c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048808 expref: 164 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155107:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372800) 00010000:00010000:1.0:1788876624.155113:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876624.155136:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155148:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155157:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155169:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155176:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155183:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155288:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155296:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.155315:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876624.155549:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].109, 64 off15168 00010000:00010000:1.0:1788876624.156021:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156033:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156041:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156049:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156056:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156062:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156084:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876624.156103:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156110:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156116:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156121:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.156126:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156134:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156145:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x88:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.156148:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876624.156151:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156157:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae4d8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x88:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156174:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156180:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156186:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156191:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.156193:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156199:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156207:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.156209:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876624.156212:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156228:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae4ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876624.156246:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f862f021 reply state 0000000041c70aa8 transno 68719477391 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156257:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.156264:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf7427f1 (ffff8a13ff372200) 00010000:00010000:1.0:1788876624.156266:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876624.156269:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876624.158575:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.158590:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.158620:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.158625:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.158637:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.158656:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x88:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:3.0:1788876624.158660:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.158665:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.158670:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4df lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x88:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.158696:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.158698:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.158700:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.158776:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+165:33371:x1875771511211648:12345-192.168.203.11@tcp:36:rm.0 Request processed in 3790us (3923us total) trans 68719477391 rc 0/0 00000100:00100000:1.0:1788876624.158786:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2386 00000100:00100000:3.0:1788876624.168639:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.168703:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511211776 00000100:00100000:2.0:1788876624.168712:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511211776 00000100:00100000:2.0:1788876624.168772:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2387 00000100:00100000:2.0:1788876624.168782:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+165:33371:x1875771511211776:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.168807:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.168829:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704880f expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.168896:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.168912:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.168924:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.168966:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.168970:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.168988:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.169010:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae4e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704880f expref: 167 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.169031:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704880f expref: 166 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.169040:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf800) 00010000:00010000:2.0:1788876624.169043:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.169047:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c0031e00, rc 0) 00000100:00100000:2.0:1788876624.169107:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+166:33371:x1875771511211776:12345-192.168.203.11@tcp:101:rm.0 Request processed in 327us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.169114:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2387 00000100:00100000:0.0:1788876624.178504:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.178619:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212032 00000100:00100000:1.0:1788876624.178629:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212032 00000100:00100000:1.0:1788876624.178693:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2388 00000100:00100000:1.0:1788876624.178703:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+166:33371:x1875771511212032:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876624.178756:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876624.178783:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa4c3000/0xf5bf0f7e313aae2f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ec3 expref: 166 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178806:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x89:0x0].0x0 (ffff8a13ca177500) 00010000:00010000:1.0:1788876624.178823:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae4ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704880f expref: 165 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178834:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf800) 00010000:00010000:1.0:1788876624.178840:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876624.178866:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178880:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178890:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178903:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178910:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.178917:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179015:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179024:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179030:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876624.179245:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].109, 64 off15168 00010000:00010000:1.0:1788876624.179296:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179306:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179315:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179323:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179330:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179336:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179361:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876624.179378:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179385:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179392:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179399:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.179404:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179413:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179422:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x89:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.179425:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876624.179428:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179438:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313ae502 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x89:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179453:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179460:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179465:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179470:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.179472:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179478:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179485:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.179487:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876624.179490:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179492:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876624.179495:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae4f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179499:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179504:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c800 already unused, calling callback (ffffffffc0cf24f0) 00000004:00010000:1.0:1788876624.179508:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a67f46b1 reply state 0000000049a4028c transno 68719477392 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179508:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179515:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.179518:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179523:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x89:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.179525:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1a469f (ffff8a13ff372800) 00010000:00010000:3.0:1788876624.179525:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876624.179527:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876624.179528:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876624.179530:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876624.179534:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae509 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x89:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.179547:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.179549:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.179550:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.179638:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+166:33371:x1875771511212032:12345-192.168.203.11@tcp:36:rm.0 Request processed in 936us (1142us total) trans 68719477392 rc 0/0 00000100:00100000:1.0:1788876624.179646:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2388 00000100:00100000:3.0:1788876624.188176:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.188335:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212160 00000100:00100000:1.0:1788876624.188345:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212160 00000100:00100000:1.0:1788876624.188410:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2389 00000100:00100000:1.0:1788876624.188421:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+166:33371:x1875771511212160:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876624.188445:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876624.188468:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae510 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048816 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188535:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188550:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188562:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876624.188643:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876624.188647:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876624.188667:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188691:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae510 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048816 expref: 168 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188709:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048816 expref: 167 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.188717:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.188720:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876624.188723:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:1.0:1788876624.189117:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+167:33371:x1875771511212160:12345-192.168.203.11@tcp:101:rm.0 Request processed in 357us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.189125:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2389 00000100:00100000:1.0:1788876624.198349:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.198460:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212416 00000100:00100000:2.0:1788876624.198470:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212416 00000100:00100000:2.0:1788876624.198527:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2390 00000100:00100000:2.0:1788876624.198537:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+167:33371:x1875771511212416:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.198592:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.198638:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aae52 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047eca expref: 167 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198658:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8a:0x0].0x0 (ffff8a13ff372c00) 00010000:00010000:2.0:1788876624.198675:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae517 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048816 expref: 166 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198685:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:2.0:1788876624.198690:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.198713:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198725:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198735:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198748:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198754:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198760:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198855:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198863:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.198871:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.199084:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].110, 64 off15232 00010000:00010000:2.0:1788876624.199131:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199141:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199149:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199156:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199162:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199168:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199194:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.199212:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199229:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199235:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199245:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.199249:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199261:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199272:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8a:0x0].0x0 (ffff8a13c2caf300) 00010000:00010000:2.0:1788876624.199275:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.199278:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199283:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae52c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199303:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199309:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199315:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199319:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.199321:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199327:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199337:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf600) 00010000:00010000:2.0:1788876624.199339:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.199342:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199347:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae51e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.199359:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7cf547e reply state 00000000bdd29318 transno 68719477393 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199369:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.199375:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ce5b4ef (ffff8a13c2cafe00) 00010000:00010000:2.0:1788876624.199377:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.199379:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.199452:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+167:33371:x1875771511212416:12345-192.168.203.11@tcp:36:rm.0 Request processed in 915us (1110us total) trans 68719477393 rc 0/0 00000100:00100000:2.0:1788876624.199460:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2390 00010000:00010000:3.0:1788876624.199567:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.199575:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.199586:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.199590:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.199597:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.199629:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8a:0x0].0x0 (ffff8a13c2caf300) 00010000:00010000:3.0:1788876624.199632:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.199635:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.199641:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae533 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.199659:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.199660:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.199662:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876624.210796:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876624.210883:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212544 00000100:00100000:3.0:1788876624.210893:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212544 00000100:00100000:3.0:1788876624.210955:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2391 00000100:00100000:3.0:1788876624.210965:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+167:33371:x1875771511212544:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876624.210989:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876624.211011:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae53a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704881d expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211084:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211103:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211115:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876624.211156:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876624.211160:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876624.211177:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211200:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae53a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704881d expref: 169 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211229:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704881d expref: 168 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.211238:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ea00) 00010000:00010000:3.0:1788876624.211241:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876624.211245:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34400, rc 0) 00000100:00100000:3.0:1788876624.211700:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+168:33371:x1875771511212544:12345-192.168.203.11@tcp:101:rm.0 Request processed in 735us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876624.211708:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2391 00000100:00100000:0.0:1788876624.219714:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876624.221417:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212800 00000100:00100000:1.0:1788876624.221434:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212800 00000100:00100000:1.0:1788876624.221502:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2392 00000100:00100000:1.0:1788876624.221513:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+168:33371:x1875771511212800:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876624.221566:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788876624.221591:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b11800/0xf5bf0f7e313aae75 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x8b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ed1 expref: 168 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221648:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8b:0x0].0x0 (ffff8a13f4518d00) 00010000:00010000:1.0:1788876624.221666:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313ae541 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704881d expref: 167 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221676:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133ea00) 00010000:00010000:1.0:1788876624.221682:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876624.221707:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221722:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221732:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221745:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221752:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221758:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221854:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221863:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.221870:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788876624.222271:0:6541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].110, 64 off15232 00010000:00010000:1.0:1788876624.222320:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222332:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222340:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222348:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222354:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222361:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222386:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876624.222403:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222410:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222417:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222422:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.222427:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222435:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222444:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8b:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:1.0:1788876624.222447:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876624.222451:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222461:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c400/0xf5bf0f7e313ae556 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x8b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222476:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222482:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222489:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222493:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876624.222496:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222503:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222510:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff372700) 00010000:00010000:1.0:1788876624.222513:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876624.222515:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222521:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c800/0xf5bf0f7e313ae548 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876624.222534:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096810a65 reply state 000000004db093ae transno 68719477394 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222546:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876624.222553:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6d15b7c (ffff8a13ff372c00) 00010000:00010000:1.0:1788876624.222555:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876624.222558:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788876624.222726:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876624.222733:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.222740:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876624.222743:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.222751:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.222760:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8b:0x0].0x0 (ffff8a13ff372b00) 00010000:00010000:3.0:1788876624.222761:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876624.222764:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.222769:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313ae55d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x8b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.222782:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.222783:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876624.222785:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.223010:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+168:33371:x1875771511212800:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1497us (3303us total) trans 68719477394 rc 0/0 00000100:00100000:1.0:1788876624.223018:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2392 00000100:00100000:1.0:1788876624.230876:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.231088:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511212928 00000100:00100000:2.0:1788876624.231100:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511212928 00000100:00100000:2.0:1788876624.231161:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2393 00000100:00100000:2.0:1788876624.231171:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+168:33371:x1875771511212928:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.231194:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.231227:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048824 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231294:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231310:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231321:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.231363:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.231367:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.231386:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231410:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048824 expref: 170 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231428:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048824 expref: 169 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.231437:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf600) 00010000:00010000:2.0:1788876624.231439:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.231443:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c0031400, rc 0) 00000100:00100000:2.0:1788876624.231666:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+169:33371:x1875771511212928:12345-192.168.203.11@tcp:101:rm.0 Request processed in 494us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.231674:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2393 00000100:00100000:2.0:1788876624.244841:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876624.244922:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213184 00000100:00100000:3.0:1788876624.244943:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213184 00000100:00100000:3.0:1788876624.245003:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2394 00000100:00100000:3.0:1788876624.245016:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+169:33371:x1875771511213184:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876624.245084:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876624.245111:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586a00/0xf5bf0f7e313aae98 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ed8 expref: 169 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245130:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8c:0x0].0x0 (ffff8a13efd0c100) 00010000:00010000:3.0:1788876624.245146:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031400/0xf5bf0f7e313ae56b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048824 expref: 168 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245156:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf600) 00010000:00010000:3.0:1788876624.245162:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876624.245183:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245196:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245205:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245226:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245235:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245242:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245330:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245339:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245346:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788876624.245546:0:15659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x40:0x0].111, 64 off15296 00010000:00010000:3.0:1788876624.245590:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245629:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245643:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245650:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245657:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245663:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245848:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876624.245867:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245874:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245881:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245886:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876624.245890:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245898:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245908:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8c:0x0].0x0 (ffff8a13c133ec00) 00010000:00010000:3.0:1788876624.245911:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876624.245915:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.245920:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313ae580 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246046:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246108:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246116:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246122:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876624.246125:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246132:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246140:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133e900) 00010000:00010000:3.0:1788876624.246143:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876624.246146:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246153:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313ae572 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876624.246168:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7b350d5 reply state 00000000b3ea190a transno 68719477395 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246184:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876624.246190:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1c3d982 (ffff8a13c133e200) 00010000:00010000:3.0:1788876624.246192:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876624.246195:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876624.246330:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+169:33371:x1875771511213184:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1313us (1497us total) trans 68719477395 rc 0/0 00000100:00100000:3.0:1788876624.246338:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2394 00010000:00010000:0.0:1788876624.248174:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876624.248189:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.248200:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876624.248205:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.248215:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.248242:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8c:0x0].0x0 (ffff8a13c133ec00) 00010000:00010000:0.0:1788876624.248245:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876624.248250:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.248257:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae587 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.248280:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876624.248282:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876624.248284:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.253987:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.254180:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213312 00000100:00100000:2.0:1788876624.254190:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213312 00000100:00100000:2.0:1788876624.254267:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2395 00000100:00100000:2.0:1788876624.254278:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+169:33371:x1875771511213312:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876624.254308:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876624.254333:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae58e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704882b expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254399:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254415:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254426:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876624.254476:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876624.254480:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876624.254500:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254527:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031800/0xf5bf0f7e313ae58e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704882b expref: 171 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254547:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704882b expref: 170 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.254556:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf000) 00010000:00010000:2.0:1788876624.254559:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876624.254563:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c0031200, rc 0) 00000100:00100000:2.0:1788876624.254667:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+170:33371:x1875771511213312:12345-192.168.203.11@tcp:101:rm.0 Request processed in 390us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876624.254675:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2395 00000100:00100000:0.0:1788876624.257654:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876624.257774:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213568 00000100:00100000:2.0:1788876624.257784:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213568 00000100:00100000:2.0:1788876624.257844:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2396 00000100:00100000:2.0:1788876624.257854:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+170:33371:x1875771511213568:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876624.257909:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876624.257946:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b10c00/0xf5bf0f7e313aaebb lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047edf expref: 170 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.257967:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8d:0x0].0x0 (ffff8a13f4518900) 00010000:00010000:2.0:1788876624.257983:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031200/0xf5bf0f7e313ae595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704882b expref: 169 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.257996:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf000) 00010000:00010000:2.0:1788876624.258001:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876624.258026:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258038:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258047:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258059:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258078:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258085:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258184:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258193:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258199:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788876624.258423:0:8722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x42:0x0].111, 64 off15296 00010000:00010000:2.0:1788876624.258468:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258478:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258487:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258494:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258500:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258507:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258534:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876624.258553:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258564:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258571:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258576:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5caa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.258580:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258588:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258596:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8d:0x0].0x0 (ffff8a13c2caf100) 00010000:00010000:2.0:1788876624.258630:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876624.258634:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258640:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5caa00/0xf5bf0f7e313ae5aa lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x8d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258655:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258660:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258666:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258670:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876624.258674:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258680:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258687:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c2caf300) 00010000:00010000:2.0:1788876624.258689:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876624.258691:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258696:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031e00/0xf5bf0f7e313ae59c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876624.258709:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a24f595f reply state 0000000065547fb7 transno 68719477396 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258719:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876624.258726:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2fa8d230 (ffff8a13c2caf800) 00010000:00010000:2.0:1788876624.258728:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876624.258730:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876624.258798:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+170:33371:x1875771511213568:12345-192.168.203.11@tcp:36:rm.0 Request processed in 945us (1152us total) trans 68719477396 rc 0/0 00000100:00100000:2.0:1788876624.258806:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2396 00010000:00010000:0.0:1788876624.258966:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876624.258973:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.258980:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876624.258983:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.258989:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.258999:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x8d:0x0].0x0 (ffff8a13c2caf100) 00010000:00010000:0.0:1788876624.259001:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876624.259004:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.259009:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0400/0xf5bf0f7e313ae5b1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x8d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876624.259021:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876624.259023:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876624.259025:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876624.360862:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876624.360885:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876624.360970:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876624.361110:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532247936 00000100:00100000:0.0:1788876624.361118:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532247936 00000100:00100000:0.0:1788876624.361181:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788876624.361191:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532247936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876624.361227:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923234816 avail 3691712512 00000100:00100000:0.0:1788876624.361273:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+48:3662:x1875771532247936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876624.361281:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00080000:3.0:1788876624.361439:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876624.361518:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876624.361527:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532248064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876624.361558:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876624.361851:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248064 00000100:00100000:1.0:1788876624.361856:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248064 00000100:00100000:1.0:1788876624.361885:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1788876624.361892:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532248064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876624.361916:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788876624.361977:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532248064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876624.361984:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1788876624.362030:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876624.362159:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532248064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876624.362469:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876624.362503:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876624.362581:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248192 00000100:00100000:3.0:1788876624.362586:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248192 00000100:00100000:3.0:1788876624.362649:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1788876624.362657:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532248192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876624.362676:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923218432 avail 3691696128 00000100:00100000:3.0:1788876624.362713:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532248192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876624.362720:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1788876624.362756:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532248192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788876624.362812:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788876624.744794:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876625.384850:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532248448:0@lo:400:kworker.0 00000100:00100000:0.0:1788876625.384932:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385011:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532248320:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385059:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385096:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385119:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385132:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532249344:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385147:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385159:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532249856:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385191:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385220:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876625.385225:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532249984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876625.385256:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248832 00000100:00100000:2.0:1788876625.385264:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248832 00000100:00080000:2.0:1788876625.385302:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876625.385310:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532248576:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385346:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249344 00000100:00100000:3.0:1788876625.385347:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385351:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249344 00000100:00080000:2.0:1788876625.385367:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876625.385373:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532249088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385377:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249856 00000100:00100000:2.0:1788876625.385381:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249856 00000100:00100000:2.0:1788876625.385398:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248576 00000100:00100000:2.0:1788876625.385401:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248576 00000100:00100000:3.0:1788876625.385407:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385419:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:2.0:1788876625.385428:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532248832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385431:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532249600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385461:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876625.385482:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532250112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876625.385488:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532248832:12345-0@lo:400:kworker.0 Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385497:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1788876625.385511:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385521:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1788876625.385529:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532249856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385539:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788876625.385548:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385568:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532249856:12345-0@lo:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385575:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1788876625.385594:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1788876625.385597:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385621:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532248576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385639:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385654:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532248576:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385660:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1788876625.385668:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876625.385682:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532249728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385685:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249216 00000100:00100000:2.0:1788876625.385689:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249216 00000100:00080000:2.0:1788876625.385705:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876625.385706:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876625.385725:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1788876625.385733:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532249216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385749:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532248576:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385764:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532249216:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385771:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1788876625.385782:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385804:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1788876625.385810:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532249344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385841:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532249344:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385848:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1788876625.385872:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249088 00000100:00100000:3.0:1788876625.385878:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249088 00000100:00100000:2.0:1788876625.385881:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249600 00000100:00100000:2.0:1788876625.385886:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249600 00000100:00100000:2.0:1788876625.385910:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248704 00000100:00100000:2.0:1788876625.385913:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248704 00000100:00100000:3.0:1788876625.385921:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249728 00000100:00100000:3.0:1788876625.385937:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249728 00000100:00100000:2.0:1788876625.385940:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788876625.385948:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3664:x1875771532249600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.385972:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1788876625.385981:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532249088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.385990:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3664:x1875771532249600:12345-0@lo:400:kworker.0 Request processed in 42us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.385999:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788876625.386015:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1788876625.386023:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532249088:12345-0@lo:400:kworker.0 Request processed in 43us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.386025:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532248704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.386038:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1788876625.386060:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1788876625.386065:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532248704:12345-0@lo:400:kworker.0 Request processed in 41us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876625.386072:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3664:x1875771532249728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.386074:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:2.0:1788876625.386101:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876625.386106:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876625.386116:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3664:x1875771532249728:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.386117:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250112 00000100:00100000:2.0:1788876625.386122:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250112 00000100:00100000:3.0:1788876625.386130:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1788876625.386150:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1788876625.386158:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532250112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876625.386172:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923234816 avail 3691712512 00000100:00100000:3.0:1788876625.386178:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532248704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.386193:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532249728:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.386218:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532249088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.386220:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532250112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.386229:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:3.0:1788876625.386233:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532249600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.386253:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532250112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876625.386266:0:43293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248320 00000100:00100000:2.0:1788876625.386271:0:43293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248320 00000100:00100000:2.0:1788876625.386298:0:43293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788876625.386304:0:43293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fd3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532248320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876625.386352:0:43293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fd3a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532248320:12345-0@lo:400:kworker.0 Request processed in 48us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.386358:0:43293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788876625.386975:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532248960:0@lo:400:kworker.0 00000100:00100000:0.0:1788876625.387004:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876625.387026:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788876625.387054:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876625.387683:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248960 00000100:00100000:3.0:1788876625.387690:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248960 00000100:00100000:3.0:1788876625.387731:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1788876625.387738:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532248960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.387783:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532248960:12345-0@lo:400:kworker.0 Request processed in 45us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876625.387790:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00080000:2.0:1788876625.389156:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876625.390137:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532248960:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.390577:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876625.390629:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532248448 00000100:00100000:1.0:1788876625.390637:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532248448 00000100:00100000:1.0:1788876625.390693:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249472 00000100:00100000:1.0:1788876625.390697:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249472 00000100:00100000:1.0:1788876625.390713:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1788876625.390720:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532248448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876625.390790:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532248448:12345-0@lo:400:kworker.0 Request processed in 69us (5867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.390797:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1788876625.390812:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1788876625.390818:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532249472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876625.390842:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532249472:12345-0@lo:400:kworker.0 Request processed in 25us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.390848:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1788876625.392859:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532248448:0@lo:400:kworker.0 00000100:00100000:0.0:1788876625.392876:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532249472:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.394440:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532248320:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.394461:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532248832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.394473:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532249344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876625.394485:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532249856:0@lo:400:kworker.0 00000100:00100000:1.0:1788876625.394583:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532249984 00000100:00100000:1.0:1788876625.394591:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532249984 00000100:00100000:1.0:1788876625.394775:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1788876625.394786:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532249984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876625.394821:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876625.394895:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532249984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.394902:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1788876625.394977:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532249984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876625.582499:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876625.582555:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876625.582640:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876625.582665:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876625.582678:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213952 00000100:00100000:2.0:1788876625.582688:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213952 00000100:00100000:0.0:1788876625.582697:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876625.582796:0:43294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213696 00000100:00100000:1.0:1788876625.582802:0:43294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213696 00000100:00100000:1.0:1788876625.582857:0:43294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788876625.582870:0:43294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fd3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511213696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876625.582959:0:43294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fd3a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511213696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.582966:0:43294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788876625.583001:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214208 00000100:00100000:1.0:1788876625.583004:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214208 00000100:00100000:1.0:1788876625.583033:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214080 00000100:00100000:1.0:1788876625.583036:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214080 00000100:00100000:1.0:1788876625.583056:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1132 00000100:00100000:1.0:1788876625.583063:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876625.583093:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.583099:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1132 00000100:00100000:1.0:1788876625.583110:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1133 00000100:00100000:1.0:1788876625.583116:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876625.583139:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876625.583145:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1133 00000100:00100000:0.0:1788876625.583205:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511213824 00000100:00100000:0.0:1788876625.583219:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511213824 00000100:00100000:0.0:1788876625.583250:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1545 00000100:00100000:0.0:1788876625.583257:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+170:2398:x1875771511213824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876625.583301:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+170:2398:x1875771511213824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876625.583309:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1545 00000100:00080000:2.0:1788876625.593553:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876625.593564:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876625.593568:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876625.593680:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1546 00000100:00100000:2.0:1788876625.593697:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511213952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876625.593797:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511213952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 107us (11240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876625.593806:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1546 00010000:00010000:0.0:1788876625.768949:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876626.409033:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532250240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876626.409112:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876626.409240:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250240 00000100:00100000:0.0:1788876626.409249:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250240 00000100:00100000:0.0:1788876626.409312:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1788876626.409323:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532250240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876626.409353:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923218432 avail 3691696128 00000100:00100000:0.0:1788876626.409409:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532250240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876626.409416:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1788876626.409698:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532250240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876626.793104:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876627.816849:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788876627.953974:0:43289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477396 is committed 00010000:00010000:2.0:1788876627.954016:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.954018:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1788876627.954031:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.954038:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:2.0:1788876627.954040:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954049:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13f415ee00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954055:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954064:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954083:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe7e8167a (ffff8a13e798cf00) 00010000:00010000:2.0:1788876627.954087:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954093:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954100:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13f415ee00/0xf5bf0f7e313ad61b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe7e8167a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954131:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954138:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.954140:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:2.0:1788876627.954147:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.954148:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1788876627.954156:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13ff5fe600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954160:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954167:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954176:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe744d4ca (ffff8a13e7965d00) 00010000:00010000:2.0:1788876627.954179:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954183:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954189:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13ff5fe600/0xf5bf0f7e313ad709 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe744d4ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954218:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954230:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954236:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954241:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954243:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954249:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954258:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38f0d619 (ffff8a13e7965800) 00010000:00010000:2.0:1788876627.954261:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954265:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954271:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313ad7c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x38f0d619 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954288:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954295:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954302:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954308:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954312:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954320:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954329:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9904882e (ffff8a13c4c77000) 00010000:00010000:2.0:1788876627.954332:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954335:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954343:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313ad859 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9904882e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954372:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954380:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954387:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954394:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954398:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954406:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954417:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x258fc80c (ffff8a13c4c77200) 00010000:00010000:2.0:1788876627.954420:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954425:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954432:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ad8d7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x258fc80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954450:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954459:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954467:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954472:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954475:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954480:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532250752:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876627.954483:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954495:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x684c3f1c (ffff8a13ff372900) 00010000:00010000:2.0:1788876627.954497:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954500:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954507:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87000/0xf5bf0f7e313ad92b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954521:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954532:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954538:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954542:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954544:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954551:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954559:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33b8752d (ffff8a13fae0b400) 00010000:00010000:2.0:1788876627.954562:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954566:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954570:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.954577:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ad955 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33b8752d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954730:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954738:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954744:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954749:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10aa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.954753:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954760:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954761:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251264:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876627.954777:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe3db4e5b (ffff8a13fa4ad900) 00010000:00010000:2.0:1788876627.954780:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954784:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954791:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10aa00/0xf5bf0f7e313ad97f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe3db4e5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954794:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.954817:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954818:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251776:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.954831:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954838:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954843:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52c00 already unused, calling callback (ffffffffc19004f0) 00000100:00100000:0.0:1788876627.954848:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.954849:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954858:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954868:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8e2b6d33 (ffff8a13fae0b600) 00010000:00010000:2.0:1788876627.954872:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.954875:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954878:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532252288:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.954889:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313ad9a9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8e2b6d33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954907:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876627.954936:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788876627.954941:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532250624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876627.954964:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.954975:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.954985:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251136:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876627.954986:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.954997:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955002:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.955007:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.955014:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.955015:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955027:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61ba9660 (ffff8a13fae0b100) 00010000:00010000:2.0:1788876627.955030:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.955034:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.955038:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251648:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.955043:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ad9d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x61ba9660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955063:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.955070:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.955081:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955087:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.955092:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532252160:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.955095:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.955100:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955107:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955116:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb8eefc1 (ffff8a13fa77b400) 00010000:00010000:2.0:1788876627.955120:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876627.955124:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.955126:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955134:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313ad9fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb8eefc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955153:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955160:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.955161:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250752 00010000:00010000:2.0:1788876627.955170:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955176:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.955179:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955185:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955205:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeb7b910e (ffff8a13e7965c00) 00010000:00010000:2.0:1788876627.955208:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.955211:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955217:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313ada27 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xeb7b910e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955231:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955238:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955244:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955249:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10a200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.955252:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955258:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955266:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd017f5e (ffff8a13fa4ad200) 00010000:00010000:2.0:1788876627.955268:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.955271:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955276:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a200/0xf5bf0f7e313ada51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfd017f5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955289:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955295:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955300:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955305:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.955309:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955314:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955321:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fa8675d (ffff8a13fa77b800) 00010000:00010000:2.0:1788876627.955323:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.955325:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955331:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313ada7b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fa8675d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.955344:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956449:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956458:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956463:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10a800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.956466:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956474:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956487:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc9e7919c (ffff8a13fa4adf00) 00010000:00010000:2.0:1788876627.956490:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.956494:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956501:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10a800/0xf5bf0f7e313adaa5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc9e7919c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956524:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956530:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956536:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956541:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.956544:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956550:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956558:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf9e0350 (ffff8a13fa77b200) 00010000:00010000:2.0:1788876627.956561:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.956563:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956568:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52600/0xf5bf0f7e313adacf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xcf9e0350 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.956583:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.956737:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876627.956786:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.956827:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876627.956851:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.956870:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.956890:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.956913:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.956935:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.956957:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788876627.956964:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876627.956985:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.957003:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876627.957022:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.957039:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.957058:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.957074:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532252032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.957112:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.957146:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251264 00000100:00100000:1.0:1788876627.957163:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251264 00000100:00100000:1.0:1788876627.957224:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251776 00000100:00100000:1.0:1788876627.957227:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251776 00000100:00100000:1.0:1788876627.957242:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532252288 00000100:00100000:1.0:1788876627.957244:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532252288 00000100:00100000:1.0:1788876627.957253:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250624 00000100:00100000:1.0:1788876627.957256:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250624 00000100:00100000:1.0:1788876627.957265:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251136 00000100:00100000:1.0:1788876627.957267:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251136 00000100:00100000:1.0:1788876627.957276:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251648 00000100:00100000:1.0:1788876627.957279:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251648 00000100:00100000:1.0:1788876627.957289:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532252160 00000100:00100000:1.0:1788876627.957292:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532252160 00000100:00100000:1.0:1788876627.957304:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250368 00000100:00100000:1.0:1788876627.957307:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250368 00000100:00100000:1.0:1788876627.957315:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250880 00000100:00100000:1.0:1788876627.957317:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250880 00000100:00100000:1.0:1788876627.957327:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251392 00000100:00100000:1.0:1788876627.957329:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251392 00000100:00100000:1.0:1788876627.957338:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251904 00000100:00100000:1.0:1788876627.957340:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251904 00000100:00100000:1.0:1788876627.957346:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532250496 00000100:00100000:1.0:1788876627.957348:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250496 00000100:00100000:1.0:1788876627.957355:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251008 00000100:00100000:1.0:1788876627.957357:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251008 00000100:00100000:1.0:1788876627.957367:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532251520 00000100:00100000:1.0:1788876627.957369:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532251520 00000100:00100000:1.0:1788876627.957378:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532252032 00000100:00100000:1.0:1788876627.957380:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532252032 00000100:00100000:1.0:1788876627.957393:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1788876627.957401:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3665:x1875771532251264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876627.957434:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:459 count 1 00010000:00010000:1.0:1788876627.957459:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.957480:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.957490:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1cb:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876627.957495:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.957500:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.957536:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.957551:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.957563:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532252416:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876627.957570:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957582:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957588:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.957673:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957681:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957692:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c06bb61 (ffff8a13fa77ba00) 00010000:00010000:2.0:1788876627.957695:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.957699:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957705:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313adaf9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957724:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957731:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957737:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957742:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.957745:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957750:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957757:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x86501ba (ffff8a13fa77b300) 00010000:00010000:2.0:1788876627.957760:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.957763:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957769:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313adb23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x86501ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957782:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957793:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957798:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957803:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ae00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.957805:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957811:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957817:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e67c437 (ffff8a13fa4adc00) 00010000:00010000:2.0:1788876627.957820:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.957823:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957828:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ae00/0xf5bf0f7e313adb4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e67c437 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957843:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957849:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957855:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957858:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10ac00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.957861:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957867:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957874:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x15bd5207 (ffff8a13fa4ad700) 00010000:00010000:2.0:1788876627.957876:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.957879:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957883:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10ac00/0xf5bf0f7e313adb77 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x15bd5207 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.957895:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958545:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958556:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958562:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.958566:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958572:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958582:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddbd5356 (ffff8a13ff372600) 00010000:00010000:2.0:1788876627.958584:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.958588:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958674:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86e00/0xf5bf0f7e313adba1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xddbd5356 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958694:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958700:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958707:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958712:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.958715:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958721:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958729:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x93460dbd (ffff8a13e7965000) 00010000:00010000:2.0:1788876627.958732:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.958734:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958740:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313adbcb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x93460dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958756:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958766:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958772:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958777:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.958780:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958786:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958793:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x845850a4 (ffff8a13e7965200) 00010000:00010000:2.0:1788876627.958796:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.958798:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958804:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313adbf5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x845850a4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958817:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958822:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958829:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958834:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.958837:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958843:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958850:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfde679fc (ffff8a13fa77bb00) 00010000:00010000:2.0:1788876627.958852:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.958855:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958861:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53000/0xf5bf0f7e313adc1f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfde679fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958873:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958879:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958885:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958890:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.958893:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.958899:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959681:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x79c64dea (ffff8a13fa77b500) 00010000:00010000:2.0:1788876627.959684:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.959689:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959696:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53200/0xf5bf0f7e313adc49 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x79c64dea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959717:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959725:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959732:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959738:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9800 already unused, calling callback (ffffffffc19004f0) 00000100:00100000:0.0:1788876627.959741:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532250752 00010000:00010000:2.0:1788876627.959742:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959752:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959761:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xffcae178 (ffff8a13fa77b900) 00010000:00010000:2.0:1788876627.959764:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.959767:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959774:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313adc73 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xffcae178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959788:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959799:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959806:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959812:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.959816:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959822:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.959826:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00010000:00010000:2.0:1788876627.959836:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5d587f95 (ffff8a13fa77b000) 00000100:00100000:0.0:1788876627.959841:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532251776:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.959842:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.959846:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959854:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313adc9d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5d587f95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876627.959866:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:540 count 1 00010000:00010000:2.0:1788876627.959869:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959876:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959883:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.959888:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.959889:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10be00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.959894:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.959913:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.959922:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21c:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1788876627.959926:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.959931:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.959961:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.959972:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.959985:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532252544:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876627.960863:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.960881:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68e42da7 (ffff8a13fa4ada00) 00010000:00010000:2.0:1788876627.960885:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.960891:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.960899:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10be00/0xf5bf0f7e313adcc7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962494:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962506:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962514:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962521:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.962526:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962535:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962552:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe274b122 (ffff8a13fa77bc00) 00010000:00010000:2.0:1788876627.962556:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.962562:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962569:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313adcf1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe274b122 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962779:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962790:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962797:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962803:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.962809:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962817:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962830:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5bda7b75 (ffff8a13e7965600) 00010000:00010000:2.0:1788876627.962834:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.962839:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962846:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313add1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5bda7b75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962874:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962887:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962894:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.962899:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.964049:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964064:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964077:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x33c39277 (ffff8a13fae0b500) 00010000:00010000:2.0:1788876627.964079:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.964083:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964089:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8000/0xf5bf0f7e313add45 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x33c39277 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964112:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964118:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964124:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964129:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.964132:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964137:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964143:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3148b334 (ffff8a13ff5bbf00) 00010000:00010000:2.0:1788876627.964145:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.964148:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964153:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8a00/0xf5bf0f7e313add6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3148b334 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964165:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964171:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964176:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964181:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.964184:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964190:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964208:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4e3ef675 (ffff8a13fa4ad500) 00010000:00010000:2.0:1788876627.964210:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.964214:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964219:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b400/0xf5bf0f7e313add99 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4e3ef675 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964236:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964244:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964251:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964256:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.964259:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964265:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964274:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7f9d98ea (ffff8a13ff372000) 00010000:00010000:2.0:1788876627.964277:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.964280:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964285:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87800/0xf5bf0f7e313addc3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7f9d98ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964304:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964312:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964317:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964322:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.964324:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964330:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964338:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd06b4f64 (ffff8a13ff5bbe00) 00010000:00010000:2.0:1788876627.964341:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.964343:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.964349:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9c00/0xf5bf0f7e313added lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd06b4f64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.964413:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.964452:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1788876627.964472:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532252288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.964506:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:544 count 1 00010000:00010000:1.0:1788876627.964529:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.964549:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 77 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.964559:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x220:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.964563:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.964567:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.964598:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 77 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.964624:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 77 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.964637:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532252672:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876627.965705:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965715:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965722:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965727:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.965731:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965738:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965749:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f5a2b28 (ffff8a13ff5bb800) 00010000:00010000:2.0:1788876627.965752:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.965756:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965761:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9a00/0xf5bf0f7e313ade17 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5f5a2b28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965775:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965781:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965786:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965792:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.965794:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965800:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965807:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd95ebeb7 (ffff8a13ff5bb000) 00010000:00010000:2.0:1788876627.965809:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.965813:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965819:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ade41 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd95ebeb7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965834:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965840:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965845:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965849:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.965852:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965857:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965864:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xecedf1db (ffff8a13fa4adb00) 00010000:00010000:2.0:1788876627.965866:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.965869:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965875:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1800/0xf5bf0f7e313ade6b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xecedf1db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965889:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965900:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965906:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.965910:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc19004f0) 00000100:00100000:0.0:1788876627.966777:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876627.966808:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1788876627.966821:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532250624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876627.966845:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:540 count 1 00010000:00010000:0.0:1788876627.966867:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.966885:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 77 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.966893:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21c:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1788876627.966897:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.967680:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967720:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 77 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967733:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 77 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.967747:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532252800:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876627.967788:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca0409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876627.967814:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788876627.967824:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532251136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876627.967839:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:544 count 1 00010000:00010000:0.0:1788876627.967855:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967867:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 77 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967879:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x220:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1788876627.967882:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.967886:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967978:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 77 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.967989:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 77 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.968000:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532252928:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876627.968025:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876627.968044:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1788876627.968052:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532251648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876627.968068:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:539 count 1 00010000:00010000:0.0:1788876627.968082:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.968094:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.968100:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21b:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1788876627.968102:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.968106:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.968139:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.968150:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.968161:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532253056:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876627.968185:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.968970:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.968999:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1788876627.969009:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532252160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.969025:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:543 count 1 00010000:00010000:1.0:1788876627.969043:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969056:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969063:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21f:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.969067:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.969071:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969092:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969103:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.969116:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532253184:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.969141:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.969388:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1788876627.969397:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532250368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876627.969411:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:538 count 1 00010000:00010000:1.0:1788876627.969426:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969439:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969451:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21a:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.969454:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.969458:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969478:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969487:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 77 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.969497:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532253312:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.969520:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.969540:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1788876627.969548:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532250880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876627.969560:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:542 count 1 00010000:00010000:1.0:1788876627.969572:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969669:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969677:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21e:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.969681:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.969685:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969706:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969715:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.969723:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532253440:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.969743:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.969759:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1788876627.969767:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532251392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.969781:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:538 count 1 00010000:00010000:1.0:1788876627.969792:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969804:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969811:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21a:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.969813:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.969817:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969835:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.969845:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.969854:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532253568:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.969874:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76840 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.969891:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1788876627.969899:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532251904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.970854:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:541 count 1 00010000:00010000:1.0:1788876627.970872:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.970887:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.970894:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21d:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.970897:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.970998:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971015:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.971024:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00010000:00010000:2.0:1788876627.971033:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7d261ae4 (ffff8a13ff5bba00) 00000100:00100000:0.0:1788876627.971037:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532250496:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876627.971039:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.971047:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876627.971055:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:539 count 1 00010000:00010000:2.0:1788876627.971057:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9000/0xf5bf0f7e313ade95 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.971071:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.971084:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971090:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.971091:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21b:0x0].0x0 since=65s v=(0 0) 00010000:00010000:0.0:1788876627.971098:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.971104:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.971106:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971124:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971132:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.971137:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.971143:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 77 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971146:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971170:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdc580966 (ffff8a13ff372e00) 00010000:00010000:0.0:1788876627.971171:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971175:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.971180:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971188:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86400/0xf5bf0f7e313adebf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdc580966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.971189:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532253696:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876627.971219:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971226:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971233:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.971235:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040780 going to sleep for 11 seconds 00010000:00010000:2.0:1788876627.971242:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.971245:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971252:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971262:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbeafb14 (ffff8a13fa4ad800) 00010000:00010000:2.0:1788876627.971264:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.971268:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971275:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1400/0xf5bf0f7e313adee9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbeafb14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.971295:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971324:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971351:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971362:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 77 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.971378:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532253824:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.971407:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.971430:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788876627.971438:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532251008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876627.971451:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:543 count 1 00010000:00010000:1.0:1788876627.971463:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971474:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971481:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21f:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.971484:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.971488:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971507:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 77 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.971517:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 77 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.971527:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532253952:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.971546:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.971564:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1788876627.971571:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532251520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.971994:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:458 count 1 00010000:00010000:1.0:1788876627.972009:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972021:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972028:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ca:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876627.972031:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.972034:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972056:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972066:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.972075:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532254080:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.972105:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.972123:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1788876627.972131:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3662:x1875771532252032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.972146:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:542 count 1 00010000:00010000:1.0:1788876627.972156:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972169:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972176:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21e:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.972179:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.972182:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972210:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.972220:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.972230:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532254208:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.972263:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00000100:00080000:1.0:1788876627.972282:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876627.972287:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788876627.973124:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934789 is committed 00010000:00010000:2.0:1788876627.975986:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976014:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976020:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976024:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976034:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976052:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x36cd9303 (ffff8a13ff5bb600) 00010000:00010000:2.0:1788876627.976055:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976060:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976068:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8800/0xf5bf0f7e313adf13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x36cd9303 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976103:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976114:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976120:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976126:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976128:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976134:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976141:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x46c12da2 (ffff8a13ff5bbc00) 00010000:00010000:2.0:1788876627.976144:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976147:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976153:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9600/0xf5bf0f7e313adf3d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x46c12da2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976167:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976173:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976179:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976183:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976186:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976204:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976214:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x89cf8cc4 (ffff8a13ff5bb500) 00010000:00010000:2.0:1788876627.976216:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976219:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976225:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8600/0xf5bf0f7e313adf67 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x89cf8cc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976239:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976245:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976250:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976256:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976258:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976264:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976271:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x951cee31 (ffff8a13ff372f00) 00010000:00010000:2.0:1788876627.976274:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976277:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976283:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86000/0xf5bf0f7e313adf91 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x951cee31 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976298:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976303:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976308:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976313:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976315:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976321:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976327:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc082bfb3 (ffff8a13ff5bbd00) 00010000:00010000:2.0:1788876627.976329:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976332:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976337:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8c00/0xf5bf0f7e313adfbb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc082bfb3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976348:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976368:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976373:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976377:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976379:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976385:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976392:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x50199b77 (ffff8a13fae83400) 00010000:00010000:2.0:1788876627.976394:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976397:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976402:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313adfe5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x50199b77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976416:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976422:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976427:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976432:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976435:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976441:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976447:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5eae1855 (ffff8a13fae83200) 00010000:00010000:2.0:1788876627.976451:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976455:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976461:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb800/0xf5bf0f7e313ae00f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5eae1855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976479:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976487:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976494:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976501:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976505:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976512:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976520:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x18b2154c (ffff8a13fa4ad100) 00010000:00010000:2.0:1788876627.976522:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976526:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976531:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0a00/0xf5bf0f7e313ae039 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x18b2154c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976548:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976554:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976559:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976564:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976568:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976574:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976582:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x223991a9 (ffff8a13e7965e00) 00010000:00010000:2.0:1788876627.976586:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976791:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976805:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313ae063 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976835:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976847:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976854:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976862:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.976866:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976874:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.976888:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fd51cfa (ffff8a13fa4ad300) 00010000:00010000:2.0:1788876627.976892:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.976897:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977260:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1000/0xf5bf0f7e313ae08d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1fd51cfa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977281:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977287:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977293:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977297:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8da00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.977300:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977306:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977314:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cb3c8c7 (ffff8a13fa77b700) 00010000:00010000:2.0:1788876627.977316:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.977320:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977324:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313ae0b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cb3c8c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977339:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977345:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977350:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977419:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.977422:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977428:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977436:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe703e79e (ffff8a13c133ed00) 00010000:00010000:2.0:1788876627.977439:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.977442:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977448:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8b600/0xf5bf0f7e313ae0e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe703e79e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977462:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977468:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977474:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977478:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.977481:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977488:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977494:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xde7f3e2c (ffff8a13ff372d00) 00010000:00010000:2.0:1788876627.977497:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.977499:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977505:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87400/0xf5bf0f7e313ae10b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xde7f3e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977519:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977530:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977535:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977540:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.977543:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977549:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977556:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6335057 (ffff8a13fa4ade00) 00010000:00010000:2.0:1788876627.977559:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.977562:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977569:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0200/0xf5bf0f7e313ae135 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6335057 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977584:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.977590:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979009:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979015:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979020:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979027:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979040:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbe2a6e5 (ffff8a13fa4ad400) 00010000:00010000:2.0:1788876627.979043:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.979047:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979053:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b0c00/0xf5bf0f7e313ae15f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbe2a6e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979079:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979086:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979091:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979096:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979099:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979105:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979112:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf9a272a (ffff8a13c133eb00) 00010000:00010000:2.0:1788876627.979115:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.979118:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979123:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae189 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdf9a272a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979136:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979142:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979147:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979151:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cae00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979154:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979159:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979167:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x63e3f2a (ffff8a13fa4ad000) 00010000:00010000:2.0:1788876627.979169:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.979172:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979177:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cae00/0xf5bf0f7e313ae1b3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x63e3f2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979190:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979212:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979217:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979222:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979225:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979231:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979239:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x248301e8 (ffff8a13ff372100) 00010000:00010000:2.0:1788876627.979241:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.979244:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979250:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87600/0xf5bf0f7e313ae1dd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x248301e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979267:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979273:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979279:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979283:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979287:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979293:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979300:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd91ac688 (ffff8a13ff5bb300) 00010000:00010000:2.0:1788876627.979302:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.979305:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979310:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae207 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd91ac688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979327:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979332:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979337:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979342:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbe00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.979346:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.979351:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.979815:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876627.979847:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214336 00000100:00100000:3.0:1788876627.979857:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214336 00000100:00100000:0.0:1788876627.979888:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532252416:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.979907:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 78 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.979916:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.979946:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:3.0:1788876627.979958:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2397:x1875771511214336:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.979973:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788876627.979975:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532252928:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.979982:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 78 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.979991:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.979997:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 78 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.980025:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.980029:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.980036:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.980047:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.980067:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876627.980113:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2397:x1875771511214336:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.980120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00080000:3.0:1788876627.980145:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876627.980333:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532253056:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876627.980352:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.980358:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532253568:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.980382:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.980410:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532253440:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.980421:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.980443:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532253184:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.980452:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980692:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1133e6 (ffff8a13cfee7f00) 00010000:00010000:1.0:1788876627.980693:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313a7c8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478b1 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980694:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.980699:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.980706:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532252544:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876627.980706:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbe00/0xf5bf0f7e313ae231 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980717:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980724:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980731:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980732:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980738:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980740:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980744:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.980747:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980749:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980754:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980756:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980761:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x13537268 (ffff8a13ff372a00) 00010000:00010000:2.0:1788876627.980762:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.980765:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.980770:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876627.980770:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a87e00/0xf5bf0f7e313ae25b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x13537268 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980785:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980794:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876627.980795:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980803:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980804:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980821:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.980826:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980837:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876627.980839:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980842:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980850:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe60214dd (ffff8a13cfee7b00) 00010000:00010000:2.0:1788876627.980854:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876627.980855:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980858:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980873:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca600/0xf5bf0f7e313ae285 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe60214dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980879:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980885:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980888:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae5bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.980896:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.980915:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.980917:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.980920:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876627.980936:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532251776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21098us (26087us total) trans 8589934790 rc 0/0 00000100:00100000:1.0:1788876627.980945:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1788876627.980949:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934789 gen 2 00000004:00080000:0.0:1788876627.980956:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb299c00, transno 8589934747 00000100:00100000:1.0:1788876627.980966:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000004:00080000:0.0:1788876627.980968:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb29a680, transno 8589934748 00000004:00080000:0.0:1788876627.980973:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb299880, transno 8589934749 00000004:00080000:0.0:1788876627.980976:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb299180, transno 8589934750 00000100:00100000:1.0:1788876627.980978:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532250752:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876627.980980:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb298000, transno 8589934751 00000004:00080000:0.0:1788876627.980985:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb299f80, transno 8589934752 00000004:00080000:0.0:1788876627.980989:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb29b800, transno 8589934753 00000004:00080000:0.0:1788876627.980992:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb298a80, transno 8589934754 00000004:00080000:0.0:1788876627.980994:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3034000, transno 8589934755 00000004:00080000:0.0:1788876627.980997:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3036d80, transno 8589934756 00000004:00080000:0.0:1788876627.981000:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa781c00, transno 8589934757 00000004:00080000:0.0:1788876627.981002:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aafb80, transno 8589934758 00000004:00080000:0.0:1788876627.981004:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aad500, transno 8589934759 00002000:00080000:1.0:1788876627.981006:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:541 count 1 00000004:00080000:0.0:1788876627.981007:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aac380, transno 8589934760 00000004:00080000:0.0:1788876627.981013:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cd880, transno 8589934761 00000004:00080000:0.0:1788876627.981016:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa782300, transno 8589934762 00000004:00080000:0.0:1788876627.981019:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff5e6680, transno 8589934763 00000004:00080000:0.0:1788876627.981022:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f0000, transno 8589934764 00000004:00080000:0.0:1788876627.981025:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cdc00, transno 8589934765 00000004:00080000:0.0:1788876627.981029:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd7f480, transno 8589934766 00010000:00010000:1.0:1788876627.981030:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788876627.981032:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa781500, transno 8589934767 00000004:00080000:0.0:1788876627.981038:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cff7e300, transno 8589934768 00010000:00010000:1.0:1788876627.981049:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.981061:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x21d:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.981064:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.981068:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.981096:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 77 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.981109:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.981122:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532254336:192.168.203.11@tcp:104: 00000004:00080000:0.0:1788876627.981145:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c92d80, transno 8589934769 00000004:00080000:0.0:1788876627.981148:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aaf100, transno 8589934770 00000100:00100000:1.0:1788876627.981177:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00000004:00080000:0.0:1788876627.981220:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4088380, transno 8589934771 00000004:00080000:0.0:1788876627.981224:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c93100, transno 8589934772 00000004:00080000:0.0:1788876627.981227:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9500, transno 8589934773 00000004:00080000:0.0:1788876627.981229:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780700, transno 8589934774 00000004:00080000:0.0:1788876627.981231:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cff7d880, transno 8589934775 00000004:00080000:0.0:1788876627.981234:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aad880, transno 8589934776 00000004:00080000:0.0:1788876627.981236:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb29bb80, transno 8589934777 00000004:00080000:0.0:1788876627.981239:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff5e5500, transno 8589934778 00000004:00080000:0.0:1788876627.981241:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f45d8380, transno 8589934779 00000004:00080000:0.0:1788876627.981244:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff5e7800, transno 8589934780 00000004:00080000:0.0:1788876627.981247:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff5e4a80, transno 8589934781 00000004:00080000:0.0:1788876627.981249:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c90e00, transno 8589934782 00000004:00080000:0.0:1788876627.981252:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3035180, transno 8589934783 00000004:00080000:0.0:1788876627.981254:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f2300, transno 8589934784 00000004:00080000:0.0:1788876627.981257:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4675f80, transno 8589934785 00000004:00080000:0.0:1788876627.981260:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cff7ed80, transno 8589934786 00000004:00080000:0.0:1788876627.981262:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4674000, transno 8589934787 00000004:00080000:0.0:1788876627.981265:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f0a80, transno 8589934788 00000004:00080000:0.0:1788876627.981267:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4674a80, transno 8589934789 00000100:00100000:0.0:1788876627.981275:0:3665:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a13f4035c00 x1875771532251776/t8589934790(8589934790) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788876643 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788876627.981285:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4035c00/2, rc 0, transno 8589934790 00000100:00100000:0.0:1788876627.981290:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251776:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876627.981514:0:43309:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 59 changes, 8 in progress, 7 in flight, 43 done 00000100:00100000:0.0:1788876627.981566:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532254464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876627.981694:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.982005:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982012:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982016:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982023:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982035:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d23cb57 (ffff8a13ff5bb900) 00010000:00010000:2.0:1788876627.982038:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982042:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982047:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb10b800/0xf5bf0f7e313ae2af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4d23cb57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982071:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982078:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982084:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982089:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cba00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982092:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982098:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982106:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2673cbdb (ffff8a13cfee7700) 00010000:00010000:2.0:1788876627.982109:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982112:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982117:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cba00/0xf5bf0f7e313ae2d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2673cbdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982131:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982137:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982143:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982148:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982151:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982157:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982165:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8524b10d (ffff8a13ff372500) 00010000:00010000:2.0:1788876627.982168:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982171:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982177:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c4a86a00/0xf5bf0f7e313ae303 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8524b10d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982206:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982217:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982223:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982227:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982230:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982237:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982245:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5714b191 (ffff8a13cfee7100) 00010000:00010000:2.0:1788876627.982247:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982249:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982255:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca400/0xf5bf0f7e313ae32d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5714b191 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982268:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982274:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982280:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982285:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5ca800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982288:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982294:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982301:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd925180b (ffff8a13cfee7d00) 00010000:00010000:2.0:1788876627.982303:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982306:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982311:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5ca800/0xf5bf0f7e313ae357 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd925180b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982322:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982327:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982332:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982337:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982340:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982345:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982351:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6585166e (ffff8a13ff372400) 00010000:00010000:2.0:1788876627.982353:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876627.982486:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 17 min 3 max 116 00000100:00100000:1.0:1788876627.982495:0:10319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_017' 00010000:00010000:2.0:1788876627.982496:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982503:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d800/0xf5bf0f7e313ae381 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6585166e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982520:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982526:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982532:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982538:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.982540:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982546:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982555:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfbc48c9f (ffff8a13cfee7300) 00010000:00010000:2.0:1788876627.982557:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.982560:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982566:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb600/0xf5bf0f7e313ae3ab lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfbc48c9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.982579:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.982667:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532253312:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.982690:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.982744:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532252672:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876627.982758:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.982835:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532252800:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876627.982854:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.982889:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532253696:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876627.982904:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.982914:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876627.982945:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876627.982975:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214464 00000100:00100000:3.0:1788876627.982976:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876627.982983:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214464 00000100:00100000:3.0:1788876627.983006:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876627.983023:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 78 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.983034:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876627.983060:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876627.983118:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532253824:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876627.983133:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.983161:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532253952:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876627.983173:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.983203:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532254080:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876627.983216:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.983662:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532254208:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876627.983677:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.983703:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532254464 00000100:00100000:1.0:1788876627.983708:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532254464 00010000:00010000:2.0:1788876627.983751:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983757:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983762:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cbc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.983765:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983772:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983783:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77f95b4c (ffff8a13cfee7a00) 00010000:00010000:2.0:1788876627.983786:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.983790:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983796:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cbc00/0xf5bf0f7e313ae3d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x77f95b4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983818:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983824:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983830:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983835:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.983838:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983844:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983852:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x737b65d2 (ffff8a13cfee7600) 00010000:00010000:2.0:1788876627.983854:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.983857:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983862:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb400/0xf5bf0f7e313ae3ff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983876:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983881:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983886:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983891:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b1e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.983893:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.983899:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.983951:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1788876627.983960:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532254464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.983987:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:545 count 1 00010000:00010000:1.0:1788876627.984007:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.984022:0:43966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 76 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.984030:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x221:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876627.984035:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.984039:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.984068:0:43966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 76 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.984087:0:43966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 76 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.984100:0:43966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532254592:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876627.984162:0:43966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6480 going to sleep for 11 seconds 00000100:00080000:1.0:1788876627.984201:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876627.984899:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1bda453 (ffff8a13fae83100) 00010000:00010000:2.0:1788876627.984970:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.984976:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.984979:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214720 00010000:00010000:2.0:1788876627.984983:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c86b1e00/0xf5bf0f7e313ae429 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1bda453 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.984991:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214720 00010000:00010000:2.0:1788876627.985008:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985010:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214976 00000100:00100000:3.0:1788876627.985015:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214976 00010000:00010000:2.0:1788876627.985016:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.985021:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 78 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985024:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985036:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 78 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985041:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.985044:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985049:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985054:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215232 00000100:00100000:3.0:1788876627.985056:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215232 00010000:00010000:2.0:1788876627.985057:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1a07d3eb (ffff8a13ff372300) 00010000:00010000:2.0:1788876627.985059:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.985062:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985067:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985068:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313ae453 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1a07d3eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985084:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985093:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985098:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985103:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fa5cb000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.985106:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.985149:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214592 00000100:00100000:3.0:1788876627.985347:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511214848 00000100:00100000:3.0:1788876627.985351:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214848 00010000:00010000:3.0:1788876627.985367:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 79 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:3.0:1788876627.985389:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+79:2398:x1875771511214464:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.985401:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876627.985408:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985420:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985438:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000257beaa1/0xf5bf0f7e313a58e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b52 expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985450:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.985454:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.985459:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985467:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985492:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876627.985529:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214464:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 140us (2619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.985537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:3.0:1788876627.985553:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:3.0:1788876627.985558:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+79:2398:x1875771511214976:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.985566:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876627.985672:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985684:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9395fd43 (ffff8a13fae83300) 00010000:00010000:2.0:1788876627.985687:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876627.985688:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985691:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985697:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fa5cb000/0xf5bf0f7e313ae47d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9395fd43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985699:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985713:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7cf001/0xf5bf0f7e313a7dde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704792f expref: 79 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985715:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985722:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985728:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985728:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.985732:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.985733:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876627.985736:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985737:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985743:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985745:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985751:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9e7acbf1 (ffff8a13c2caf500) 00010000:00010000:2.0:1788876627.985753:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.985756:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985761:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031a00/0xf5bf0f7e313ae4a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9e7acbf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985762:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876627.985775:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985781:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985781:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511214976:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 223us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.985787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 169 00010000:00010000:2.0:1788876627.985788:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985793:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.985795:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985801:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:3.0:1788876627.985808:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+77:2398:x1875771511214720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876627.985809:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbf7427f1 (ffff8a13ff372200) 00010000:00010000:2.0:1788876627.985811:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.985814:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985816:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876627.985820:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313ae4d1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbf7427f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985821:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985831:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985834:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985840:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985843:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313a7c1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047887 expref: 77 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985847:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985852:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.985855:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985858:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.985860:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985861:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.985866:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985867:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4c1a469f (ffff8a13ff372800) 00010000:00010000:2.0:1788876627.985869:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.985872:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985874:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.985878:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313ae4fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x4c1a469f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985890:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876627.985891:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876627.985907:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+76:2398:x1875771511214720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 99us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.985913:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:3.0:1788876627.985954:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:3.0:1788876627.985961:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+77:2398:x1875771511215232:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.985968:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876627.985974:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985984:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.985997:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313a7d36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478f0 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986012:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.986015:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.986019:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986027:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986044:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876627.986062:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+76:2398:x1875771511215232:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 102us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.986069:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:3.0:1788876627.986081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:3.0:1788876627.986087:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+75:2398:x1875771511214848:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.986095:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876627.986101:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986111:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986124:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313a7e4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047959 expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986139:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.986142:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.986146:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986153:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.986170:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876627.986187:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+74:2398:x1875771511214848:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 99us (3126us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876627.986388:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986399:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986408:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986414:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986430:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876627.986582:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532251264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29181us (31788us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788876627.986590:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00010000:00010000:1.0:1788876627.986636:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986651:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986659:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986667:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986681:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876627.986765:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3665:x1875771532251648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18712us (31696us total) trans 8589934791 rc 0/0 00000100:00100000:1.0:1788876627.986771:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00010000:00010000:1.0:1788876627.986790:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876627.986796:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986803:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876627.986806:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986813:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986825:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986833:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009631af82/0xf5bf0f7e313ae5b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986847:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876627.986851:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986857:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876627.986860:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986867:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986878:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986886:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae5db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986888:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986896:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.986900:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876627.986901:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876627.986903:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876627.986911:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.986915:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986922:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986932:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ce5b4ef (ffff8a13c2cafe00) 00010000:00010000:2.0:1788876627.986934:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.986937:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.986942:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4036d80/2, rc 0, transno 8589934791 00010000:00010000:2.0:1788876627.986943:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313ae525 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3ce5b4ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.986959:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251648:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.986960:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986966:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986972:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876627.986973:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4036300/2, rc 0, transno 4294967498 00010000:00010000:2.0:1788876627.986978:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c600 already unused, calling callback (ffffffffc19004f0) 00000100:00100000:1.0:1788876627.986980:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251264:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876627.986981:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986987:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.986994:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6d15b7c (ffff8a13ff372c00) 00010000:00010000:2.0:1788876627.986996:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.986999:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987003:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313ae54f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6d15b7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987017:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987023:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987028:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987033:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.987035:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987042:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987049:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe1c3d982 (ffff8a13c133e200) 00010000:00010000:2.0:1788876627.987051:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876627.987052:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532254720:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876627.987054:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987059:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313ae579 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe1c3d982 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987074:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987080:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.987082:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876627.987086:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987090:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0030a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876627.987093:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987098:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987105:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2fa8d230 (ffff8a13c2caf800) 00010000:00010000:2.0:1788876627.987108:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876627.987110:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987116:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313ae5a3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2fa8d230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.987139:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532254720 00000100:00100000:1.0:1788876627.987145:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532254720 00000100:00100000:1.0:1788876627.987174:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1788876627.987181:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3663:x1875771532254720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876627.987212:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:546 count 1 00000100:00100000:2.0:1788876627.987226:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876627.987231:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987240:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876627.987245:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 74 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987251:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876627.987253:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x222:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876627.987256:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.987261:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987264:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876627.987275:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876627.987282:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 74 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987293:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 74 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987304:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876627.987308:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532254976:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876627.987321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215104 00000100:00100000:2.0:1788876627.987324:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215104 00010000:00010000:2.0:1788876627.987340:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 76 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.987349:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788876627.987363:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876627.987372:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532254848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876627.987398:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876627.987421:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532254848 00000100:00100000:1.0:1788876627.987424:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532254848 00000100:00100000:1.0:1788876627.987447:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1788876627.987452:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532254848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876627.987464:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:545 count 1 00010000:00010000:1.0:1788876627.987477:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987487:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 76 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987488:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215360 00000100:00100000:2.0:1788876627.987492:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215360 00010000:00010000:1.0:1788876627.987495:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x221:0x0].0x0 since=65s v=(0 0) 00010000:00010000:1.0:1788876627.987498:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.987502:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987506:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 75 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215616 00010000:00010000:1.0:1788876627.987519:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 76 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987520:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215616 00010000:00010000:1.0:1788876627.987529:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987529:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 77 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.987540:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532255104:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876627.987541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215488 00000100:00100000:2.0:1788876627.987543:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215488 00010000:00010000:2.0:1788876627.987552:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 78 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876627.987561:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876627.987563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215744 00000100:00100000:2.0:1788876627.987565:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215744 00010000:00010000:2.0:1788876627.987575:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 76 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987658:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876627.987675:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216000 00000100:00100000:1.0:1788876627.987679:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216000 00010000:00010000:1.0:1788876627.987695:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.987696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:2.0:1788876627.987703:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+78:2398:x1875771511215104:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788876627.987710:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00010000:00010000:2.0:1788876627.987711:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788876627.987715:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+77:2398:x1875771511215360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876627.987716:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 78 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987721:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876627.987725:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987727:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 78 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987735:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987741:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb979e6/0xf5bf0f7e313a7b76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047848 expref: 78 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987746:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008037d843/0xf5bf0f7e313a7bae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704785d expref: 77 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987752:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.987755:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.987755:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.987758:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.987760:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987762:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987768:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.987776:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987786:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876627.987789:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876627.987810:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+77:2398:x1875771511215104:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876627.987816:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:2.0:1788876627.987832:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:2.0:1788876627.987840:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+76:2397:x1875771511215616:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876627.987847:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876627.987852:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 76 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987860:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 76 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.987871:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fcf7d5c/0xf5bf0f7e313a7be6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047872 expref: 76 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.989055:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.989063:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.989069:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.989079:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.989105:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876627.990357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:3.0:1788876627.990390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:3.0:1788876627.990402:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+75:2398:x1875771511215488:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876627.990419:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876627.990428:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.990444:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.990464:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017f7dffe/0xf5bf0f7e313a7c56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704789c expref: 75 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.990482:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.990486:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876627.990491:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.990500:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.990649:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876627.990921:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+75:2398:x1875771511215360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3203us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876627.990929:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:1.0:1788876627.990948:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:1.0:1788876627.990956:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+74:2398:x1875771511215744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876627.990966:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876627.990971:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 74 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.990981:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 74 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.990995:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313a7cfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478db expref: 74 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991007:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.991010:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.991015:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991028:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991049:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876627.991071:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+73:2398:x1875771511215744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 116us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876627.991076:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:1.0:1788876627.991091:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:1.0:1788876627.991097:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+72:2398:x1875771511216000:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876627.991105:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876627.991110:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991119:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991131:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac9a809/0xf5bf0f7e313a58ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b3d expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991141:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.991144:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ca:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876627.991148:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991160:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991176:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876627.991206:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+71:2398:x1875771511216000:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 108us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876627.991212:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00010000:00010000:1.0:1788876627.991252:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991262:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991272:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991281:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991298:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876627.991452:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3662:x1875771532251904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21553us (34514us total) trans 8589934792 rc 0/0 00000100:00100000:1.0:1788876627.991460:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00010000:00010000:1.0:1788876627.991482:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991495:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991503:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.991510:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876627.993894:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876627.994085:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3662:x1875771532251520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22511us (37021us total) trans 8589934793 rc 0/0 00000100:00100000:1.0:1788876627.994095:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000004:00080000:1.0:1788876627.994157:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4037b80/2, rc 0, transno 8589934793 00000100:00100000:1.0:1788876627.994169:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251520:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876627.994182:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4034700/2, rc 0, transno 8589934792 00000100:00100000:1.0:1788876627.994186:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.994375:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876627.994388:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532255232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876627.994427:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876627.994460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+74:2397:x1875771511215616:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6619us (7204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876627.994469:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00010000:00010000:2.0:1788876627.994507:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.994526:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.994536:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.994543:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.994559:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788876627.995806:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3665:x1875771532252160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26795us (40681us total) trans 8589934794 rc 0/0 00000100:00100000:2.0:1788876627.995814:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1788876627.995834:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532255232 00000100:00100000:2.0:1788876627.995840:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532255232 00000100:00100000:2.0:1788876627.995877:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1788876627.995888:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+15:3664:x1875771532255232:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876627.995895:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511214592 00002000:00080000:2.0:1788876627.995929:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:547 count 1 00010000:00010000:0.0:1788876627.995932:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.995944:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.995955:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.995956:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.995977:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.995987:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 70 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.995991:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788876627.996001:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x223:0x0].0x0 since=64s v=(0 0) 00010000:00010000:2.0:1788876627.996006:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876627.996010:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.996042:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 70 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.996055:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 70 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876627.996069:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532255488:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876627.996128:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82300 going to sleep for 11 seconds 00000001:00080000:2.0:1788876627.996275:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967497 is committed 00000100:00100000:3.0:1788876627.998229:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+74:2398:x1875771511215488:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 7820us (10952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876627.998243:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00010000:00010000:3.0:1788876627.998291:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.998305:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.998317:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.998325:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876627.998336:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788876627.998485:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3665:x1875771532250624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31668us (43519us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788876627.998493:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1788876627.998529:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3662:x1875771532250496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 27495us (41540us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788876627.998538:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00010000:00010000:0.0:1788876627.998562:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876627.998569:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998578:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.998582:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998598:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998631:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998638:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae5fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998660:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876627.998664:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998671:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.998674:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998682:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998692:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998698:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998715:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876627.998719:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998726:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.998729:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998737:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998747:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998754:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5e5a29/0xf5bf0f7e313ae5e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998768:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876627.998771:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998778:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.998781:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998793:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998802:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998808:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae605 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998821:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876627.998824:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998830:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.998834:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998841:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998850:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998857:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033029961/0xf5bf0f7e313ae5cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.998876:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.998878:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.998880:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.998933:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 73 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876627.998970:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:0.0:1788876627.998978:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+73:2398:x1875771511214592:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876627.998995:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876627.999001:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 73 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999013:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 73 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999031:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe4717c7/0xf5bf0f7e313a7e16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047944 expref: 73 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999043:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.999047:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x220:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876627.999052:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999062:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999092:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876627.999118:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+72:2398:x1875771511214592:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 140us (16086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876627.999124:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00010000:00010000:0.0:1788876627.999178:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999187:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999206:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999214:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999227:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876627.999325:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532251136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31504us (44311us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788876627.999332:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00010000:00010000:0.0:1788876627.999347:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876627.999351:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999358:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb10b200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876627.999362:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999370:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999381:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999388:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eef32d3/0xf5bf0f7e313ae5d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876627.999401:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.999403:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876627.999404:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876627.999527:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999537:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999545:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999552:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999572:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876627.999736:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+14:3662:x1875771532250880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30187us (42882us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788876627.999743:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00010000:00010000:2.0:1788876627.999764:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999773:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999783:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999790:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999799:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876627.999865:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3662:x1875771532250368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30470us (43078us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788876627.999871:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00010000:00010000:2.0:1788876627.999889:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999897:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999904:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999916:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876627.999924:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788876627.999991:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3665:x1875771532252288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35527us (45083us total) trans 8589934795 rc 0/0 00000100:00100000:2.0:1788876627.999996:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00010000:00010000:2.0:1788876628.000022:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.000031:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.000039:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.000047:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.000056:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788876628.000117:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+16:3662:x1875771532251392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30351us (43225us total) trans 8589934796 rc 0/0 00000100:00100000:2.0:1788876628.000124:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1788876628.000179:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.000289:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.000426:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511215872 00000100:00100000:3.0:1788876628.000435:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511215872 00010000:00010000:3.0:1788876628.000460:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 72 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.000480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216128 00000100:00100000:3.0:1788876628.000483:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216128 00010000:00010000:3.0:1788876628.000495:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 71 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.000513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:3.0:1788876628.001433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+72:2397:x1875771511215872:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.001449:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.001457:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 72 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.001471:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 72 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1788876628.001706:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+71:2397:x1875771511216128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.001716:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.001722:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 71 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001732:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 71 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.001740:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.001755:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313a7d6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047905 expref: 71 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001769:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.001773:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.001779:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001788:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001813:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.001815:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876628.001830:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876628.001840:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001848:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2397:x1875771511216128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 143us (1558us total) trans 0 rc 0/0 00010000:00010000:0.0:1788876628.001853:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.001860:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001860:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00010000:00010000:0.0:1788876628.001872:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001881:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216256 00000100:00100000:1.0:1788876628.001887:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216256 00010000:00010000:0.0:1788876628.001888:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.001898:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313ae5f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001905:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 73 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.001922:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788876628.001924:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216384 00010000:00010000:0.0:1788876628.001928:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001929:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216384 00010000:00010000:0.0:1788876628.001938:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.001942:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001946:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 70 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.001957:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00010000:00010000:0.0:1788876628.001970:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.001979:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+73:2396:x1875771511216256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.001982:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef491c6/0xf5bf0f7e313ae5e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.001989:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.001996:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 73 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002001:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876628.002008:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002011:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 73 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002024:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.002030:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002035:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.002041:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.002044:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002052:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002053:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002075:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876628.002077:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002086:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372426f5/0xf5bf0f7e313ae5c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.002098:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+73:2396:x1875771511216256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 122us (357us total) trans 0 rc 0/0 00010000:00010000:0.0:1788876628.002101:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.002108:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.002110:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00010000:00010000:0.0:1788876628.002120:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.002124:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002131:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.002132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:1.0:1788876628.002144:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2398:x1875771511216384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.002146:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002156:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae5f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002156:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.002165:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 70 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002177:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.002178:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 70 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.002180:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.002183:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.002206:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.002210:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.002215:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002233:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002246:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.002266:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2398:x1875771511216384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 124us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.002272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00010000:00010000:1.0:1788876628.002292:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002307:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002316:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002324:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002343:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.002475:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3662:x1875771532252032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30344us (45361us total) trans 8589934797 rc 0/0 00000100:00100000:1.0:1788876628.002483:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00010000:00010000:1.0:1788876628.002505:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.002510:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002527:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.002530:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002538:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002551:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002557:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae61a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.002570:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.002572:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.002574:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.002586:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.002628:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532255360:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.002640:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.002666:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.002726:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f452c380/2, rc 0, transno 4294967499 00000100:00100000:1.0:1788876628.002736:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250496:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.002748:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eef60380/2, rc 0, transno 8589934797 00000100:00100000:1.0:1788876628.002756:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532252032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.002766:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967497 gen 2 00000004:00080000:1.0:1788876628.002770:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9c00, transno 4294967455 00000004:00080000:1.0:1788876628.002773:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fb800, transno 4294967456 00000004:00080000:1.0:1788876628.002776:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f8000, transno 4294967457 00000004:00080000:1.0:1788876628.002778:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f8380, transno 4294967458 00000004:00080000:1.0:1788876628.002780:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fbb80, transno 4294967459 00000004:00080000:1.0:1788876628.002783:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9f80, transno 4294967460 00000004:00080000:1.0:1788876628.002785:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9180, transno 4294967461 00000004:00080000:1.0:1788876628.002787:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35faa00, transno 4294967462 00000004:00080000:1.0:1788876628.002789:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa783480, transno 4294967463 00000004:00080000:1.0:1788876628.002792:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff574000, transno 4294967464 00000004:00080000:1.0:1788876628.002794:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff574a80, transno 4294967465 00000004:00080000:1.0:1788876628.002797:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa781880, transno 4294967466 00000004:00080000:1.0:1788876628.002799:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3037800, transno 4294967467 00000004:00080000:1.0:1788876628.002801:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa783100, transno 4294967468 00000004:00080000:1.0:1788876628.002804:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3036a00, transno 4294967469 00000004:00080000:1.0:1788876628.002806:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa782d80, transno 4294967470 00000004:00080000:1.0:1788876628.002809:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cc000, transno 4294967471 00000004:00080000:1.0:1788876628.002812:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f1c00, transno 4294967472 00000004:00080000:1.0:1788876628.002814:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cea00, transno 4294967473 00000004:00080000:1.0:1788876628.002817:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c93b80, transno 4294967474 00000004:00080000:1.0:1788876628.002820:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c91880, transno 4294967475 00000004:00080000:1.0:1788876628.002822:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c92300, transno 4294967476 00000004:00080000:1.0:1788876628.002824:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f2d80, transno 4294967477 00000004:00080000:1.0:1788876628.002827:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d12f3b80, transno 4294967478 00000004:00080000:1.0:1788876628.002829:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780000, transno 4294967479 00000004:00080000:1.0:1788876628.002832:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780e00, transno 4294967480 00000004:00080000:1.0:1788876628.002834:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7aae680, transno 4294967481 00000004:00080000:1.0:1788876628.002836:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780380, transno 4294967482 00000004:00080000:1.0:1788876628.002839:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c93480, transno 4294967483 00000004:00080000:1.0:1788876628.002842:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fa300, transno 4294967484 00000004:00080000:1.0:1788876628.002844:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fad80, transno 4294967485 00000004:00080000:1.0:1788876628.002846:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fb100, transno 4294967486 00000004:00080000:1.0:1788876628.002850:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cff7df80, transno 4294967487 00000004:00080000:1.0:1788876628.002853:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3658a80, transno 4294967488 00000004:00080000:1.0:1788876628.002855:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb29aa00, transno 4294967489 00000004:00080000:1.0:1788876628.002858:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c92680, transno 4294967490 00000004:00080000:1.0:1788876628.002860:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4677b80, transno 4294967491 00000004:00080000:1.0:1788876628.002863:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4676d80, transno 4294967492 00000004:00080000:1.0:1788876628.002865:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f8700, transno 4294967493 00000004:00080000:1.0:1788876628.002868:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3357480, transno 4294967494 00000004:00080000:1.0:1788876628.002870:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3355880, transno 4294967495 00000004:00080000:1.0:1788876628.002873:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4676a00, transno 4294967496 00000004:00080000:1.0:1788876628.002875:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3659c00, transno 4294967497 00000100:00100000:1.0:1788876628.002883:0:3662:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a13f4036300 x1875771532251264/t4294967498(4294967498) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788876643 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788876628.002891:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f452dc00/2, rc 0, transno 4294967503 00000100:00100000:1.0:1788876628.002895:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250368:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.002906:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f452f800/2, rc 0, transno 4294967502 00000100:00100000:1.0:1788876628.002910:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532250880:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.002918:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4037100/2, rc 0, transno 8589934796 00000100:00100000:1.0:1788876628.002921:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251392:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876628.003121:0:43311:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 58 changes, 9 in progress, 5 in flight, 43 done 00000100:00100000:1.0:1788876628.003181:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532255616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.003224:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.003258:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532255872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.003280:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.003306:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f452d880/2, rc 0, transno 4294967500 00000100:00100000:1.0:1788876628.003314:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532250624:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.003323:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4037800/2, rc 0, transno 4294967501 00000100:00100000:1.0:1788876628.003327:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532251136:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.003336:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eef62300/2, rc 0, transno 8589934794 00000100:00100000:1.0:1788876628.003339:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532252160:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876628.003349:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eef62a00/2, rc 0, transno 8589934795 00000100:00100000:1.0:1788876628.003352:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532252288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.003360:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876628.003365:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532255744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.003386:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.003435:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532256128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.003456:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.003472:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.003477:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532256000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.003495:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.003526:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532255360 00000100:00100000:1.0:1788876628.003532:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532255360 00000100:00100000:1.0:1788876628.003563:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532255616 00000100:00100000:1.0:1788876628.003566:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532255616 00000100:00100000:1.0:1788876628.003582:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532255872 00000100:00100000:1.0:1788876628.003585:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532255872 00000100:00100000:1.0:1788876628.003597:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532255744 00000100:00100000:1.0:1788876628.003623:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532255744 00000100:00100000:1.0:1788876628.003640:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532256128 00000100:00100000:1.0:1788876628.003643:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532256128 00000100:00100000:1.0:1788876628.003655:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532256000 00000100:00100000:1.0:1788876628.003658:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532256000 00000100:00100000:1.0:1788876628.003670:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1788876628.003677:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:3663:x1875771532255360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.003701:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:548 count 1 00010000:00010000:1.0:1788876628.003721:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003738:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003748:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x224:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.003752:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.003757:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003781:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003800:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.003812:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:43963:1875771532256256:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.003855:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c1254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.003870:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1788876628.003877:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbe9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3663:x1875771532255616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.003890:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:546 count 1 00010000:00010000:1.0:1788876628.003904:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003916:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 72 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003924:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x222:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.003927:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.003931:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003949:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 72 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.003959:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 72 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.003976:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532256384:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.003999:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.004014:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788876628.004022:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3665:x1875771532255872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.004032:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:548 count 1 00010000:00010000:1.0:1788876628.004043:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004054:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 72 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004061:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x224:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.004064:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.004068:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004108:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 72 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004119:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 72 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.004130:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532256512:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.004155:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c1254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.004166:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788876628.004174:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1788876628.004179:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3665:x1875771532255744:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.004187:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3663:x1875771532256128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.004205:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:547 count 1 00002000:00080000:1.0:1788876628.004217:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:550 count 1 00010000:00010000:0.0:1788876628.004221:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004233:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004236:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 72 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004255:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x223:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.004257:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 72 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004259:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.004268:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004273:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x226:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.004282:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.004287:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004298:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 72 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004313:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 72 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.004323:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532256640:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.004326:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 72 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.004340:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.004351:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.004354:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532256768:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.004370:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1788876628.004378:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3663:x1875771532256000:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.004386:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c1254780 going to sleep for 11 seconds 00002000:00080000:0.0:1788876628.004392:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:549 count 1 00010000:00010000:0.0:1788876628.004403:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004414:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 72 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004422:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x225:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.004426:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.004430:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004452:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 72 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004463:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.004470:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532257408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.004476:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532257280:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.004502:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.004508:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.004518:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532257408 00000100:00100000:0.0:1788876628.004523:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532257408 00000100:00100000:1.0:1788876628.004533:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.004541:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532257152:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.004547:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1788876628.004555:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3663:x1875771532257408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.004567:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:550 count 1 00000100:00100000:1.0:1788876628.004569:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.004581:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004595:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 69 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.004598:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532257024:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.004623:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x226:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.004628:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.004632:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004654:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 69 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.004664:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.004674:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532257536:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.014821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313a7da6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704791a expref: 72 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.014850:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.014855:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.014862:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.014874:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.014912:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.020625:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca0403c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.020664:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.020694:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532256896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.021622:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.021667:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532257152 00000100:00100000:1.0:1788876628.021676:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532257152 00000100:00100000:1.0:1788876628.021712:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532257024 00000100:00100000:1.0:1788876628.021715:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532257024 00000100:00100000:1.0:1788876628.021729:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1788876628.021737:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3663:x1875771532257152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.021766:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:549 count 1 00010000:00010000:1.0:1788876628.021793:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.021814:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 69 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.021823:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x225:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.021827:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.021833:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.021866:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 69 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.021880:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.021900:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532257664:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.021938:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.021957:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1788876628.021965:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+19:3665:x1875771532257024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.021977:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:459 count 1 00010000:00010000:1.0:1788876628.021989:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.022000:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 69 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.022007:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1cb:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.022010:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.022013:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.022032:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 69 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.022041:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.022050:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532257792:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.022069:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.022098:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532254976:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.022116:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.022149:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532255104:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.022160:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.022205:0:43966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313a7ebe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047983 expref: 69 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.022219:0:43966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532254592:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.022261:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.022294:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532256896 00000100:00100000:0.0:1788876628.022298:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532256896 00000100:00100000:0.0:1788876628.022336:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1788876628.022342:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.022349:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3664:x1875771532256896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.022364:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:450 count 1 00010000:00010000:0.0:1788876628.022380:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.022395:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 68 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.022403:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876628.022411:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1c2:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.022415:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.022419:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.026861:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216640 00000100:00100000:2.0:1788876628.026874:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216640 00010000:00010000:2.0:1788876628.027530:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.027562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216512 00000100:00100000:2.0:1788876628.027567:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216512 00010000:00010000:2.0:1788876628.027584:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.027703:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:2.0:1788876628.027713:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c6679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+72:2398:x1875771511216640:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.027729:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.027735:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.027749:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.027772:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313a7e86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704796e expref: 72 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.027789:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.027795:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x221:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.027801:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.027812:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.027850:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.027980:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c6679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+71:2398:x1875771511216640:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 266us (5640us total) trans 0 rc 0/0 00010000:00010000:0.0:1788876628.027990:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 69 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.027991:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00010000:00010000:0.0:1788876628.028008:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 69 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.028018:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1788876628.028029:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532257920:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.028097:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2398:x1875771511216512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788876628.028102:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788876628.028110:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.028118:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028132:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028148:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6e0269/0xf5bf0f7e313a7f2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ad expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028159:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.028162:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.028166:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028174:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028206:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.028229:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2398:x1875771511216512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 203us (5829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.028235:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00010000:00010000:2.0:1788876628.028288:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313a7cc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370478c6 expref: 70 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.028302:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532254336:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.028325:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028334:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028342:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028352:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028359:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.028375:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.028533:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3665:x1875771532250752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47558us (73965us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788876628.028541:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00010000:00010000:2.0:1788876628.028584:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.029094:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2397:x1875771511215872:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 27667us (28914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.029105:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:3.0:1788876628.029706:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.029750:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.029768:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.029785:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216768 00000100:00100000:3.0:1788876628.029791:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216768 00010000:00010000:3.0:1788876628.029816:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 68 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.029838:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217024 00000100:00100000:3.0:1788876628.029840:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217024 00010000:00010000:3.0:1788876628.029852:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 69 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.029863:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511216896 00000100:00100000:3.0:1788876628.029865:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511216896 00010000:00010000:3.0:1788876628.029876:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.029890:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1788876628.029899:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2395:x1875771511216768:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.030027:0:43966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.030063:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1788876628.030071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2395:x1875771511217024:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.030083:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.030089:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 69 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030108:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 69 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030134:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.030138:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x222:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.030144:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030153:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030169:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.030212:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2395:x1875771511217024:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 142us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.030221:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1788876628.030371:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1788876628.030378:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2395:x1875771511216896:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.030388:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.030393:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030404:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030417:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.030421:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.030425:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030439:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030450:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.030468:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2395:x1875771511216896:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 91us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.030474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00010000:00010000:1.0:1788876628.030508:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047036805/0xf5bf0f7e313a7ef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047998 expref: 68 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.030585:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532256384:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.030615:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030625:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030633:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030643:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030652:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030670:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876628.030800:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbe9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3663:x1875771532255616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26922us (27574us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788876628.030807:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00010000:00010000:1.0:1788876628.030830:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.030836:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030845:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.030849:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030860:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030872:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030880:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae621 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.030897:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.030900:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.031015:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.031021:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 68 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.031093:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 68 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.031108:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.031112:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.031116:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.031125:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.031140:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.031160:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2395:x1875771511216768:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1262us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.031167:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00010000:00010000:0.0:1788876628.031512:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.031868:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.031872:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.031882:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.031895:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.031959:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae64b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.031977:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.031979:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.031981:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.032014:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad3ad80/2, rc 0, transno 4294967505 00000100:00100000:1.0:1788876628.032027:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532255616:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876628.032336:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.032346:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.032354:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.032373:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876628.032475:0:43963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000515d353c/0xf5bf0f7e313a800e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a01 expref: 67 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.032487:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:43963:1875771532256256:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.032488:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+19:3662:x1875771532251008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 61050us (75463us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788876628.032495:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00010000:00010000:1.0:1788876628.032504:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032717:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.032723:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032736:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.032739:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032746:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032759:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032766:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae60c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.032783:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.032785:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.032786:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.032802:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532258048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.032842:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876628.033125:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313a7f9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479d7 expref: 66 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.033138:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532255488:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.033155:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.033320:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.033328:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.033337:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.033344:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.033360:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.033461:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+21:3663:x1875771532255360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29783us (30794us total) trans 8589934798 rc 0/0 00000100:00100000:1.0:1788876628.033469:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1788876628.033487:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532258048 00000100:00100000:1.0:1788876628.033493:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532258048 00000004:00080000:3.0:1788876628.033654:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f4035180/2, rc 0, transno 4294967506 00000100:00100000:3.0:1788876628.033665:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532251008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.033706:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876628.033715:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532258176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.033743:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876628.033843:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.033852:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.033864:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.033871:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.033883:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876628.033953:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3664:x1875771532255232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38066us (39525us total) trans 8589934799 rc 0/0 00000100:00100000:2.0:1788876628.033960:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1788876628.037756:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532258176 00000100:00100000:1.0:1788876628.037770:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532258176 00000100:00100000:1.0:1788876628.037826:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1788876628.037836:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+20:3664:x1875771532258048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.037866:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:551 count 1 00010000:00010000:1.0:1788876628.037892:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.037932:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 67 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.037942:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x227:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.037947:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.037953:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.037993:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 67 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038008:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 67 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.038024:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532258304:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.038115:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223540 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.038136:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.038143:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038154:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.038158:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038170:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038205:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038215:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038253:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.038258:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038266:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c86b0400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.038269:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038278:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038289:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038297:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de4d60fb/0xf5bf0f7e313ae63d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.038313:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.038316:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.038318:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.038327:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.038369:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad3aa00/2, rc 0, transno 8589934798 00000100:00100000:1.0:1788876628.038383:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532255360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.038439:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.038451:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532258432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.038490:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.039852:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.039868:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.039880:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.039889:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.039929:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.040184:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3663:x1875771532254720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 53001us (53098us total) trans 8589934800 rc 0/0 00000100:00100000:1.0:1788876628.040206:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1788876628.040304:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532258432 00000100:00100000:1.0:1788876628.040312:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532258432 00000100:00100000:1.0:1788876628.040336:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1788876628.040344:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3664:x1875771532258176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.040368:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:552 count 1 00010000:00010000:1.0:1788876628.040388:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.040404:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 67 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.040411:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x228:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.040415:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.040419:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.040447:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 67 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.040459:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 67 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.040473:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532258560:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.040478:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.040486:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.040497:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.040501:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.040516:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.040531:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.040538:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313ae62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.040559:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.040561:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.040562:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.040717:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223f00 going to sleep for 11 seconds 00000004:00080000:1.0:1788876628.040753:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad3a680/2, rc 0, transno 8589934800 00000100:00100000:1.0:1788876628.040765:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532254720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.040821:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532258688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.040851:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.040879:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532258688 00000100:00100000:1.0:1788876628.040883:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532258688 00000100:00100000:1.0:1788876628.040973:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1788876628.040983:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3663:x1875771532258432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.040997:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:551 count 1 00010000:00010000:1.0:1788876628.041012:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041025:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 65 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041040:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x227:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.041043:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.041046:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041071:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 65 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041083:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 65 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.041094:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532258816:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.041123:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb2236c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.041144:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041153:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041163:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041171:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.041185:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.043553:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1788876628.043571:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3663:x1875771532258688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876628.043671:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:552 count 1 00010000:00010000:2.0:1788876628.043696:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.043936:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 65 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.043946:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x228:0x0].0x0 since=64s v=(0 0) 00010000:00010000:2.0:1788876628.043951:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.043956:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.043990:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 65 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.044002:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 65 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.044016:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532258944:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.044079:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d34bb9c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788876628.044155:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad38000/2, rc 0, transno 8589934799 00000100:00100000:2.0:1788876628.044171:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532255232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.044692:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3665:x1875771532254848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57237us (57290us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788876628.044702:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00010000:00010000:1.0:1788876628.044735:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.044743:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.044753:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.044758:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.044770:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.044789:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.044797:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae636 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.044818:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.044819:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.044821:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.044887:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad3b100/2, rc 0, transno 4294967507 00000100:00100000:1.0:1788876628.044899:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532254848:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.045061:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f452d180/2, rc 0, transno 4294967504 00000100:00100000:1.0:1788876628.045067:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532250752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.045072:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876628.045083:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532259072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.045113:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.045147:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532259072 00000100:00100000:1.0:1788876628.045152:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532259072 00000100:00100000:1.0:1788876628.045188:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1788876628.045217:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3665:x1875771532259072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.045656:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:553 count 1 00010000:00010000:1.0:1788876628.045678:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045694:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 65 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045702:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x229:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.045707:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.045711:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045744:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 65 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045755:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 65 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.045766:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532259200:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.045805:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223240 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.045811:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532259456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.045827:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532259328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.045841:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.045851:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532259456 00000100:00100000:1.0:1788876628.045855:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532259456 00000100:00100000:1.0:1788876628.045881:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788876628.045889:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3662:x1875771532259456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.045902:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:554 count 1 00010000:00010000:1.0:1788876628.045930:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045943:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 67 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045951:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22a:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.045955:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.045959:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045983:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 67 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.045994:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 67 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.046005:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532259584:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.046037:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb2230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.046054:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.046078:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532259328 00000100:00100000:1.0:1788876628.046082:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532259328 00000100:00100000:1.0:1788876628.046099:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1788876628.046105:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3665:x1875771532259328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.046117:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:553 count 1 00010000:00010000:1.0:1788876628.046128:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.046139:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 67 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.046146:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x229:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.046149:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.046153:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.046675:0:43966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.046686:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.046696:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.046703:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.046752:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 67 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.046766:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 67 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.046776:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532259712:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.046817:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.046922:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.046986:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532256640:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.047012:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.047043:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532257280:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.047054:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1788876628.047058:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.047088:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532257536:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.047099:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.048883:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.048934:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.048958:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:2.0:1788876628.048996:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.049158:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+24:3662:x1875771532254464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 65198us (67462us total) trans 8589934801 rc 0/0 00000100:00100000:2.0:1788876628.049167:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000004:00080000:2.0:1788876628.049294:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fac08700/2, rc 0, transno 8589934801 00000100:00100000:2.0:1788876628.049311:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532254464:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788876628.049363:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217152 00000100:00100000:2.0:1788876628.049369:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217152 00010000:00010000:2.0:1788876628.049398:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.049419:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217792 00000100:00100000:2.0:1788876628.049422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217792 00010000:00010000:2.0:1788876628.049436:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 66 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.049449:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217408 00000100:00100000:2.0:1788876628.049451:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217408 00010000:00010000:2.0:1788876628.049464:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 69 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.049475:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217536 00000100:00100000:2.0:1788876628.049477:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217536 00010000:00010000:2.0:1788876628.049487:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 70 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.049498:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217920 00000100:00100000:2.0:1788876628.049500:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217920 00010000:00010000:2.0:1788876628.049511:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 67 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.049525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1788876628.049533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2397:x1875771511217152:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.049545:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.049551:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 70 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.049564:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 70 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.050896:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.050904:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x224:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.050911:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.050924:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.050948:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.050990:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2397:x1875771511217152:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1456us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.050999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1788876628.051022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1788876628.051030:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+67:2395:x1875771511217792:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.051041:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.051047:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 67 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051058:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 67 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051074:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.051077:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.051081:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051089:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051101:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.051119:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+67:2395:x1875771511217792:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 89us (4067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.051125:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1788876628.051137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:2.0:1788876628.051144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2397:x1875771511217408:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.051153:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.051157:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 69 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051166:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 69 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051179:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.051182:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.051187:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051209:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051222:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.051240:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2397:x1875771511217408:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 96us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.051246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:2.0:1788876628.051283:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:2.0:1788876628.051302:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2395:x1875771511217536:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.051310:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.051316:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 68 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.051326:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 68 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052389:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313a7fd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479ec expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.052408:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532256512:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.052430:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052440:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052447:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052457:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052468:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052492:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876628.052689:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3665:x1875771532255872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48666us (49405us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788876628.052697:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788876628.052729:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:1.0:1788876628.052738:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2397:x1875771511217920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.052749:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.052756:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 66 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052767:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 66 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052785:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.052789:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.052794:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052803:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052818:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876628.052835:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc10dce/0xf5bf0f7e313a8046 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a16 expref: 67 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.052841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2397:x1875771511217920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 105us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.052848:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00010000:00010000:2.0:1788876628.052852:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.052855:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x225:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.052859:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.052866:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052867:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.052872:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052879:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.052884:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052894:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052905:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052912:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052933:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.052937:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052943:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.052946:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.052958:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.052958:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052970:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052977:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.052989:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.052991:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.052993:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.053012:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532259840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.053053:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.053094:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532259840 00000100:00100000:1.0:1788876628.053099:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532259840 00000100:00100000:1.0:1788876628.053127:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1788876628.053134:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3663:x1875771532259840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.053155:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:554 count 1 00010000:00010000:1.0:1788876628.053175:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053190:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 65 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053216:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22a:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.053219:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.053234:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053260:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 65 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053272:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 65 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.053283:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532259968:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.053322:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.053355:0:43962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002501da0a/0xf5bf0f7e313a80b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a40 expref: 66 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.053366:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532256768:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.053380:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053389:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053395:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053406:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053415:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053431:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.053521:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+23:3663:x1875771532256128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49338us (50063us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788876628.053528:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00010000:00010000:1.0:1788876628.053546:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.053551:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053559:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.053563:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053572:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053584:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053592:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313ae660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053623:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.053625:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.053627:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.053650:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff574a80/2, rc 0, transno 4294967509 00000100:00100000:1.0:1788876628.053662:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532256128:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876628.053695:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.053718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+65:2395:x1875771511217536:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2427us (4783us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876628.053724:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313a807e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a2b expref: 65 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.053726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1788876628.053734:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532257664:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.053745:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053752:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053759:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053767:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053774:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053791:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876628.053864:0:43961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d62a4089/0xf5bf0f7e313a591e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b67 expref: 64 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.053876:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532257792:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.053878:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532257152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32142us (49310us total) trans 8589934802 rc 0/0 00000100:00100000:1.0:1788876628.053884:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00010000:00010000:2.0:1788876628.053888:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.053896:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.053903:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.053907:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed6a00/2, rc 0, transno 8589934802 00000100:00100000:1.0:1788876628.053915:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532257152:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876628.053917:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.053924:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.053937:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876628.053945:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.053949:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053956:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.053960:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053967:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053978:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.053985:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313ae675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.053997:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054000:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.054007:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054008:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:3665:x1875771532257024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32043us (32386us total) trans 8589934803 rc 0/0 00010000:00010000:0.0:1788876628.054018:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054019:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb200 already unused, calling callback (ffffffffc0cf24f0) 00000100:00100000:2.0:1788876628.054019:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00010000:00010000:1.0:1788876628.054023:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.054039:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054041:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054042:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260224:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.054065:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054067:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054071:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.054087:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313ae67c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.054094:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788876628.054097:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed4000/2, rc 0, transno 8589934803 00010000:00010000:1.0:1788876628.054102:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.054106:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054108:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532257024:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.054113:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.054116:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788876628.054119:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad38700/2, rc 0, transno 4294967508 00010000:00010000:1.0:1788876628.054124:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054125:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532255872:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.054135:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.054135:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876628.054142:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260096:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.054144:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054157:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.054159:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.054161:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876628.054163:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.054172:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532260224 00000100:00100000:1.0:1788876628.054176:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532260224 00000100:00100000:2.0:1788876628.054183:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532260096 00000100:00100000:2.0:1788876628.054186:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532260096 00000100:00100000:1.0:1788876628.054212:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1788876628.054220:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3665:x1875771532260224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.054237:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:555 count 1 00010000:00010000:1.0:1788876628.054251:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.054252:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+24:3663:x1875771532256000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 49873us (50753us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788876628.054268:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00010000:00010000:1.0:1788876628.054273:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 63 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054282:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22b:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.054286:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.054288:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.054292:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054313:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 63 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054325:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 63 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.054337:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532260352:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.054363:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.054375:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.054413:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13ff574000/2, rc 0, transno 4294967510 00000100:00100000:1.0:1788876628.054421:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532256000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.054425:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.054433:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532260480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.054457:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.054504:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532260608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.054526:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.054558:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532260480 00000100:00100000:1.0:1788876628.054562:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532260480 00000100:00100000:1.0:1788876628.054576:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532260608 00000100:00100000:1.0:1788876628.054579:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532260608 00000100:00100000:1.0:1788876628.054589:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1788876628.054595:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532260480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.054622:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:555 count 1 00010000:00010000:1.0:1788876628.054636:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054648:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 64 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054655:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22b:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.054659:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.054663:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054682:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 64 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054692:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 64 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.054703:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532260736:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.054724:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.054761:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1788876628.054769:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3663:x1875771532260608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.054780:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:556 count 1 00010000:00010000:1.0:1788876628.054792:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054804:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 64 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054812:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22c:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.054816:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.054820:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054838:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 64 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.054848:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 64 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.054858:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532260992:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.054876:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223300 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.055002:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876628.055011:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.055033:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.055050:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532260864 00000100:00100000:1.0:1788876628.055053:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532260864 00000100:00100000:1.0:1788876628.055070:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1788876628.055076:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+26:3665:x1875771532260864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.055087:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:556 count 1 00010000:00010000:1.0:1788876628.055097:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.055109:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 63 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.055117:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22c:0x0].0x0 since=64s v=(0 0) 00010000:00010000:1.0:1788876628.055120:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.055124:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.055144:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 63 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.055155:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 63 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.055166:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532261120:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.062047:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.062136:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1788876628.062153:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+25:3665:x1875771532260096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.062188:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:460 count 1 00010000:00010000:2.0:1788876628.062226:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.062248:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 64 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.062256:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1cc:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.062261:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.062266:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.062301:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 64 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.062314:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 64 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.062328:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532261248:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.073424:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073461:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073496:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073568:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073589:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073625:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073638:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073676:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073688:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073717:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073728:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073748:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073771:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073809:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.073853:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532257920:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.073878:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.073910:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217280 00000100:00100000:0.0:1788876628.073916:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217280 00010000:00010000:0.0:1788876628.073951:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 65 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.073974:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511217664 00000100:00100000:0.0:1788876628.073976:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511217664 00010000:00010000:0.0:1788876628.073988:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 64 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.073998:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218048 00000100:00100000:0.0:1788876628.074001:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218048 00010000:00010000:0.0:1788876628.074011:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 65 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074020:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218304 00000100:00100000:0.0:1788876628.074022:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218304 00010000:00010000:0.0:1788876628.074033:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 66 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074044:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218560 00000100:00100000:0.0:1788876628.074046:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218560 00010000:00010000:0.0:1788876628.074057:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 66 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074066:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218176 00000100:00100000:0.0:1788876628.074068:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218176 00010000:00010000:0.0:1788876628.074077:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 67 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074088:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218432 00000100:00100000:0.0:1788876628.074090:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218432 00010000:00010000:0.0:1788876628.074100:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 67 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074109:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218816 00000100:00100000:0.0:1788876628.074111:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218816 00010000:00010000:0.0:1788876628.074121:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074130:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218688 00000100:00100000:0.0:1788876628.074133:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218688 00010000:00010000:0.0:1788876628.074143:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 68 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074153:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219072 00000100:00100000:0.0:1788876628.074156:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219072 00010000:00010000:0.0:1788876628.074167:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 69 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074177:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511218944 00000100:00100000:0.0:1788876628.074180:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511218944 00010000:00010000:0.0:1788876628.074205:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 70 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074217:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219200 00000100:00100000:0.0:1788876628.074219:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219200 00010000:00010000:0.0:1788876628.074231:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 69 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074243:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219328 00000100:00100000:0.0:1788876628.074245:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219328 00010000:00010000:0.0:1788876628.074256:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 70 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074267:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219456 00000100:00100000:0.0:1788876628.074269:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219456 00010000:00010000:0.0:1788876628.074281:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 71 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.074296:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1788876628.074305:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+71:2397:x1875771511217280:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.074319:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.074326:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 71 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074339:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 71 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074362:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313a7f66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370479c2 expref: 71 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074377:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074381:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x223:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074387:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074397:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074425:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.074471:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2397:x1875771511217280:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 166us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.074479:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1788876628.074498:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:0.0:1788876628.074505:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+70:2397:x1875771511217664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.074514:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.074519:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 70 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074535:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 70 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074550:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000826223de/0xf5bf0f7e313a80ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a55 expref: 70 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074560:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074563:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x226:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074567:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074575:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074593:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.074637:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2397:x1875771511217664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 131us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.074644:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:0.0:1788876628.074659:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:0.0:1788876628.074665:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2397:x1875771511218048:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.074673:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.074679:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074695:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074708:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4e39b90/0xf5bf0f7e313a552e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370469ed expref: 68 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074718:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074721:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074726:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074734:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074752:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.074774:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+67:2397:x1875771511218048:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 109us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.074781:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:0.0:1788876628.074795:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:0.0:1788876628.074801:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2398:x1875771511218304:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.074809:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.074814:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074830:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 69 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074842:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074845:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074849:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074857:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074870:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.074889:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+69:2398:x1875771511218304:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 88us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.074895:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:0.0:1788876628.074909:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:0.0:1788876628.074915:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2398:x1875771511218560:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.074922:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.074928:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 66 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074937:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 66 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074955:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074958:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x228:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.074962:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074970:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.074982:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075003:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2398:x1875771511218560:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 87us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075009:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:0.0:1788876628.075043:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:0.0:1788876628.075050:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2398:x1875771511218176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075057:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075062:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 68 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075072:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 68 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075084:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075087:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075091:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075103:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075114:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075132:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+68:2398:x1875771511218176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 83us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075139:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:0.0:1788876628.075151:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1788876628.075158:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+65:2398:x1875771511218432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075166:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075170:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 65 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075180:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 65 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075206:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075209:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x227:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075213:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075220:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075232:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075247:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+65:2398:x1875771511218432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 89us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075252:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:0.0:1788876628.075265:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:0.0:1788876628.075271:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+67:2398:x1875771511218816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075278:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075283:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 67 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075292:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 67 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075303:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075305:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075309:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075316:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075326:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075340:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+67:2398:x1875771511218816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 69us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075346:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:0.0:1788876628.075358:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:0.0:1788876628.075364:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+64:2398:x1875771511218688:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075375:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075380:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 64 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075390:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 64 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075401:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075404:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075408:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075416:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075427:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075441:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+64:2398:x1875771511218688:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 77us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075447:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:0.0:1788876628.075458:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:0.0:1788876628.075464:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+63:2398:x1875771511219072:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075473:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075478:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 63 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075487:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 63 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075498:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075501:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075505:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075512:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075523:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075536:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+63:2398:x1875771511219072:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 72us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075541:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:0.0:1788876628.075553:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1788876628.075559:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+62:2398:x1875771511218944:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075565:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075570:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 62 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075579:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 62 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075590:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075593:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075597:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075625:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075636:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075650:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+62:2398:x1875771511218944:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 91us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075657:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:0.0:1788876628.075669:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:0.0:1788876628.075675:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c6679050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2396:x1875771511219200:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075682:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075688:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 66 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075697:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 66 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075707:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075709:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x229:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075713:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075720:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075730:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075744:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c6679050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+66:2396:x1875771511219200:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 70us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.075750:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:0.0:1788876628.075773:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:0.0:1788876628.075780:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+65:2395:x1875771511219328:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075787:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075792:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 65 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075801:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 65 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075812:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075815:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075818:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075825:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075836:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075848:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+65:2395:x1875771511219328:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 69us (2077us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.075852:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313a81ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047aa9 expref: 61 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.075854:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:3.0:1788876628.075864:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532258944:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.075866:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:0.0:1788876628.075873:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+64:2397:x1875771511219456:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.075880:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.075884:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 64 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.075885:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075893:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 64 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.075896:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.075903:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075904:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075907:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.075911:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.075913:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075919:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.075922:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075929:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.075940:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+64:2397:x1875771511219456:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 68us (2131us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.075944:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.075945:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00010000:00010000:0.0:1788876628.075964:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075972:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075979:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075985:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.075999:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876628.076182:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001797594b/0xf5bf0f7e313a8276 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ae8 expref: 63 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.076208:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532259584:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.076225:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.076233:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.076239:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.076247:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.076254:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.076273:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1788876628.079472:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff43c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788876628.079526:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876628.079534:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079546:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.079551:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079566:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079588:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079596:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae69f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079653:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876628.079658:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079665:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.079668:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079674:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079684:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079691:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079712:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.079716:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079722:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.079725:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079732:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079741:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079749:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313ae6ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.079763:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.079765:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.079766:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.083266:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3665:x1875771532255744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 79081us (79869us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1788876628.083280:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00010000:00010000:0.0:1788876628.083320:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083333:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083345:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083353:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083374:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.083540:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3663:x1875771532257408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 78986us (79033us total) trans 8589934805 rc 0/0 00000100:00100000:0.0:1788876628.083547:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00010000:00010000:0.0:1788876628.083568:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.083574:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083583:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.083586:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083596:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083642:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083650:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae66e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083670:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.083672:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.083673:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.083678:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876628.083713:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed4a80/2, rc 0, transno 8589934804 00000100:00100000:0.0:1788876628.083725:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532258688:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.083735:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed7b80/2, rc 0, transno 8589934805 00000100:00100000:0.0:1788876628.083739:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532257408:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.083756:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083764:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083773:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083779:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.083792:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.083870:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3664:x1875771532256896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 61525us (61610us total) trans 8589934806 rc 0/0 00000100:00100000:0.0:1788876628.083878:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00010000:00010000:0.0:1788876628.083894:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.083899:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084210:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.084213:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084221:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084234:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084242:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084257:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.084259:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.084261:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876628.084356:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532261504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788876628.084398:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.084456:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532261504 00000100:00100000:0.0:1788876628.084461:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532261504 00000100:00100000:0.0:1788876628.084493:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1788876628.084500:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:3662:x1875771532261504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.084520:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:558 count 1 00010000:00010000:0.0:1788876628.084538:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084554:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 60 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084562:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22e:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.084566:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.084571:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084592:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 60 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084619:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 60 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.084631:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532261632:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.084671:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.084713:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313a823e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ad3 expref: 60 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.084723:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17045:1875771532259200:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.084741:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084750:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084757:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084765:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084772:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.084786:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.084867:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3665:x1875771532259072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39653us (39754us total) trans 8589934807 rc 0/0 00000100:00100000:0.0:1788876628.084875:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00010000:00010000:0.0:1788876628.084892:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.084897:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086330:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1caa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.086336:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086348:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086368:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086376:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aabb0712/0xf5bf0f7e313ae6a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086402:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.086404:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.086407:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.086433:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532261376:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.086485:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.086526:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532261376 00000100:00100000:0.0:1788876628.086532:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532261376 00000100:00100000:0.0:1788876628.086568:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1788876628.086576:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3665:x1875771532261376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.086597:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:557 count 1 00010000:00010000:0.0:1788876628.086629:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086651:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 59 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086658:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22d:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.086662:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.086667:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086695:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 59 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.086707:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 59 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.086719:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532261760:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.086749:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca0403c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788876628.086783:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3659c00/2, rc 0, transno 8589934807 00000100:00100000:0.0:1788876628.086793:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532259072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.087366:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3663:x1875771532258688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43795us (46508us total) trans 8589934804 rc 0/0 00000100:00100000:3.0:1788876628.087379:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00010000:00010000:3.0:1788876628.087530:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038c200f4/0xf5bf0f7e313a831e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b27 expref: 59 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.087550:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532260352:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.087579:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087593:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087638:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087652:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087662:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087690:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.087848:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3665:x1875771532260224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33628us (33778us total) trans 8589934808 rc 0/0 00000100:00100000:3.0:1788876628.087855:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00010000:00010000:3.0:1788876628.087886:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f7bf867/0xf5bf0f7e313a82ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047afd expref: 58 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.087898:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532259968:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.087910:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087919:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087926:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087934:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087942:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.087955:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788876628.088014:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3663:x1875771532259840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34881us (34960us total) trans 8589934809 rc 0/0 00000100:00100000:3.0:1788876628.088021:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00010000:00010000:3.0:1788876628.088694:0:43963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d61c28/0xf5bf0f7e313a8126 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a6a expref: 62 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.088709:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532258304:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.088723:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088732:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088739:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088748:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088756:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088766:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788876628.088855:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+27:3664:x1875771532258048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 51021us (56013us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1788876628.088862:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00010000:00010000:3.0:1788876628.088892:0:43962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313a82e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b12 expref: 61 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.088908:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532260736:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.088920:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088929:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088936:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088944:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088953:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.088961:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1788876628.089016:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+27:3663:x1875771532260480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34420us (34558us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788876628.089022:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00010000:00010000:3.0:1788876628.089061:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062dba18e/0xf5bf0f7e313a8196 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a94 expref: 60 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.089072:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532258560:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.089083:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089092:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089100:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089108:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089115:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089123:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:3.0:1788876628.089181:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3664:x1875771532258176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48837us (55437us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788876628.089187:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00010000:00010000:3.0:1788876628.089238:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000765b1c57/0xf5bf0f7e313a8356 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b3c expref: 59 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.089250:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532260992:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.089262:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089276:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089283:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089292:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089299:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089308:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:3.0:1788876628.089366:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3663:x1875771532260608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34598us (34839us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788876628.089372:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00010000:00010000:3.0:1788876628.089400:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313a815e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047a7f expref: 57 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.089411:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532258816:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.089423:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089431:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089439:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089447:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089454:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089463:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:3.0:1788876628.089528:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3663:x1875771532258432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48548us (51038us total) trans 8589934810 rc 0/0 00000100:00100000:3.0:1788876628.089535:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00010000:00010000:3.0:1788876628.089561:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1bfb38/0xf5bf0f7e313a8206 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047abe expref: 58 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.089572:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532259712:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.089583:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089591:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089599:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089628:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089636:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.089645:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00000100:00100000:3.0:1788876628.089700:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3665:x1875771532259328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43595us (43645us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788876628.089706:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1788876628.089757:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532261888:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.089788:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788876628.089827:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785f800/2, rc 0, transno 4294967516 00000100:00100000:3.0:1788876628.089837:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532260608:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089846:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785d180/2, rc 0, transno 4294967514 00000100:00100000:3.0:1788876628.089850:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532260480:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089858:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785f480/2, rc 0, transno 8589934809 00000100:00100000:3.0:1788876628.089862:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532259840:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876628.089869:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed7100/2, rc 0, transno 8589934810 00000100:00100000:3.0:1788876628.089873:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532258432:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876628.089897:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad39500/2, rc 0, transno 4294967511 00000100:00100000:3.0:1788876628.089901:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532255744:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089914:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785ca80/2, rc 0, transno 8589934808 00000100:00100000:3.0:1788876628.089918:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260224:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876628.089925:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c93100/2, rc 0, transno 4294967517 00000100:00100000:3.0:1788876628.089928:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532259328:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089945:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd05180/2, rc 0, transno 4294967515 00000100:00100000:3.0:1788876628.089949:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532258176:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089956:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed4700/2, rc 0, transno 4294967513 00000100:00100000:3.0:1788876628.089960:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532258048:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.089968:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed7800/2, rc 0, transno 8589934806 00000100:00100000:3.0:1788876628.089971:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532256896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.096761:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532261888 00000100:00100000:0.0:1788876628.096776:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532261888 00000100:00100000:0.0:1788876628.096825:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1788876628.096834:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3663:x1875771532261888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.096865:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:460 count 1 00010000:00010000:0.0:1788876628.096890:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.096925:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.096934:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1cc:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.096939:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.096943:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.096978:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.096991:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.097006:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532262016:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.097095:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040180 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.097112:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788876628.097119:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097128:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097133:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097143:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097162:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097170:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000024a6cd3/0xf5bf0f7e313ae6c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097202:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788876628.097206:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097213:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cae00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097216:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097223:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097233:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097240:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6b792b7/0xf5bf0f7e313ae6bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097258:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788876628.097263:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097270:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbe00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097274:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097281:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097292:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097300:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313ae68a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097313:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876628.097317:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097323:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097327:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097333:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097341:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097348:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae6c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097360:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876628.097365:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097370:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097373:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097380:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097389:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097396:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313ae691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097408:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876628.097412:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097418:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097421:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097428:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097436:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097442:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae6d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097454:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876628.097458:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097464:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cac00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.097466:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097473:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097483:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097490:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cf514d/0xf5bf0f7e313ae698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.097495:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.097501:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.097501:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097503:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.097505:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.097509:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.097511:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.097518:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.097528:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.097535:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313ae6b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.097551:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532262144:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.097554:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.097556:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.097558:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.097592:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.097653:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262144 00000100:00100000:0.0:1788876628.097658:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262144 00000100:00100000:0.0:1788876628.097682:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1788876628.097689:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3664:x1875771532262144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.097702:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:559 count 1 00010000:00010000:0.0:1788876628.097715:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097743:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 56 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097752:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22f:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.097755:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.097759:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097777:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 56 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097786:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 56 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.097795:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.097797:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532262784:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.097804:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532262528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.097830:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.097832:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d34bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.097844:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262528 00000100:00100000:0.0:1788876628.097847:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262528 00000100:00100000:3.0:1788876628.097849:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788876628.097855:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532262400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.097871:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1788876628.097874:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.097877:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3663:x1875771532262528:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.097887:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532263040:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.097890:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:559 count 1 00010000:00010000:0.0:1788876628.097902:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.097904:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.097914:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 57 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.097921:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22f:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.097923:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22f:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1788876628.097925:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262400 00010000:00010000:0.0:1788876628.097927:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.097928:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262400 00010000:00010000:0.0:1788876628.097946:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 57 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.097947:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532263040 00000100:00100000:3.0:1788876628.097949:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532263040 00010000:00010000:0.0:1788876628.097956:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 57 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.097963:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1788876628.097966:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:43956:1875771532263168:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.097968:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3663:x1875771532262400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876628.097978:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:558 count 1 00000100:00100000:0.0:1788876628.097990:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc840 going to sleep for 11 seconds 00010000:00010000:3.0:1788876628.097990:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.098001:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 57 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098002:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262272:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.098008:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22e:0x0].0x0 since=64s v=(0 0) 00010000:00010000:3.0:1788876628.098011:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.098016:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098026:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876628.098034:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 57 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098041:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262912:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.098044:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 57 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.098053:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532263296:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.098060:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.098073:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76840 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.098076:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876628.098081:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262656:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.098085:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262272 00000100:00100000:3.0:1788876628.098088:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262272 00000100:00100000:0.0:1788876628.098101:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.098106:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262912 00000100:00100000:3.0:1788876628.098109:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262912 00000100:00100000:3.0:1788876628.098119:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532262656 00000100:00100000:3.0:1788876628.098121:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532262656 00000100:00100000:0.0:1788876628.098123:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1788876628.098129:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3663:x1875771532263040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.098131:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1788876628.098135:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:3665:x1875771532262272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.098141:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:463 count 1 00002000:00080000:3.0:1788876628.098143:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:557 count 1 00010000:00010000:0.0:1788876628.098152:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.098152:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098164:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 57 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.098164:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 57 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098172:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1cf:0x0].0x0 since=69s v=(0 0) 00010000:00010000:3.0:1788876628.098172:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22d:0x0].0x0 since=64s v=(0 0) 00010000:00010000:0.0:1788876628.098176:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.098176:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.098181:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.098181:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098217:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 57 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098228:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 57 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098237:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532263424:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.098260:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.098279:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1788876628.098285:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3665:x1875771532262912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.098297:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:462 count 1 00010000:00010000:0.0:1788876628.098308:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098318:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 57 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098324:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ce:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.098327:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.098330:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098347:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 57 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098355:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 57 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098363:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532263552:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.098383:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.098399:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1788876628.098405:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3665:x1875771532262656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.098417:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:461 count 1 00010000:00010000:0.0:1788876628.098427:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098438:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 57 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098444:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1cd:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.098446:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.098450:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098469:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 57 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.098478:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 57 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.098488:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532263680:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.098509:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.098646:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532263808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.098669:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.098730:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532263936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.098752:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.098797:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532264064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.098818:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.105774:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3662:x1875771532259456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 59877us (59922us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788876628.105790:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788876628.105820:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532263808 00000100:00100000:1.0:1788876628.105828:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532263808 00000100:00100000:1.0:1788876628.105858:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532263936 00000100:00100000:1.0:1788876628.105861:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532263936 00000100:00100000:1.0:1788876628.105869:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532264064 00000100:00100000:1.0:1788876628.105872:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532264064 00000100:00100000:1.0:1788876628.105884:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1788876628.105891:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3663:x1875771532263808:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.106294:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 57 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106314:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 57 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.106330:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532264192:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.106413:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76480 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.106443:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1788876628.106456:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+33:3664:x1875771532263936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876628.106486:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:462 count 1 00010000:00010000:3.0:1788876628.106517:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106540:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 56 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106551:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ce:0x0].0x0 since=70s v=(0 0) 00010000:00010000:3.0:1788876628.106557:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.106564:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106595:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 56 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106641:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 56 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.106657:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532264320:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.106711:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.106736:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1788876628.106744:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3665:x1875771532264064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876628.106760:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:463 count 1 00010000:00010000:3.0:1788876628.106778:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106795:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 56 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106805:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1cf:0x0].0x0 since=70s v=(0 0) 00010000:00010000:3.0:1788876628.106809:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.106814:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106841:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 56 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.106858:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 56 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.106879:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532264448:192.168.203.11@tcp:104: 00002000:00080000:1.0:1788876628.107184:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:461 count 1 00010000:00010000:1.0:1788876628.107219:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.107237:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 56 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.107247:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1cd:0x0].0x0 since=70s v=(0 0) 00010000:00010000:1.0:1788876628.107251:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.107255:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.107291:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 56 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.107311:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 56 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.107325:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532264576:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.107387:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.107663:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223900 going to sleep for 11 seconds 00000004:00080000:2.0:1788876628.110654:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c92d80/2, rc 0, transno 4294967512 00000100:00100000:2.0:1788876628.110682:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532259456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.111082:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532264704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.111144:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876628.111199:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532264704 00000100:00100000:2.0:1788876628.111205:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532264704 00000100:00100000:2.0:1788876628.111246:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1788876628.111255:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3662:x1875771532264704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.111283:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:464 count 1 00010000:00010000:2.0:1788876628.111310:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.111335:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.111343:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d0:0x0].0x0 since=70s v=(0 0) 00010000:00010000:2.0:1788876628.111348:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.111352:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.111378:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.111390:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.111402:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532264832:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.111460:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.118489:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.118501:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532261120:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.118509:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.118527:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118537:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.118556:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.118557:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219584 00000100:00100000:1.0:1788876628.118562:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219584 00000100:00100000:3.0:1788876628.118586:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.118595:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 58 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118633:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219840 00000100:00100000:1.0:1788876628.118636:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219840 00000100:00100000:3.0:1788876628.118640:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.118648:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 57 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118652:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.118660:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219712 00000100:00100000:1.0:1788876628.118662:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219712 00010000:00010000:1.0:1788876628.118673:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 58 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118675:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.118684:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511219968 00000100:00100000:1.0:1788876628.118687:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511219968 00010000:00010000:1.0:1788876628.118698:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 59 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220096 00000100:00100000:1.0:1788876628.118711:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220096 00000100:00100000:3.0:1788876628.118720:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.118721:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 60 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118731:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.118732:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220224 00000100:00100000:1.0:1788876628.118735:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220224 00000100:00100000:3.0:1788876628.118743:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.118745:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 59 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118755:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220352 00000100:00100000:1.0:1788876628.118757:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220352 00010000:00010000:1.0:1788876628.118767:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 61 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118778:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220480 00000100:00100000:1.0:1788876628.118780:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220480 00010000:00010000:1.0:1788876628.118791:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 60 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118794:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532263296:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.118802:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220736 00000100:00100000:1.0:1788876628.118803:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220736 00010000:00010000:3.0:1788876628.118810:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.118813:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 61 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220608 00000100:00100000:1.0:1788876628.118826:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220608 00000100:00100000:3.0:1788876628.118832:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532264192:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.118835:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 62 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.118844:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118845:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220864 00000100:00100000:1.0:1788876628.118846:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220864 00010000:00010000:1.0:1788876628.118856:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 63 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118863:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:43962:1875771532264320:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.118870:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00010000:00010000:3.0:1788876628.118873:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.118878:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+63:2396:x1875771511219584:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.118891:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.118896:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 63 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118915:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532262016:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.118928:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118949:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532261632:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.118960:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.118980:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1788876628.118987:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+61:2396:x1875771511219840:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.118996:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119001:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 61 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119014:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 61 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119038:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f8eac8/0xf5bf0f7e313a838e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b51 expref: 61 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119053:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22c:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119057:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22c:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119063:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119074:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119095:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119136:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+60:2396:x1875771511219840:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 150us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119144:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1788876628.119160:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:3.0:1788876628.119166:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+59:2396:x1875771511219712:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119173:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119178:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 59 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119188:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 59 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119215:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313a846e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047ba5 expref: 59 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119225:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22e:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119228:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22e:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119232:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119245:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119261:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119279:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+58:2396:x1875771511219712:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 113us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119285:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:3.0:1788876628.119298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1788876628.119305:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+57:2396:x1875771511219968:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119313:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119318:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 57 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119328:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 57 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119339:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22d:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119343:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22d:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119348:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119356:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119368:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119384:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+57:2396:x1875771511219968:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 80us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119390:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1788876628.119402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:3.0:1788876628.119408:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+56:2395:x1875771511220096:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119415:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119420:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119430:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119442:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055841085/0xf5bf0f7e313a598e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b91 expref: 56 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119451:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cc:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119454:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cc:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119458:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119466:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119480:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119497:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+55:2395:x1875771511220096:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 89us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:3.0:1788876628.119519:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:3.0:1788876628.119525:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+63:2395:x1875771511220224:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119533:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119538:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 63 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119548:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 63 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119561:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119564:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22f:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119568:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119577:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119587:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119626:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+63:2395:x1875771511220224:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 101us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119633:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:3.0:1788876628.119644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:3.0:1788876628.119650:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+54:2395:x1875771511220352:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119659:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119665:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 54 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119675:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 54 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119686:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119689:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22f:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119694:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119701:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119712:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119727:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+54:2395:x1875771511220352:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 77us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:3.0:1788876628.119744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1788876628.119750:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+62:2395:x1875771511220480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119757:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119762:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 62 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119772:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 62 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119789:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000465f6f45/0xf5bf0f7e313a8436 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b90 expref: 62 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119799:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22e:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119802:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22e:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119806:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119814:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119829:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+61:2395:x1875771511220480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 93us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119849:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:3.0:1788876628.119861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1788876628.119867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+60:2395:x1875771511220736:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119874:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119879:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 60 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119889:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 60 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119906:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.119909:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ce:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.119913:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119920:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119931:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.119948:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+60:2395:x1875771511220736:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 81us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.119954:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1788876628.119966:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:3.0:1788876628.119972:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+59:2395:x1875771511220608:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.119979:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.119984:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 59 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.119993:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 59 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.119998:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 59 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.120004:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876628.120007:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cf:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1788876628.120008:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788876628.120011:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cc:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1788876628.120011:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120015:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120024:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.120025:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120036:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876628.120036:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.120048:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+59:2395:x1875771511220608:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 77us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.120060:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+59:2396:x1875771511219584:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1184us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.120067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:1.0:1788876628.120101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:1.0:1788876628.120108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+58:2395:x1875771511220864:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.120115:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313a5956 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046b7c expref: 58 pid: 17045 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120116:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.120121:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 58 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120132:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 57 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.120132:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532261248:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.120144:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788876628.120146:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120147:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1cd:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1788876628.120151:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120155:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120158:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120163:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.120169:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876628.120172:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120180:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.120181:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+57:2395:x1875771511220864:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 74us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.120188:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00010000:00010000:2.0:1788876628.120210:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.120360:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+33:3665:x1875771532260096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 58214us (66194us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788876628.120367:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00010000:00010000:2.0:1788876628.120418:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37c8097/0xf5bf0f7e313a83fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b7b expref: 53 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.120429:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532261760:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.120443:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120452:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120460:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120469:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120477:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120492:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876628.120576:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532261376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34000us (34090us total) trans 8589934811 rc 0/0 00000100:00100000:2.0:1788876628.120583:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00010000:00010000:2.0:1788876628.120629:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876628.120636:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120644:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.120649:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120665:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120677:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120685:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae6de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120701:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.120705:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120711:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.120714:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120722:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120731:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120738:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313ae6ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120756:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.120758:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.120760:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.120951:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120960:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120968:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120976:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.120991:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.121065:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+34:3662:x1875771532261504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36564us (36666us total) trans 8589934812 rc 0/0 00000100:00100000:2.0:1788876628.121071:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00010000:00010000:1.0:1788876628.121084:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121097:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788876628.121101:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fac0aa00/2, rc 0, transno 8589934812 00010000:00010000:1.0:1788876628.121105:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.121111:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532261504:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.121112:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121126:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876628.121133:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121142:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121150:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121157:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121164:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788876628.121204:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532260864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66116us (66159us total) trans 8589934813 rc 0/0 00000100:00100000:1.0:1788876628.121211:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1788876628.121250:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+33:3663:x1875771532262400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23279us (23373us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788876628.121257:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00010000:00010000:2.0:1788876628.121277:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121285:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121293:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121300:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121307:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:2.0:1788876628.121367:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3663:x1875771532261888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24534us (31577us total) trans 8589934814 rc 0/0 00000100:00100000:2.0:1788876628.121376:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00010000:00010000:2.0:1788876628.121400:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788876628.121405:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121412:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.121416:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121423:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121436:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121442:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4877758/0xf5bf0f7e313ae6e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121456:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876628.121460:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121466:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.121469:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121480:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121490:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121497:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae6d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121503:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.121507:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121510:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.121513:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.121514:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121517:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121520:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.121523:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121526:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121531:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121536:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121539:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121545:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313ae708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121547:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313ae6f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.121557:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.121558:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.121560:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.121563:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.121564:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.121566:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788876628.121591:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd04000/2, rc 0, transno 4294967519 00000100:00100000:2.0:1788876628.121621:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532262400:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876628.121633:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fac08e00/2, rc 0, transno 8589934814 00000100:00100000:2.0:1788876628.121636:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532261888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788876628.121683:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532264960:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.121713:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876628.121750:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532264960 00000100:00100000:2.0:1788876628.121756:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532264960 00000100:00100000:2.0:1788876628.121789:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1788876628.121797:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3663:x1875771532264960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.121818:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:451 count 1 00010000:00010000:2.0:1788876628.121837:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121852:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 56 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121859:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c3:0x0].0x0 since=70s v=(0 0) 00010000:00010000:2.0:1788876628.121863:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.121867:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121895:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 56 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.121908:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 56 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.121919:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532265088:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.121972:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.125467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:3.0:1788876628.125792:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.125813:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.125829:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.125843:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.125862:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.125898:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532264448:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.125923:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.125966:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532264832:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.125993:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.126013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221120 00000100:00100000:3.0:1788876628.126018:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221120 00010000:00010000:3.0:1788876628.126091:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 53 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.126116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221376 00000100:00100000:3.0:1788876628.126119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221376 00010000:00010000:3.0:1788876628.126132:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 56 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.126144:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511220992 00000100:00100000:3.0:1788876628.126146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511220992 00010000:00010000:3.0:1788876628.126158:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 57 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.126168:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221248 00000100:00100000:3.0:1788876628.126171:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221248 00010000:00010000:3.0:1788876628.126182:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 54 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.126189:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532264576:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.126214:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.126288:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221504 00000100:00100000:1.0:1788876628.126292:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221504 00010000:00010000:1.0:1788876628.126310:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 55 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.126327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:1.0:1788876628.126334:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c6679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+55:2396:x1875771511221120:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.126349:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.126355:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 55 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126366:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 55 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126388:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313a5a6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046be5 expref: 55 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126403:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.126407:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.126412:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126421:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126445:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.126483:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:2.0:1788876628.126492:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+57:2396:x1875771511221376:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788876628.126493:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c6679450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+54:2396:x1875771511221120:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 159us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.126500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00010000:00010000:2.0:1788876628.126502:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.126507:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126516:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126530:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046bec5cb/0xf5bf0f7e313a5b16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c24 expref: 57 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.126535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00010000:00010000:2.0:1788876628.126540:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1788876628.126541:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+56:2396:x1875771511220992:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.126543:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.126547:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126548:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.126553:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 56 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126562:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126563:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 56 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.126576:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058972f39/0xf5bf0f7e313a83c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047b66 expref: 56 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126579:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.126591:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22d:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788876628.126594:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22d:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1788876628.126598:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.126598:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+55:2396:x1875771511221376:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 108us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.126620:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:2.0:1788876628.126635:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:2.0:1788876628.126642:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+53:2396:x1875771511221504:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.126649:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.126654:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 53 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126663:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 53 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126675:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077897ec5/0xf5bf0f7e313a59fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bbb expref: 53 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126684:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.126688:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.126692:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126705:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126721:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.126738:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+52:2396:x1875771511221504:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 97us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.126745:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00010000:00010000:2.0:1788876628.126777:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126786:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126797:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126807:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.126821:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.126977:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+34:3662:x1875771532264704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15723us (15832us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788876628.126985:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00010000:00010000:1.0:1788876628.126996:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.127014:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.127283:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+54:2396:x1875771511220992:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 740us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.127291:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00010000:00010000:1.0:1788876628.127312:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.127321:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.127330:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.127339:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.127360:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876628.127451:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:3664:x1875771532263936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20999us (28697us total) trans 8589934815 rc 0/0 00000100:00100000:1.0:1788876628.127459:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00010000:00010000:1.0:1788876628.128168:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.128181:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.128205:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.128214:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.128947:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788876628.129148:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3663:x1875771532263808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23253us (30475us total) trans 8589934816 rc 0/0 00000100:00100000:1.0:1788876628.129156:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00010000:00010000:1.0:1788876628.129186:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876628.129208:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129218:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.129409:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129429:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129446:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129455:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129477:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.129481:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129487:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.129490:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129497:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129507:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129515:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae72b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129535:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.129539:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129546:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.129549:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129558:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129567:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129575:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae739 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129587:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.129589:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.129591:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.129645:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c47ebb80/2, rc 0, transno 4294967520 00000100:00100000:1.0:1788876628.129659:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532264704:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.129679:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129695:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129705:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129714:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129727:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.129819:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbe9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532262272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31682us (31790us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788876628.129826:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000004:00080000:1.0:1788876628.129901:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3034e00/2, rc 0, transno 8589934816 00000100:00100000:1.0:1788876628.129907:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532263808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.129920:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.129925:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129933:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.129937:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129945:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129957:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129965:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae70f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.129990:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.129992:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.129994:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.130270:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313a84a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bba expref: 53 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.130283:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:43956:1875771532263168:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.130304:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130314:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130322:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130331:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130338:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130354:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.130437:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3663:x1875771532262528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32558us (32605us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788876628.130444:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00010000:00010000:0.0:1788876628.130475:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015977028/0xf5bf0f7e313a5aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bfa expref: 52 pid: 8455 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.130486:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532263424:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.130498:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130507:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130515:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130524:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130531:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130540:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876628.130626:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3663:x1875771532263040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32496us (32720us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788876628.130633:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00010000:00010000:0.0:1788876628.130661:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000058ae0d5/0xf5bf0f7e313a5a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046bd0 expref: 51 pid: 8456 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.130672:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8456:1875771532263552:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.130684:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130692:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130700:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130708:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130716:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130724:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788876628.130781:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532262912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32496us (32719us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788876628.130788:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00010000:00010000:0.0:1788876628.130815:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc2d4ec/0xf5bf0f7e313a59c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ba6 expref: 50 pid: 10319 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.130826:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532263680:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.130836:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130851:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130858:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130867:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130874:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.130883:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788876628.130939:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3665:x1875771532262656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32533us (32837us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788876628.130945:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000004:00080000:0.0:1788876628.130972:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd06300/2, rc 0, transno 4294967525 00000100:00100000:0.0:1788876628.130982:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262656:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876628.130991:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd07100/2, rc 0, transno 4294967521 00000100:00100000:0.0:1788876628.130994:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262272:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876628.131002:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd04700/2, rc 0, transno 4294967524 00000100:00100000:0.0:1788876628.131005:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532262912:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876628.131015:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fac08000/2, rc 0, transno 8589934811 00000100:00100000:0.0:1788876628.131019:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532261376:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.131028:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785fb80/2, rc 0, transno 8589934813 00000100:00100000:0.0:1788876628.131032:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260864:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.131041:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785e680/2, rc 0, transno 4294967518 00000100:00100000:0.0:1788876628.131044:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532260096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131049:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876628.131060:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131093:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788876628.131130:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3036d80/2, rc 0, transno 8589934815 00000100:00100000:0.0:1788876628.131135:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532263936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.131222:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265344:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.131223:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532265472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131245:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.131264:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.131269:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876628.131274:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.131279:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876628.131284:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532265600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131294:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.131322:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265216 00000100:00100000:1.0:1788876628.131328:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265216 00000004:00080000:0.0:1788876628.131349:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3658a80/2, rc 0, transno 4294967523 00000100:00100000:0.0:1788876628.131355:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532263040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.131357:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265344 00000100:00100000:1.0:1788876628.131359:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265344 00000004:00080000:0.0:1788876628.131364:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13cfd07b80/2, rc 0, transno 4294967522 00000100:00100000:0.0:1788876628.131368:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532262528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.131374:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265472 00000100:00100000:1.0:1788876628.131376:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265472 00000100:00100000:1.0:1788876628.131391:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265728 00000100:00100000:1.0:1788876628.131393:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265728 00000100:00100000:0.0:1788876628.131407:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.131409:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1788876628.131416:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+37:3665:x1875771532265216:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131427:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788876628.131440:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:465 count 1 00000100:00100000:0.0:1788876628.131450:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876628.131456:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532265984:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.131460:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131474:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.131480:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.131488:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d1:0x0].0x0 since=70s v=(0 0) 00010000:00010000:1.0:1788876628.131493:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876628.131494:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265856 00000100:00100000:0.0:1788876628.131497:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265856 00010000:00010000:1.0:1788876628.131497:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131515:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265984 00000100:00100000:0.0:1788876628.131518:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265984 00010000:00010000:1.0:1788876628.131522:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131530:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1788876628.131535:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3665:x1875771532265344:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.131535:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876628.131547:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:466 count 1 00000100:00100000:1.0:1788876628.131547:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532266112:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.131559:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131570:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 49 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131575:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d2:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.131578:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.131581:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131599:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 49 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131616:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.131625:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 49 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131631:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1788876628.131634:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532266240:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.131638:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3662:x1875771532265472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.131649:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:467 count 1 00000100:00100000:0.0:1788876628.131657:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82780 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.131660:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131671:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00010000:00010000:1.0:1788876628.131671:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 49 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131678:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+39:3665:x1875771532265728:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.131683:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d3:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.131687:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00002000:00080000:0.0:1788876628.131688:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:469 count 1 00010000:00010000:1.0:1788876628.131690:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131697:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131707:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 49 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.131707:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 49 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131714:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d5:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.131717:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.131717:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131721:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131727:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532266368:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.131737:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 49 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131745:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 49 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131748:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223300 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.131755:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532266496:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.131762:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788876628.131769:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+39:3665:x1875771532265856:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.131775:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82b40 going to sleep for 11 seconds 00002000:00080000:1.0:1788876628.131779:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:470 count 1 00000100:00100000:0.0:1788876628.131788:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00010000:00010000:1.0:1788876628.131790:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.131793:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3663:x1875771532265984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.131802:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 49 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876628.131803:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:471 count 1 00010000:00010000:1.0:1788876628.131809:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d6:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.131812:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.131812:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.131816:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131828:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 49 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131835:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d7:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.131835:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 49 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131838:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.131841:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.131844:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 49 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131853:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532266624:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.131857:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 49 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131865:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 49 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.131873:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.131874:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:43956:1875771532266752:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.131892:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82180 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.131917:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876628.131923:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131930:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.131935:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131944:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131959:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131966:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d5d49f2/0xf5bf0f7e313ae701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131981:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876628.131985:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.131991:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.131994:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132000:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132010:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132017:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7b70432/0xf5bf0f7e313ae716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132020:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.132030:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876628.132033:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132040:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.132044:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132050:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532265600 00010000:00010000:0.0:1788876628.132051:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132053:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532265600 00010000:00010000:0.0:1788876628.132060:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132068:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba49acb8/0xf5bf0f7e313ae71d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132073:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1788876628.132078:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3662:x1875771532265600:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.132082:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.132085:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.132089:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:468 count 1 00010000:00010000:0.0:1788876628.132091:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.132094:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.132099:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132102:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.132111:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 49 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132112:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.132118:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d4:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.132120:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053fcf65b/0xf5bf0f7e313ae724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.132121:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.132125:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132131:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.132133:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.132135:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.132146:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.132149:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 49 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.132158:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 49 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132166:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf71d2cb/0xf5bf0f7e313a84de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bcf expref: 51 pid: 8453 timeout: 1715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132167:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532266880:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.132177:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532262784:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.132208:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223540 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.132209:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132218:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132225:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132233:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132240:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132257:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.132357:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3664:x1875771532262144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34669us (34764us total) trans 8589934817 rc 0/0 00000100:00100000:0.0:1788876628.132363:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000004:00080000:0.0:1788876628.132460:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fac0a680/2, rc 0, transno 8589934817 00000100:00100000:0.0:1788876628.132464:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532262144:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.132473:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.132477:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132483:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.132486:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132493:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132502:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132509:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313ae6fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132521:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.132522:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.132524:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.132560:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532267008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.132581:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.132668:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267008 00000100:00100000:0.0:1788876628.132672:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267008 00000100:00100000:0.0:1788876628.132691:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:0.0:1788876628.132698:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3663:x1875771532267008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.132709:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:464 count 1 00010000:00010000:0.0:1788876628.132721:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132733:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 50 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132740:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d0:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.132743:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.132747:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132748:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532267136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.132765:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 50 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132772:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.132775:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 50 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.132785:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532267264:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.132809:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.132820:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267136 00000100:00100000:1.0:1788876628.132820:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532267392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.132823:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267136 00000100:00100000:1.0:1788876628.132842:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.132845:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1788876628.132851:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3664:x1875771532267136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.132861:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:465 count 1 00010000:00010000:0.0:1788876628.132872:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132883:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 50 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132885:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532267520:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.132890:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d1:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.132893:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.132897:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.132906:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.132914:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 50 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.132923:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 50 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.132933:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532267648:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.132939:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876628.132945:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532267776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.132955:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.132964:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.133003:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532267904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.133024:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876628.133162:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.133545:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:3.0:1788876628.133555:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2396:x1875771511221248:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.133565:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.133572:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133586:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133621:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba74eebb/0xf5bf0f7e313a5ade lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c0f expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133633:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.133636:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1cf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.133642:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133650:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133670:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.133692:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2396:x1875771511221248:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 139us (7848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.133699:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00010000:00010000:3.0:1788876628.133720:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133730:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133740:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133749:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.133762:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.133856:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3665:x1875771532264064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27113us (35037us total) trans 8589934818 rc 0/0 00000100:00100000:3.0:1788876628.133864:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1788876628.136185:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267392 00000100:00100000:0.0:1788876628.136517:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267392 00000100:00100000:0.0:1788876628.136573:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267520 00000100:00100000:0.0:1788876628.136577:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267520 00000100:00100000:0.0:1788876628.136587:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267776 00000100:00100000:0.0:1788876628.136589:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267776 00000100:00100000:0.0:1788876628.136618:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1788876628.136628:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3665:x1875771532267392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.136656:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:466 count 1 00010000:00010000:0.0:1788876628.136682:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136703:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 48 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136712:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d2:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.136717:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.136721:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136754:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 48 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136767:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 48 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.136781:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532268032:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.136848:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.136873:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1788876628.136879:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3662:x1875771532267520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.136892:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:467 count 1 00010000:00010000:0.0:1788876628.136902:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136913:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 48 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136920:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d3:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.136923:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.136927:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136945:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 48 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.136954:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 48 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.136964:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532268160:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.136985:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82300 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.137061:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.137068:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137076:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.137081:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137091:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137109:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137117:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313ae732 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137133:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.137135:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.137137:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.137148:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1788876628.137155:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3662:x1875771532267776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.137167:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:468 count 1 00010000:00010000:0.0:1788876628.137177:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137189:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 48 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137207:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d4:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.137210:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.137214:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137239:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 48 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.137248:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 48 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.137257:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532268288:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.137279:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82480 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.139335:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532267904 00000100:00100000:0.0:1788876628.139348:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532267904 00000100:00100000:0.0:1788876628.139385:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1788876628.139393:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3664:x1875771532267904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.139420:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:451 count 1 00010000:00010000:0.0:1788876628.139443:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139461:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 48 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139469:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1c3:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.139473:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.139477:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139508:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 48 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139520:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 48 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.139525:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.139534:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532268416:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.139587:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82000 going to sleep for 11 seconds 00000004:00080000:0.0:1788876628.139669:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f41cea00/2, rc 0, transno 8589934818 00000100:00100000:0.0:1788876628.139677:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532264064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.139732:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532268544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.139763:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.139810:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876628.139818:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532268672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.139834:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221632 00000100:00100000:1.0:1788876628.139838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221632 00000100:00100000:0.0:1788876628.139843:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.139861:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.139863:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532268544 00000100:00100000:0.0:1788876628.139865:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532268544 00000100:00100000:0.0:1788876628.139879:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532268672 00000100:00100000:0.0:1788876628.139882:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532268672 00000100:00100000:1.0:1788876628.139889:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:0.0:1788876628.139893:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1788876628.139895:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2397:x1875771511221632:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788876628.139898:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+41:3665:x1875771532268544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.139909:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:469 count 1 00010000:00010000:0.0:1788876628.139921:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139933:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 48 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139946:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d5:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.139949:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.139953:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.139965:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.139972:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 48 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.139972:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.139982:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 48 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.139985:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.139991:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532268800:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.140004:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.140007:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.140012:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.140017:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82540 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.140021:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.140031:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1788876628.140038:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+41:3663:x1875771532268672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.140050:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:470 count 1 00010000:00010000:0.0:1788876628.140061:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.140073:0:43966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 48 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.140080:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d6:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.140083:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.140087:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140097:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876628.140103:0:43966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 48 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.140112:0:43966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 48 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.140119:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2397:x1875771511221632:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 224us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.140121:0:43966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532268928:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.140127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:0.0:1788876628.140141:0:43966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d34bb9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.140210:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e9cda1e/0xf5bf0f7e313a5566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a02 expref: 49 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.140229:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532265088:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.140248:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140257:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140264:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140273:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140281:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.140305:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.140441:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3663:x1875771532264960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18644us (18727us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788876628.140449:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000004:00080000:1.0:1788876628.140476:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785ce00/2, rc 0, transno 4294967526 00000100:00100000:1.0:1788876628.140487:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532264960:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.140529:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.140555:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.140583:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532269056 00000100:00100000:1.0:1788876628.140587:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532269056 00000100:00100000:1.0:1788876628.142142:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1788876628.142158:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3663:x1875771532269056:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.142182:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:472 count 1 00010000:00010000:1.0:1788876628.142213:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.142230:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 48 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.142238:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d8:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.142242:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.142246:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.142274:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 48 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.142285:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 48 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.142299:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532269184:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.142351:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.146338:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.146351:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.146365:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.146370:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.146382:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.146405:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.146414:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313ae747 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.146438:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.146439:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.146441:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.150951:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.151121:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532266112:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.151147:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.151182:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221760 00000100:00100000:3.0:1788876628.151188:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221760 00010000:00010000:3.0:1788876628.151229:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.151266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:3.0:1788876628.151275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2397:x1875771511221760:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.151289:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.151295:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151307:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151330:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfb44461/0xf5bf0f7e313a5b86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c4e expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151344:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.151348:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.151355:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151364:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151394:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.151438:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+48:2397:x1875771511221760:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 164us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.151446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00010000:00010000:0.0:1788876628.151567:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.151578:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.151588:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.151596:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.151638:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.151779:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+42:3665:x1875771532265216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20362us (20684us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788876628.151787:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000004:00080000:0.0:1788876628.151822:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785d500/2, rc 0, transno 4294967527 00000100:00100000:0.0:1788876628.151834:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265216:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.151957:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.151965:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151972:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.151977:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151986:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.151999:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.152006:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae74e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.152030:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.152032:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.152034:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.152440:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876628.152453:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532269312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.152487:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876628.152548:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532269312 00000100:00100000:2.0:1788876628.152554:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532269312 00000100:00100000:2.0:1788876628.152589:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1788876628.152597:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+42:3665:x1875771532269312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.152636:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:473 count 1 00010000:00010000:2.0:1788876628.152655:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.152669:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.152677:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1d9:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.152681:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.152685:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.152710:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.152722:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.152734:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532269440:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.152778:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.152987:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153007:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153025:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153043:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153058:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153075:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153086:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153099:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153111:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153126:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.153140:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511221888 00000100:00100000:2.0:1788876628.153144:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511221888 00010000:00010000:2.0:1788876628.153162:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 49 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153178:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222144 00000100:00100000:2.0:1788876628.153181:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222144 00010000:00010000:2.0:1788876628.153205:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 48 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153217:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222400 00000100:00100000:2.0:1788876628.153220:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222400 00010000:00010000:2.0:1788876628.153229:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 49 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153239:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222656 00000100:00100000:2.0:1788876628.153241:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222656 00010000:00010000:2.0:1788876628.153249:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 50 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153258:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222912 00000100:00100000:2.0:1788876628.153260:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222912 00010000:00010000:2.0:1788876628.153269:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 51 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153278:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222016 00000100:00100000:2.0:1788876628.153280:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222016 00010000:00010000:2.0:1788876628.153288:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 50 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153297:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222272 00000100:00100000:2.0:1788876628.153299:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222272 00010000:00010000:2.0:1788876628.153306:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 51 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153315:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222528 00000100:00100000:2.0:1788876628.153317:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222528 00010000:00010000:2.0:1788876628.153325:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 52 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153334:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511222784 00000100:00100000:2.0:1788876628.153336:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511222784 00010000:00010000:2.0:1788876628.153344:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 53 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153352:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223040 00000100:00100000:2.0:1788876628.153354:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223040 00010000:00010000:2.0:1788876628.153362:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 52 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.153373:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:2.0:1788876628.153379:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+52:2396:x1875771511221888:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153388:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153393:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 52 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153403:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 52 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153420:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153423:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153429:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153438:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153451:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.153473:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+52:2396:x1875771511221888:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 94us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.153480:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:2.0:1788876628.153516:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:2.0:1788876628.153521:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+53:2396:x1875771511222144:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153528:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153532:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 53 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153543:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 53 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153555:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153558:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153563:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153571:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153581:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.153596:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+53:2396:x1875771511222144:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 75us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.153626:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:2.0:1788876628.153640:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:2.0:1788876628.153647:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+52:2396:x1875771511222400:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153654:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153658:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 52 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153668:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 52 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153679:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153682:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153686:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153699:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153710:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.153728:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+52:2396:x1875771511222400:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 81us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.153734:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:2.0:1788876628.153747:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:2.0:1788876628.153753:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2396:x1875771511222656:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153761:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153766:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 51 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153776:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 51 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153788:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153791:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153795:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153803:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153813:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.153829:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2396:x1875771511222656:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 76us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.153835:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:2.0:1788876628.153846:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:2.0:1788876628.153851:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2396:x1875771511222912:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153857:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153862:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153872:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 50 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153882:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153885:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153889:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153897:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153907:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.153921:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2396:x1875771511222912:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 70us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.153927:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:2.0:1788876628.153938:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:2.0:1788876628.153944:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2396:x1875771511222016:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.153951:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.153955:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 51 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153965:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 51 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153976:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153979:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.153983:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.153991:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154001:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.154015:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2396:x1875771511222016:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 72us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.154021:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:2.0:1788876628.154031:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:2.0:1788876628.154037:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2396:x1875771511222272:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.154043:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.154047:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 50 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154057:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 50 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154068:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154071:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154076:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154084:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154093:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.154107:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2396:x1875771511222272:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 71us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.154113:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:2.0:1788876628.154124:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:2.0:1788876628.154130:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c6679c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2396:x1875771511222528:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.154136:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.154140:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 49 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154151:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 49 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154161:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154164:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154168:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154181:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154204:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.154221:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c6679c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2396:x1875771511222528:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 91us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.154227:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:2.0:1788876628.154247:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:2.0:1788876628.154253:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+48:2396:x1875771511222784:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.154260:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.154265:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 48 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154275:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 48 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154286:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154289:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154293:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154301:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154312:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.154324:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+48:2396:x1875771511222784:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 71us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.154329:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:2.0:1788876628.154341:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:2.0:1788876628.154346:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2396:x1875771511223040:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.154353:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.154357:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 49 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154367:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 49 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154378:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154380:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.154385:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154392:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.154402:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.154413:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2396:x1875771511223040:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 67us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.154418:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00010000:00010000:0.0:1788876628.154723:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe977f45/0xf5bf0f7e313a5bbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c63 expref: 48 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.154742:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532267648:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.154760:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.154769:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.154777:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.154787:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.154794:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.154814:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.154941:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3664:x1875771532267136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22089us (22167us total) trans 8589934819 rc 0/0 00000100:00100000:0.0:1788876628.154949:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00010000:00010000:0.0:1788876628.154977:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049999109/0xf5bf0f7e313a5bf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c78 expref: 47 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.154988:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532266240:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.154999:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155008:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155015:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155023:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155031:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155043:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876628.155112:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3665:x1875771532265344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23575us (23865us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788876628.155118:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00010000:00010000:0.0:1788876628.155145:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6581252/0xf5bf0f7e313a5c2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c8d expref: 47 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.155155:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532268032:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.155165:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155179:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155186:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155210:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155217:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155227:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788876628.155266:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fff329f/0xf5bf0f7e313a5c66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ca2 expref: 46 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.155283:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532266368:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.155286:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+42:3665:x1875771532267392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18660us (22442us total) trans 8589934820 rc 0/0 00000100:00100000:0.0:1788876628.155291:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00010000:00010000:1.0:1788876628.155295:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155303:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155309:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155316:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313a5c9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cb7 expref: 46 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155318:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155326:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.155327:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532268160:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.155334:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788876628.155338:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155345:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155352:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155360:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155367:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155376:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788876628.155406:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3662:x1875771532265472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23768us (24139us total) trans 4294967529 rc 0/0 00000100:00100000:1.0:1788876628.155412:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1788876628.155437:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3662:x1875771532267520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18558us (22530us total) trans 8589934821 rc 0/0 00010000:00010000:1.0:1788876628.155439:0:43962:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313a5db6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d20 expref: 45 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.155443:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1788876628.155450:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532266624:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.155460:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155467:0:43963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313a5d46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046cf6 expref: 44 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155469:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155477:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.155478:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532266496:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.155486:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155487:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155494:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155496:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155502:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1788876628.155503:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155511:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155518:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155526:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788876628.155561:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+44:3665:x1875771532265856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23793us (24132us total) trans 4294967530 rc 0/0 00000100:00100000:1.0:1788876628.155567:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1788876628.155578:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+43:3665:x1875771532265728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23901us (24283us total) trans 4294967531 rc 0/0 00000100:00100000:0.0:1788876628.155583:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00010000:00010000:1.0:1788876628.155595:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000988aade4/0xf5bf0f7e313a5cd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ccc expref: 43 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.155619:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532266880:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.155621:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313a5e26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d4a expref: 42 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155630:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.155631:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:43956:1875771532266752:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.155640:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155643:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155649:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155651:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155656:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155659:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155663:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155666:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155671:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.155675:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1788876628.155679:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:1.0:1788876628.155733:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3662:x1875771532265600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23653us (23711us total) trans 4294967532 rc 0/0 00000100:00100000:0.0:1788876628.155735:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3663:x1875771532265984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23942us (24260us total) trans 4294967533 rc 0/0 00000100:00100000:1.0:1788876628.155739:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1788876628.155742:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00010000:00010000:0.0:1788876628.155766:0:43953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b252041e/0xf5bf0f7e313a5b4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046c39 expref: 45 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.155772:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed6300/2, rc 0, transno 8589934821 00000100:00100000:0.0:1788876628.155775:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532267264:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.155783:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532267520:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.155787:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.155793:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3037800/2, rc 0, transno 4294967532 00010000:00010000:0.0:1788876628.155795:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155801:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.155802:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532265600:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.155810:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3036a00/2, rc 0, transno 4294967529 00010000:00010000:0.0:1788876628.155811:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.155813:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532265472:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.155818:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155827:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000004:00080000:1.0:1788876628.155831:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fb800/2, rc 0, transno 4294967533 00000100:00100000:1.0:1788876628.155834:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532265984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.155890:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3663:x1875771532267008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23193us (23308us total) trans 8589934822 rc 0/0 00000100:00100000:0.0:1788876628.155897:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000004:00080000:0.0:1788876628.155923:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785f100/2, rc 0, transno 8589934819 00000100:00100000:1.0:1788876628.155923:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269824:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.155926:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532267136:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.155930:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876628.155937:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532269568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.155953:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.155957:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788876628.155963:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.155971:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.155976:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.155980:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35faa00/2, rc 0, transno 8589934822 00000100:00100000:1.0:1788876628.155983:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532267008:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.155985:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.155990:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.155994:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269696:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.155998:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156006:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313ae786 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156013:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.156028:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788876628.156032:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156039:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52000 already unused, calling callback (ffffffffc0cf24f0) 00000100:00100000:1.0:1788876628.156039:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532269824 00010000:00010000:0.0:1788876628.156042:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156043:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532269824 00010000:00010000:0.0:1788876628.156049:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156059:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156066:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2dd37b/0xf5bf0f7e313ae755 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156067:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532269696 00000100:00100000:1.0:1788876628.156069:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532269696 00010000:00010000:0.0:1788876628.156079:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:1.0:1788876628.156083:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00010000:00010000:0.0:1788876628.156084:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156090:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:3663:x1875771532269824:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.156091:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156094:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156105:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.156109:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:475 count 1 00010000:00010000:0.0:1788876628.156114:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156120:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae78d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156126:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156132:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788876628.156135:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156138:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 41 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156141:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156145:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156146:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1db:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.156150:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.156151:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156154:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156160:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156166:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313ae75c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156174:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 41 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156182:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788876628.156185:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156205:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 41 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156206:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156209:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156217:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156217:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532269952:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.156226:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156233:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae794 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156244:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876628.156247:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156252:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223240 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.156253:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156257:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156264:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.156270:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156280:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156284:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532269568 00010000:00010000:0.0:1788876628.156287:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313ae76a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156287:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532269568 00010000:00010000:0.0:1788876628.156299:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876628.156302:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156306:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00010000:00010000:0.0:1788876628.156309:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156312:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156312:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3663:x1875771532269696:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.156320:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.156322:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:452 count 1 00010000:00010000:0.0:1788876628.156329:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156332:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156337:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012c786ca/0xf5bf0f7e313ae763 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156342:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156350:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c4:0x0].0x0 since=70s v=(0 0) 00010000:00010000:1.0:1788876628.156353:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.156354:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876628.156356:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156357:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156364:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156367:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156373:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156374:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156384:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156389:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 41 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156392:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313ae778 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156398:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532270080:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.156403:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876628.156406:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156412:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.156415:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156418:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb2230c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876628.156428:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.156431:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1788876628.156437:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3664:x1875771532269568:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.156438:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156445:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001047b313/0xf5bf0f7e313ae771 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.156447:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:474 count 1 00010000:00010000:0.0:1788876628.156456:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.156456:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156459:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156466:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.156467:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156469:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156474:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1da:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.156477:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156477:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.156481:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156486:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156493:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313ae77f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156497:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.156507:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 41 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.156509:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.156511:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.156513:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.156522:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532270208:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.156545:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223180 going to sleep for 11 seconds 00010000:00010000:2.0:1788876628.156579:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.156633:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532270592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.156659:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.156927:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.156958:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788876628.156982:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785c000/2, rc 0, transno 8589934820 00000100:00100000:3.0:1788876628.156991:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532267392:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876628.157000:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9c00/2, rc 0, transno 4294967530 00000100:00100000:3.0:1788876628.157007:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265856:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.157015:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13d3035180/2, rc 0, transno 4294967531 00000100:00100000:3.0:1788876628.157018:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265728:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.157025:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f41cdc00/2, rc 0, transno 4294967528 00000100:00100000:3.0:1788876628.157028:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532265344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.157036:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876628.157041:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.157061:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.157083:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270592 00000100:00100000:1.0:1788876628.157088:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270592 00000100:00100000:1.0:1788876628.157108:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270464 00000100:00100000:1.0:1788876628.157110:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270464 00000100:00100000:1.0:1788876628.157123:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270336 00000100:00100000:1.0:1788876628.157125:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270336 00000100:00100000:1.0:1788876628.157140:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1788876628.157147:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3662:x1875771532270592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.157159:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:473 count 1 00010000:00010000:1.0:1788876628.157173:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.157174:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270976:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.157186:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 44 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.157206:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d9:0x0].0x0 since=69s v=(0 0) 00000100:00100000:3.0:1788876628.157209:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.157210:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.157213:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.157226:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876628.157231:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.157233:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 44 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.157243:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 44 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.157251:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.157253:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532271104:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.157269:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.157287:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223840 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.157300:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270976 00000100:00100000:1.0:1788876628.157303:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270976 00000100:00100000:1.0:1788876628.157319:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270848 00000100:00100000:1.0:1788876628.157322:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270848 00000100:00100000:3.0:1788876628.157538:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1788876628.157546:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3665:x1875771532270464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876628.157558:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:472 count 1 00010000:00010000:3.0:1788876628.157570:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.157582:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 44 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.157589:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d8:0x0].0x0 since=69s v=(0 0) 00010000:00010000:3.0:1788876628.157593:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.157596:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.157651:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 44 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.157660:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 44 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.157670:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532271360:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.157696:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.159471:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532270720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.159546:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.159583:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.159592:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532271232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.159667:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.159712:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532270720 00000100:00100000:1.0:1788876628.159720:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532270720 00000100:00100000:1.0:1788876628.159752:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532271232 00000100:00100000:1.0:1788876628.159756:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532271232 00000100:00100000:1.0:1788876628.159771:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1788876628.159779:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3665:x1875771532270336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.159802:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:471 count 1 00010000:00010000:1.0:1788876628.159824:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.159840:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 44 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.159853:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d7:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.159857:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.159861:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.159889:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 44 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.159900:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 44 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.159909:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532271488:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.159950:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.159966:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1788876628.159973:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532270976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.159986:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:478 count 1 00010000:00010000:1.0:1788876628.160000:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.160320:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788876628.160331:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532270848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.160345:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:477 count 1 00010000:00010000:2.0:1788876628.160357:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.160369:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 41 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.160376:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1dd:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.160379:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.160383:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.160403:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 41 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.160414:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 41 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.160425:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532271616:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.160461:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.160492:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:43964:1875771532269440:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.160511:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.160784:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1788876628.160793:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+48:3663:x1875771532270720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.160806:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:476 count 1 00010000:00010000:0.0:1788876628.160817:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160828:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 41 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160836:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1dc:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.160839:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.160843:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160860:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 41 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160870:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 41 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.160879:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532271744:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.160909:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.160924:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1788876628.160931:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3663:x1875771532271232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.160943:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:474 count 1 00010000:00010000:0.0:1788876628.160955:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160966:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 44 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160973:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1da:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.160976:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1da:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.160980:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.160999:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 44 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.161008:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 44 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.161018:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532271872:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.161038:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.161126:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532268800:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.161139:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.161163:0:43966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532268928:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.161174:0:43966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.161823:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532269184:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.161841:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.164302:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.164315:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1de:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.164320:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.164326:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.164368:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 41 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.164381:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 41 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.164396:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532272000:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.164466:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.164747:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532268288:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.164767:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.164868:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164888:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164902:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164933:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164953:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164968:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.164992:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.165016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223680 00000100:00100000:1.0:1788876628.165019:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.165025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223680 00000100:00100000:1.0:1788876628.165043:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876628.165071:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 45 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165092:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.165099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223808 00000100:00100000:3.0:1788876628.165103:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223808 00000100:00100000:1.0:1788876628.165108:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876628.165119:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 46 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165129:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.165142:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223296 00000100:00100000:3.0:1788876628.165145:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223296 00010000:00010000:3.0:1788876628.165161:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 47 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165166:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.165181:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223552 00000100:00100000:3.0:1788876628.165184:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223552 00010000:00010000:3.0:1788876628.165212:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 42 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165227:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223168 00000100:00100000:3.0:1788876628.165230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223168 00010000:00010000:3.0:1788876628.165242:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 48 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165243:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223424 00000100:00100000:1.0:1788876628.165250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223424 00000100:00100000:3.0:1788876628.165259:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511223936 00000100:00100000:3.0:1788876628.165263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511223936 00010000:00010000:1.0:1788876628.165274:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 44 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165281:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 44 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165297:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224064 00000100:00100000:3.0:1788876628.165301:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224192 00000100:00100000:1.0:1788876628.165303:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224064 00000100:00100000:3.0:1788876628.165306:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224192 00010000:00010000:3.0:1788876628.165325:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 46 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165331:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 46 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165337:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224320 00000100:00100000:3.0:1788876628.165341:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224320 00010000:00010000:3.0:1788876628.165355:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 49 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165360:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224576 00000100:00100000:1.0:1788876628.165369:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224576 00000100:00100000:3.0:1788876628.165373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224448 00000100:00100000:3.0:1788876628.165377:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224448 00010000:00010000:1.0:1788876628.165388:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 51 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165397:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 51 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165407:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224704 00000100:00100000:1.0:1788876628.165412:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224704 00000100:00100000:3.0:1788876628.165419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00010000:00010000:1.0:1788876628.165429:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 47 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165431:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2398:x1875771511223680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.165446:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.165453:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 51 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165456:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:1.0:1788876628.165468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+51:2398:x1875771511223808:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.165471:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 51 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165480:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.165487:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 51 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165496:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313a5d0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ce1 expref: 51 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165515:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 50 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165518:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.165526:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.165534:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165545:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165549:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.165557:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.165564:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165569:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.165579:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165632:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+50:2398:x1875771511223680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 204us (762us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876628.165640:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.165640:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:3.0:1788876628.165666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:3.0:1788876628.165674:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2395:x1875771511223296:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788876628.165683:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+49:2398:x1875771511223808:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 211us (787us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.165685:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.165694:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 49 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00010000:00010000:3.0:1788876628.165710:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 49 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165726:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdc5afdc/0xf5bf0f7e313a5dee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d35 expref: 48 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165736:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00010000:00010000:3.0:1788876628.165737:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.165742:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.165747:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.165749:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+47:2395:x1875771511223552:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.165764:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165765:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.165775:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165787:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165801:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.165816:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020d8ae0e/0xf5bf0f7e313a5f06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d9e expref: 47 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165825:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+47:2395:x1875771511223296:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 150us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.165837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00010000:00010000:1.0:1788876628.165842:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.165850:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1788876628.165854:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00010000:00010000:1.0:1788876628.165861:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.165865:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c667bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+46:2395:x1875771511223168:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.165877:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.165881:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.165885:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 46 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.165929:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.165962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+46:2395:x1875771511223552:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 213us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.165971:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:1.0:1788876628.165996:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:1.0:1788876628.166008:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+45:2395:x1875771511223424:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.166021:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.166030:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 45 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166043:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 45 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166066:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000735f6f7c/0xf5bf0f7e313a5e96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d74 expref: 45 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166087:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166091:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166097:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166106:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166115:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 46 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166133:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045fbfcef/0xf5bf0f7e313a5d7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d0b expref: 46 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166142:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876628.166145:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.166150:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.166155:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166173:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.166174:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+44:2395:x1875771511223424:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 163us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876628.166205:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00010000:00010000:3.0:1788876628.166212:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.166224:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:1.0:1788876628.166233:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+43:2395:x1875771511223936:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788876628.166238:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c667bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+45:2395:x1875771511223168:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 372us (1280us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876628.166243:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788876628.166249:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00010000:00010000:1.0:1788876628.166253:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 43 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166266:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 43 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166283:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166286:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166291:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.166295:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00010000:00010000:1.0:1788876628.166305:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166318:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.166319:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+43:2398:x1875771511224192:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.166329:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.166336:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 43 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.166342:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+43:2395:x1875771511223936:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 109us (1346us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.166354:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 43 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.166355:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00010000:00010000:3.0:1788876628.166372:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1788876628.166377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00010000:00010000:3.0:1788876628.166379:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1da:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.166386:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.166390:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+42:2398:x1875771511224064:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.166402:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166404:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788876628.166404:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532271616:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.166412:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 42 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.166425:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.166428:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 42 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166429:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.166444:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166447:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.166451:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.166459:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+42:2398:x1875771511224192:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 152us (1414us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876628.166475:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.166475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00010000:00010000:1.0:1788876628.166491:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.166493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1788876628.166503:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+44:2395:x1875771511224320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.166512:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788876628.166518:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+41:2398:x1875771511224064:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (1496us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.166521:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 44 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.166530:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00010000:00010000:3.0:1788876628.166542:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 44 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166555:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.166559:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.166564:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166573:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.166586:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.166623:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+44:2395:x1875771511224320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 101us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.166655:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532271744:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.166671:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.166694:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532271872:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.166706:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166736:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c600b149/0xf5bf0f7e313a559e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a17 expref: 44 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.166748:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532268416:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.166760:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166769:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166782:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166793:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166800:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.166816:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.166965:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3664:x1875771532267904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27572us (33937us total) trans 8589934823 rc 0/0 00000100:00100000:0.0:1788876628.166972:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000004:00080000:0.0:1788876628.167010:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed5880/2, rc 0, transno 8589934823 00000100:00100000:0.0:1788876628.167022:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532267904:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876628.167036:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.167042:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.167050:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.167055:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.167064:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.167077:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.167085:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae7a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.167102:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.167104:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.167106:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.170772:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:43959:1875771532271488:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.170802:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170837:0:43958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009080284d/0xf5bf0f7e313a5f3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046db3 expref: 43 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.170853:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532271104:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.170864:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170873:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170881:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170894:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170902:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.170929:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.171108:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3662:x1875771532270592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13959us (14446us total) trans 8589934824 rc 0/0 00000100:00100000:0.0:1788876628.171118:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00010000:00010000:0.0:1788876628.171160:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000094a6d82/0xf5bf0f7e313a5f76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046dc8 expref: 40 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.171171:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532270208:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.171183:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171203:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171211:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171220:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171228:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171243:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876628.171320:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3664:x1875771532269568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14882us (15054us total) trans 4294967534 rc 0/0 00000100:00100000:0.0:1788876628.171327:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00010000:00010000:0.0:1788876628.171354:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009896eddc/0xf5bf0f7e313a55d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a2c expref: 39 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.171365:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532270080:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.171377:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171386:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171393:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171401:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171409:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171422:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1788876628.171484:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3663:x1875771532269696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15171us (15470us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1788876628.171491:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00010000:00010000:0.0:1788876628.171518:0:43961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6f5740/0xf5bf0f7e313a5fe6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046df2 expref: 38 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.171529:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532269952:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.171538:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171546:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171552:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171558:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171564:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.171571:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1788876628.171648:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+49:3663:x1875771532269824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15558us (15693us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1788876628.171654:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1788876628.173909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1788876628.173935:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+42:2395:x1875771511224576:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.173956:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.173966:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 42 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.173984:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 42 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174008:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b18cd19/0xf5bf0f7e313a5e5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d5f expref: 42 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174026:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174030:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174037:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174046:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174081:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.174128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+41:2395:x1875771511224576:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 206us (9019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.174136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1788876628.174166:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:2.0:1788876628.174173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+40:2395:x1875771511224448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.174182:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.174187:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 40 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174211:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 40 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174227:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174230:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174233:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174240:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174250:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.174268:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+40:2395:x1875771511224448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 96us (9143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.174275:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:2.0:1788876628.174292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:2.0:1788876628.174299:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+37:2395:x1875771511224704:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.174308:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.174314:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 37 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174324:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 37 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174335:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a03e7aa/0xf5bf0f7e313a60c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e46 expref: 37 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174345:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174347:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.174351:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174357:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174375:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876628.174393:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174402:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174417:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174425:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.174435:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1788876628.174591:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+49:3665:x1875771532270848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14262us (17337us total) trans 4294967537 rc 0/0 00000100:00100000:2.0:1788876628.174598:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788876628.174659:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2395:x1875771511224704:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 360us (9496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.174666:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:1.0:1788876628.175433:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532272128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.175479:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.175541:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed7480/2, rc 0, transno 4294967535 00000100:00100000:1.0:1788876628.175555:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.175555:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532272128 00000100:00100000:2.0:1788876628.175562:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532272128 00000004:00080000:1.0:1788876628.175566:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797f100/2, rc 0, transno 4294967536 00000100:00100000:1.0:1788876628.175570:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269824:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.175595:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797ea00/2, rc 0, transno 8589934824 00000100:00100000:2.0:1788876628.175597:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1788876628.175620:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532270592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788876628.175621:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3663:x1875771532272128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876628.175645:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:475 count 1 00010000:00010000:2.0:1788876628.175667:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.175679:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.175684:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 39 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.175688:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.175692:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1db:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.175696:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.175697:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.175710:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.175719:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:1.0:1788876628.175825:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3663:x1875771532269056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33673us (35267us total) trans 4294967538 rc 0/0 00000100:00100000:1.0:1788876628.175832:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000004:00080000:1.0:1788876628.175860:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed6d80/2, rc 0, transno 4294967538 00000100:00100000:1.0:1788876628.175867:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532269056:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.175900:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532272512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.175928:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.175961:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532272512 00000100:00100000:1.0:1788876628.175964:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532272512 00000100:00100000:1.0:1788876628.175988:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1788876628.175993:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3662:x1875771532272512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.176004:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:481 count 1 00010000:00010000:1.0:1788876628.176018:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176029:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 35 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176043:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e1:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.176046:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.176050:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176073:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 35 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176085:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 35 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.176096:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532272640:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.176138:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223f00 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.176156:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176165:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176173:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176181:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176200:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788876628.176270:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+50:3665:x1875771532269312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23673us (23780us total) trans 4294967539 rc 0/0 00000100:00100000:1.0:1788876628.176276:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1788876628.176481:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532272768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.176504:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.176535:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532272768 00000100:00100000:1.0:1788876628.176538:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532272768 00000100:00100000:1.0:1788876628.176559:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:1.0:1788876628.176565:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3663:x1875771532272768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.176579:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:476 count 1 00010000:00010000:1.0:1788876628.176592:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176625:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 39 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176634:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1dc:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.176637:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.176641:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176662:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 39 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.176673:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 39 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.176683:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532272896:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.176716:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb2236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.178003:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.178043:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.178067:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224832 00000100:00100000:1.0:1788876628.178072:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224832 00010000:00010000:1.0:1788876628.178101:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 36 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.178121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511224960 00000100:00100000:1.0:1788876628.178124:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511224960 00010000:00010000:1.0:1788876628.178137:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 40 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.178150:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:1.0:1788876628.178157:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2395:x1875771511224832:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.178169:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876628.178174:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 36 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178186:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 36 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178397:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313a6056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e1c expref: 36 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178413:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.178416:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.178422:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178437:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178465:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.178485:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178493:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178502:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178511:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.178520:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1788876628.178678:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178707:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 40 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178718:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 40 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.178722:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+50:3663:x1875771532270720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17930us (19177us total) trans 4294967540 rc 0/0 00000100:00100000:1.0:1788876628.178729:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1788876628.178731:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532273024:192.168.203.11@tcp:104: 00000004:00080000:1.0:1788876628.178770:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7979500/2, rc 0, transno 4294967540 00000100:00100000:1.0:1788876628.178780:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532270720:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876628.178784:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.178799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:2.0:1788876628.178807:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+40:2395:x1875771511224960:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.178815:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.178820:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 40 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178830:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 40 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178842:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd512a83/0xf5bf0f7e313a5fae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ddd expref: 40 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178853:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1da:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.178856:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1da:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.178861:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.178868:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.178883:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2395:x1875771511224832:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 726us (886us total) trans 0 rc 0/0 00010000:00010000:2.0:1788876628.178886:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.178891:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:2.0:1788876628.178902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+39:2395:x1875771511224960:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 97us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.178908:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00010000:00010000:2.0:1788876628.180050:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313a5ece lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046d89 expref: 38 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.180068:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10319:1875771532271360:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.180086:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180096:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180102:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180111:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180124:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180134:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1788876628.180264:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3665:x1875771532270464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22719us (23304us total) trans 8589934825 rc 0/0 00000100:00100000:2.0:1788876628.180272:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00010000:00010000:2.0:1788876628.180294:0:43966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180302:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180309:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180316:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.180323:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00000100:00100000:2.0:1788876628.180391:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+48:3663:x1875771532268672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40354us (40547us total) trans 8589934826 rc 0/0 00000100:00100000:2.0:1788876628.180397:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000004:00080000:1.0:1788876628.180426:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa714a80/2, rc 0, transno 8589934826 00000100:00100000:1.0:1788876628.180445:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532268672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.180577:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532272256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.180632:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.180666:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532273152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.180699:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.180737:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed5180/2, rc 0, transno 4294967534 00000100:00100000:1.0:1788876628.180747:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532269568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.180759:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788876628.180768:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532272384:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.180803:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.180832:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532273280:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.180865:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.181317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000004:00080000:3.0:1788876628.181405:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797ad80/2, rc 0, transno 4294967537 00000100:00100000:3.0:1788876628.181413:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270848:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876628.181429:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797c000/2, rc 0, transno 8589934825 00000100:00100000:3.0:1788876628.181439:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270464:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876628.181449:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7978380/2, rc 0, transno 4294967539 00000100:00100000:3.0:1788876628.181452:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532269312:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.181517:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1788876628.181534:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788876628.181542:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181553:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.181557:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181569:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181588:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181595:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313ae7da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181674:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788876628.181679:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181688:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532272256 00010000:00010000:3.0:1788876628.181694:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00000100:00100000:1.0:1788876628.181700:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532272256 00010000:00010000:3.0:1788876628.181700:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181711:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181723:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181731:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313ae7d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181746:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:1.0:1788876628.181751:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532273152 00010000:00010000:3.0:1788876628.181751:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181757:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532273152 00010000:00010000:3.0:1788876628.181763:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.181767:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181779:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532272384 00000100:00100000:1.0:1788876628.181785:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532272384 00010000:00010000:3.0:1788876628.181794:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.181807:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181816:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532273280 00010000:00010000:3.0:1788876628.181816:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313ae7cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181824:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532273280 00010000:00010000:3.0:1788876628.181837:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788876628.181843:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.181865:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1788876628.181878:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+52:3664:x1875771532272256:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.182069:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182073:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182082:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182094:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182101:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313ae7c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182117:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788876628.182121:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182128:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182132:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182140:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182149:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182157:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313ae7f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182170:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788876628.182174:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182181:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182184:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182203:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182211:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182221:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313ae7b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182234:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876628.182238:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182244:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182247:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182254:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182264:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182270:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae7be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182280:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876628.182284:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182290:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182293:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182304:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182313:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182320:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae7fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182333:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876628.182336:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182341:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182344:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182350:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182358:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182364:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313ae7e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182379:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.182383:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182389:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.182392:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182399:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182409:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182416:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313ae7b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182429:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.182430:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.182432:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.182464:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532272000:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.182483:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.182503:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225088 00000100:00100000:3.0:1788876628.182507:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225088 00010000:00010000:3.0:1788876628.182528:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 35 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.182554:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1788876628.182562:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2398:x1875771511225088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.182573:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.182579:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 35 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182591:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 35 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182627:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313a6136 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e70 expref: 35 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182640:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.182645:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.182651:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182661:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182682:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.182727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2398:x1875771511225088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 165us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.182738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00010000:00010000:3.0:1788876628.182758:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182767:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182794:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182803:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.182816:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.182954:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3665:x1875771532270976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22981us (25743us total) trans 4294967541 rc 0/0 00000100:00100000:3.0:1788876628.182962:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1788876628.182976:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1788876628.182984:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3664:x1875771532273152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876628.182998:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:482 count 1 00010000:00010000:3.0:1788876628.183015:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.183050:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:479 count 1 00010000:00010000:1.0:1788876628.183074:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183096:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183105:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1df:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.183109:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.183114:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183152:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183167:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 33 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.183183:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532273408:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.183259:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb2230c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.183379:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:1.0:1788876628.183391:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+52:3664:x1875771532272384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.183409:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:480 count 1 00010000:00010000:1.0:1788876628.183426:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183440:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 33 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183453:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e0:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.183457:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.183461:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183486:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 33 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183493:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183500:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 33 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183524:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e2:0x0].0x0 since=69s v=(0 0) 00010000:00010000:3.0:1788876628.183530:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1788876628.183533:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532273920:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.183536:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183564:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 33 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183576:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 33 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.183580:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.183593:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532274048:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.183634:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1788876628.183647:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3664:x1875771532273280:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.183656:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00002000:00080000:1.0:1788876628.183668:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:477 count 1 00000004:00080000:3.0:1788876628.183685:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7978700/2, rc 0, transno 4294967541 00010000:00010000:1.0:1788876628.183687:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.183698:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270976:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.183706:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 36 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.183708:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788876628.183720:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1dd:0x0].0x0 since=69s v=(0 0) 00000100:00100000:3.0:1788876628.183721:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532273792:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.183730:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.183737:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.183755:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788876628.183761:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 36 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.183774:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 36 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.183786:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532274176:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.183822:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223840 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.183849:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532273792 00000100:00100000:1.0:1788876628.183856:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532273792 00000100:00100000:3.0:1788876628.183876:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532274304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.183896:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1788876628.183904:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876628.183924:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.183929:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183943:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.183947:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183957:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183971:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.183979:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313ae7ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184010:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.184012:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.184014:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.184176:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184186:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184207:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184221:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184236:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876628.184244:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.184248:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184255:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.184259:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184267:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184279:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184287:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae7a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184302:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.184304:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.184306:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.184407:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+53:3665:x1875771532273792:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.184418:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+49:3665:x1875771532268544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44518us (44652us total) trans 8589934827 rc 0/0 00002000:00080000:1.0:1788876628.184423:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:453 count 1 00000100:00100000:3.0:1788876628.184428:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00010000:00010000:1.0:1788876628.184440:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.184454:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.184461:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c5:0x0].0x0 since=70s v=(0 0) 00000004:00080000:3.0:1788876628.184461:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa714380/2, rc 0, transno 8589934827 00010000:00010000:1.0:1788876628.184469:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.184473:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.184475:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532268544:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.184509:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.184512:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532274304 00000100:00100000:3.0:1788876628.184517:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532274304 00010000:00010000:1.0:1788876628.184523:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 33 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.184534:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532274688:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.184539:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1788876628.184548:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+54:3665:x1875771532274304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876628.184561:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:485 count 1 00000100:00100000:1.0:1788876628.184566:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223540 going to sleep for 11 seconds 00010000:00010000:3.0:1788876628.184574:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.184588:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532273536:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.184589:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.184623:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e5:0x0].0x0 since=69s v=(0 0) 00010000:00010000:3.0:1788876628.184627:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.184632:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.184648:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876628.184656:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 33 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.184668:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532274432:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.184670:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 33 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.184685:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532274816:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.184697:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.184726:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.184735:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788876628.184743:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532273664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.184764:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.184773:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532274560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.184788:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876628.184807:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532273536 00000100:00100000:2.0:1788876628.184811:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532273536 00000100:00100000:1.0:1788876628.184813:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532274432 00000100:00100000:1.0:1788876628.184816:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532274432 00000100:00100000:1.0:1788876628.184830:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532273664 00000100:00100000:2.0:1788876628.184830:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532274560 00000100:00100000:1.0:1788876628.184833:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532273664 00000100:00100000:2.0:1788876628.184833:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532274560 00000100:00100000:1.0:1788876628.184843:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1788876628.184848:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3662:x1875771532273536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.184859:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:483 count 1 00010000:00010000:1.0:1788876628.184872:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.184883:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 33 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.184889:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e3:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.184892:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.184896:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.185523:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.185535:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.185545:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.185554:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.185574:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876628.185672:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.185678:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.185687:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.185691:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.185701:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.185717:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.185725:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313ae7e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.185742:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.185744:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.185746:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.185839:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+51:3665:x1875771532270336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26058us (28774us total) trans 8589934828 rc 0/0 00000100:00100000:2.0:1788876628.185878:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1788876628.185891:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+51:3662:x1875771532274432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876628.185907:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:478 count 1 00010000:00010000:2.0:1788876628.185922:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.185935:0:43966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.185942:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1de:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.185945:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.185949:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.185975:0:43966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.185986:0:43966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.185998:0:43966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532274944:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.186008:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 33 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186018:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 33 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.186026:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532275072:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.186038:0:43966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.186043:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.186054:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.186060:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.186070:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186078:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186092:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186103:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186136:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788876628.186167:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797f800/2, rc 0, transno 8589934828 00000100:00100000:3.0:1788876628.186179:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532270336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.186236:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876628.186247:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532275200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.186282:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.186298:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3662:x1875771532267776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 49137us (53326us total) trans 8589934829 rc 0/0 00000100:00100000:1.0:1788876628.186311:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1788876628.186481:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532275200 00000100:00100000:1.0:1788876628.186487:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532275200 00000100:00100000:1.0:1788876628.186510:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1788876628.186516:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3662:x1875771532274560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.186530:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:452 count 1 00010000:00010000:1.0:1788876628.186542:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186553:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186561:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1c4:0x0].0x0 since=70s v=(0 0) 00010000:00010000:1.0:1788876628.186563:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.186567:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186591:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 36 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186619:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 36 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.186630:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532275328:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.186657:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223240 going to sleep for 11 seconds 00000004:00080000:1.0:1788876628.186681:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eeed4380/2, rc 0, transno 8589934829 00000100:00100000:1.0:1788876628.186691:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532267776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.186718:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1788876628.186727:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+56:3662:x1875771532273664:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876628.186730:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.186735:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788876628.186740:0:43962:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:484 count 1 00010000:00010000:2.0:1788876628.186748:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.186752:0:43962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186752:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186762:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186764:0:43962:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 33 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.186771:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e4:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.186773:0:43962:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.186778:0:43962:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186778:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186786:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313ae79b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186802:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.186803:0:43962:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 33 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.186804:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.186806:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.186812:0:43962:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 33 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.186822:0:43962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532275456:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.186842:0:43962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.186859:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1788876628.186866:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:3665:x1875771532275200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.186877:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:479 count 1 00010000:00010000:1.0:1788876628.186889:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.187556:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532275584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.187593:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876628.187910:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.188003:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.188113:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225216 00000100:00100000:2.0:1788876628.188118:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225216 00010000:00010000:2.0:1788876628.188145:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 34 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188165:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 36 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.188168:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225344 00000100:00100000:2.0:1788876628.188171:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225344 00010000:00010000:1.0:1788876628.188178:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1df:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.188181:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1df:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.188183:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 37 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188186:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.188213:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:2.0:1788876628.188220:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2398:x1875771511225216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.188222:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 37 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188230:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.188235:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 34 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188238:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 37 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188247:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 34 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.188248:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532275712:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.188266:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.188269:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.188274:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188284:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.188285:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223300 going to sleep for 11 seconds 00010000:00010000:2.0:1788876628.188298:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.188308:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532272896:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.188317:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2398:x1875771511225216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.188323:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00010000:00010000:1.0:1788876628.188325:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.188338:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:2.0:1788876628.188344:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+37:2398:x1875771511225344:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.188351:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.188357:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 37 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188368:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 37 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.188375:0:10319:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 18 min 3 max 116 00000100:00100000:1.0:1788876628.188381:0:10319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_018' 00010000:00010000:2.0:1788876628.188381:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc99fbd/0xf5bf0f7e313a608e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e31 expref: 37 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188392:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.188396:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.188399:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188406:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188414:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.188421:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.188422:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188432:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188440:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.188441:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2398:x1875771511225344:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 97us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.188447:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00010000:00010000:1.0:1788876628.188453:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.188581:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3663:x1875771532271232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27650us (28915us total) trans 8589934830 rc 0/0 00000100:00100000:1.0:1788876628.188588:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1788876628.188621:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532275584 00000100:00100000:1.0:1788876628.188625:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532275584 00000100:00100000:1.0:1788876628.188643:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1788876628.188649:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3665:x1875771532275584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.188666:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:480 count 1 00010000:00010000:1.0:1788876628.188684:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188696:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 35 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188702:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e0:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.188705:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.188708:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188726:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 35 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188735:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 35 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.188744:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532275840:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.188776:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.188790:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788876628.188797:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7978000/2, rc 0, transno 8589934830 00010000:00010000:1.0:1788876628.188798:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.188804:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532271232:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.188806:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188813:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.188836:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1788876628.190019:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3663:x1875771532272768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13448us (13508us total) trans 8589934831 rc 0/0 00000100:00100000:1.0:1788876628.190029:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000004:00080000:1.0:1788876628.190093:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25a680/2, rc 0, transno 8589934831 00000100:00100000:1.0:1788876628.190100:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532272768:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.190121:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876628.190130:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003892a438/0xf5bf0f7e313a6286 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eee expref: 33 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190131:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190154:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.190160:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.190161:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532272640:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.190177:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190182:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190207:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190215:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190225:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190233:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.190249:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876628.190313:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190323:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae804 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190346:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.190350:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190357:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.190361:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190369:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190379:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190386:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313ae819 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190404:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.190408:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190415:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.190418:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190425:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190436:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.190443:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313ae812 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.190445:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3662:x1875771532272512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14450us (14519us total) trans 4294967542 rc 0/0 00000100:00100000:3.0:1788876628.190460:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00010000:00010000:1.0:1788876628.190468:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.190472:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.190474:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.190482:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.190502:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25b480/2, rc 0, transno 4294967542 00000100:00100000:3.0:1788876628.190513:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:43953:1875771532273024:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.190518:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532272512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876628.190530:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.190591:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532276096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.190626:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876628.190636:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532276224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.190667:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876628.191621:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.193279:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.193329:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876628.193339:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532275968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.193364:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876628.193398:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532276224 00000100:00100000:1.0:1788876628.193405:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532276224 00000100:00100000:1.0:1788876628.193440:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532276096 00000100:00100000:1.0:1788876628.193442:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532276096 00000100:00100000:3.0:1788876628.193442:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532275968 00000100:00100000:3.0:1788876628.193449:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532275968 00000100:00100000:1.0:1788876628.193457:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1788876628.193467:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532276224:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.193485:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00002000:00080000:1.0:1788876628.193494:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:482 count 1 00000100:00100000:3.0:1788876628.193495:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3663:x1875771532276096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876628.193513:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:481 count 1 00010000:00010000:1.0:1788876628.193522:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.193528:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.193555:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 35 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.193555:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 35 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.193576:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e1:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.193577:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e2:0x0].0x0 since=69s v=(0 0) 00010000:00010000:3.0:1788876628.193584:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.193585:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.193593:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.193594:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.193655:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 35 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.193655:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 35 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.193685:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 35 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.193686:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 35 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.193715:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532276352:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.193717:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532276480:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.194059:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.194274:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1788876628.194356:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c1254780 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.194554:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1788876628.194570:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3663:x1875771532275968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.194587:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:486 count 1 00010000:00010000:0.0:1788876628.194619:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.194635:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 32 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.194649:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e6:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.194652:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.194657:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.194679:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 32 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.194691:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 32 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.194702:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532276608:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.194745:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.196958:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.197026:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225472 00000100:00100000:2.0:1788876628.197034:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225472 00010000:00010000:2.0:1788876628.197067:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 36 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.197104:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:2.0:1788876628.197112:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2395:x1875771511225472:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.197124:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.197130:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 36 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.197144:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 36 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.197167:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002663c8d0/0xf5bf0f7e313a601e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e07 expref: 36 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.197182:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.197187:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1db:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.197203:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.197214:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.197248:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.197298:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2395:x1875771511225472:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 186us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.197305:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 254 00010000:00010000:0.0:1788876628.197403:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197413:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197425:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197434:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197453:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.197497:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.197533:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.197553:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.197595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225600 00000100:00100000:0.0:1788876628.197639:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3663:x1875771532272128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22017us (22157us total) trans 8589934832 rc 0/0 00000100:00100000:0.0:1788876628.197647:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1788876628.197665:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225600 00010000:00010000:0.0:1788876628.197668:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876628.197675:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197683:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876628.197687:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197690:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 33 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197704:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.197709:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532273920:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.197719:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.197720:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225728 00000100:00100000:3.0:1788876628.197725:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225728 00010000:00010000:0.0:1788876628.197730:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d21cb8e/0xf5bf0f7e313ae80b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.197731:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197742:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.197750:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.197753:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.197756:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.197760:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532274176:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.197761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225856 00000100:00100000:3.0:1788876628.197767:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225856 00010000:00010000:1.0:1788876628.197774:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788876628.197778:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa780e00/2, rc 0, transno 8589934832 00000100:00100000:0.0:1788876628.197790:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532272128:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.197855:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 35 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.197858:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532276736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.197882:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:3.0:1788876628.197891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2397:x1875771511225600:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788876628.197899:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788876628.197905:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.197912:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197930:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197946:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876628.197949:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532276736 00010000:00010000:3.0:1788876628.197950:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1df:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876628.197955:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532276736 00010000:00010000:3.0:1788876628.197957:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197967:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.197984:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.197987:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1788876628.197997:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:3665:x1875771532276736:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.198013:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2397:x1875771511225600:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 122us (515us total) trans 0 rc 0/0 00002000:00080000:0.0:1788876628.198018:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:483 count 1 00000100:00100000:3.0:1788876628.198022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 255 00010000:00010000:0.0:1788876628.198038:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.198052:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 34 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.198060:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e3:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.198063:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.198067:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.198089:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 34 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.198102:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 34 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.198109:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1788876628.198122:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2397:x1875771511225728:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788876628.198123:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532276864:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.198135:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.198143:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198155:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.198168:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb480 going to sleep for 11 seconds 00010000:00010000:3.0:1788876628.198178:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e5e100f/0xf5bf0f7e313a6216 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ec4 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198201:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.198205:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.198211:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198220:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198244:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.198269:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+33:2397:x1875771511225728:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 151us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.198277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1788876628.198290:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:3.0:1788876628.198296:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+32:2395:x1875771511225856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.198305:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.198310:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 32 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198321:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 32 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198341:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.198345:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.198350:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198359:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198371:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.198398:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+32:2395:x1875771511225856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 102us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.198404:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 257 00010000:00010000:3.0:1788876628.198433:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013dda39a/0xf5bf0f7e313a62f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f18 expref: 31 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.198443:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:43954:1875771532274048:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.198496:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.198505:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.198514:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.198521:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198532:0:43961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008feffb98/0xf5bf0f7e313a61a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e9a expref: 30 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.198538:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.198544:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:43961:1875771532273408:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.198544:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198559:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198563:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198567:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198583:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198595:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198597:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198627:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198633:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198643:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.198645:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876628.198660:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788876628.198663:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3664:x1875771532272384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15277us (17861us total) trans 4294967543 rc 0/0 00000100:00100000:1.0:1788876628.198670:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:2.0:1788876628.198750:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+59:3664:x1875771532272256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16875us (18118us total) trans 4294967545 rc 0/0 00000100:00100000:2.0:1788876628.198758:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1788876628.198765:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3664:x1875771532273152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15780us (18063us total) trans 4294967544 rc 0/0 00010000:00010000:2.0:1788876628.198790:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876628.198797:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198809:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.198812:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198821:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198832:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198840:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313ae82e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198854:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876628.198858:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198865:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.198868:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198876:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198886:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198893:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1163998/0xf5bf0f7e313ae820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198905:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.198908:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198914:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.198917:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198925:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198934:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198942:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b28ba66d/0xf5bf0f7e313ae827 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.198954:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.198955:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.198957:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876628.199132:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb258700/2, rc 0, transno 4294967543 00000100:00100000:0.0:1788876628.199153:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532272384:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876628.199164:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25ad80/2, rc 0, transno 4294967545 00000100:00100000:0.0:1788876628.199168:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532272256:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1788876628.199175:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25c700/2, rc 0, transno 4294967544 00000100:00100000:0.0:1788876628.199179:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532273152:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876628.199200:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.199312:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00010000:00010000:3.0:1788876628.199341:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.200733:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532274688:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.200761:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.200778:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.200797:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532275072:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.200801:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.200809:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.200830:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511225984 00000100:00100000:1.0:1788876628.200830:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8453:1875771532275328:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.200835:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511225984 00010000:00010000:1.0:1788876628.200840:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.200862:0:43962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:43962:1875771532275456:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.200867:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.200874:0:43962:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.200890:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532274816:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.200893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226112 00000100:00100000:0.0:1788876628.200897:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226112 00000100:00100000:1.0:1788876628.200900:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532275712:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.200912:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 30 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.200912:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.200931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:0.0:1788876628.200939:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2395:x1875771511225984:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.200950:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.200955:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.200964:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.200977:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201000:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313a60fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e5b expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201013:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.201017:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1dd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.201022:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201030:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201057:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.201101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2395:x1875771511225984:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 162us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.201108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:0.0:1788876628.201123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:0.0:1788876628.201129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+30:2395:x1875771511226112:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.201140:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.201145:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 30 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201161:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 30 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201175:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000079acec/0xf5bf0f7e313a5646 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a56 expref: 30 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201184:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.201187:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.201204:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201212:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.201229:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.201248:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+29:2395:x1875771511226112:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.201254:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:2.0:1788876628.201555:0:43966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532274944:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.201571:0:43966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.201722:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532276992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.201761:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.201799:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876628.201805:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532277120:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.201825:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.201855:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532276992 00000100:00100000:0.0:1788876628.201860:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532277248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.201861:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532276992 00000100:00100000:3.0:1788876628.201893:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532277120 00000100:00100000:0.0:1788876628.201897:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876628.201900:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532277120 00000100:00100000:3.0:1788876628.201924:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532277248 00000100:00100000:3.0:1788876628.201928:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532277248 00000100:00100000:2.0:1788876628.201985:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.202005:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202009:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1788876628.202016:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202025:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.202040:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.202057:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.202072:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.202102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226240 00000100:00100000:2.0:1788876628.202106:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226240 00010000:00010000:2.0:1788876628.202124:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 29 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.202135:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202138:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226496 00000100:00100000:2.0:1788876628.202141:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226496 00010000:00010000:1.0:1788876628.202145:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202151:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 30 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202161:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226752 00010000:00010000:1.0:1788876628.202162:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.202163:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226752 00010000:00010000:2.0:1788876628.202171:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 31 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202180:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226368 00000100:00100000:2.0:1788876628.202182:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226368 00010000:00010000:2.0:1788876628.202201:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202212:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226624 00000100:00100000:2.0:1788876628.202215:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226624 00010000:00010000:2.0:1788876628.202225:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 35 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202234:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511226880 00000100:00100000:2.0:1788876628.202236:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511226880 00010000:00010000:2.0:1788876628.202245:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 36 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.202256:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:2.0:1788876628.202261:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+31:2395:x1875771511226240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.202269:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.202274:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 31 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202284:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 31 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202299:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6493989/0xf5bf0f7e313a6446 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f96 expref: 31 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202309:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.202313:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.202317:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202325:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202347:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.202375:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+30:2395:x1875771511226240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.202382:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:2.0:1788876628.202396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:2.0:1788876628.202403:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+29:2395:x1875771511226496:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.202411:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.202416:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202426:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202440:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb54697a/0xf5bf0f7e313a6366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f42 expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202449:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.202453:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.202457:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.202465:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.203447:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3664:x1875771532273280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19796us (22574us total) trans 8589934833 rc 0/0 00000100:00100000:1.0:1788876628.203461:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1788876628.203490:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1788876628.203500:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3662:x1875771532276992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876628.203523:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:487 count 1 00010000:00010000:1.0:1788876628.203544:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203559:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 28 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203566:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e7:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.203569:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788876628.203570:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00010000:00010000:1.0:1788876628.203573:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.203579:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3662:x1875771532277120:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.203611:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 28 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876628.203617:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:488 count 1 00010000:00010000:1.0:1788876628.203625:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 28 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203628:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.203638:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532277376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.203639:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 28 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203645:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e8:0x0].0x0 since=68s v=(0 0) 00010000:00010000:0.0:1788876628.203648:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.203651:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203669:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 28 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203677:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 28 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.203686:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532277504:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.203687:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.203707:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb000 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.203710:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203719:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.203723:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00010000:00010000:1.0:1788876628.203729:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.203730:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3664:x1875771532277248:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876628.203737:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876628.203741:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:489 count 1 00010000:00010000:0.0:1788876628.203752:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203752:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876628.203762:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 28 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203768:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e9:0x0].0x0 since=68s v=(0 0) 00010000:00010000:0.0:1788876628.203770:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.203774:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203791:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 28 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.203799:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 28 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.203809:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532277632:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.203830:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.203880:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+61:3665:x1875771532273792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19974us (20123us total) trans 4294967546 rc 0/0 00000100:00100000:1.0:1788876628.203888:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000004:00080000:1.0:1788876628.203938:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c92680/2, rc 0, transno 8589934833 00000100:00100000:1.0:1788876628.203952:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532273280:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788876628.203967:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876628.203975:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203983:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.203987:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.203997:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.204016:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.204026:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313ae835 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.204934:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.204976:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+28:2395:x1875771511226496:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2568us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.204986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:2.0:1788876628.205056:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:2.0:1788876628.205068:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+27:2395:x1875771511226752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.205080:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.205086:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 27 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205100:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 27 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205121:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf13449a/0xf5bf0f7e313a63d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f6c expref: 27 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205136:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205140:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205146:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205156:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205181:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.205221:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+26:2395:x1875771511226752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 157us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.205228:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 262 00000100:00100000:2.0:1788876628.205242:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 263 00000100:00100000:2.0:1788876628.205249:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2395:x1875771511226368:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.205258:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.205263:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205274:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205288:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001e91b8b/0xf5bf0f7e313a616e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046e85 expref: 36 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205298:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205301:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1de:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205306:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205314:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205346:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.205375:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2395:x1875771511226368:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 126us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.205382:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 263 00000100:00100000:2.0:1788876628.205396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 264 00000100:00100000:2.0:1788876628.205403:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2395:x1875771511226624:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.205411:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.205417:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 34 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205426:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 34 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205440:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee3a0957/0xf5bf0f7e313a560e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a41 expref: 34 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205450:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205453:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.205457:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.205465:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788876628.205917:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25df80/2, rc 0, transno 4294967546 00000100:00100000:0.0:1788876628.205938:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532273792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876628.209857:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.209875:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.209942:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.209955:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.210022:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876628.210259:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876628.210287:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532277760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.210328:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532276608:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.210340:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876628.210351:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.210385:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532276864:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.210398:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.211748:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.211813:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+33:2395:x1875771511226624:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 6405us (9750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.211825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 264 00000100:00100000:2.0:1788876628.211853:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227136 00000100:00100000:2.0:1788876628.211858:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227136 00010000:00010000:2.0:1788876628.211883:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 33 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.211901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227008 00000100:00100000:2.0:1788876628.211903:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227008 00010000:00010000:2.0:1788876628.211914:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 34 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.211926:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227392 00000100:00100000:2.0:1788876628.211928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227392 00010000:00010000:2.0:1788876628.211939:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 35 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.211950:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227264 00000100:00100000:2.0:1788876628.211953:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227264 00010000:00010000:2.0:1788876628.211964:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.211975:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227520 00000100:00100000:2.0:1788876628.211977:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227520 00010000:00010000:2.0:1788876628.211987:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 36 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.212000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 265 00000100:00100000:2.0:1788876628.212008:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+36:2395:x1875771511226880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212020:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212026:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 36 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212039:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 36 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d6ee5b1/0xf5bf0f7e313a61de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046eaf expref: 36 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212075:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1df:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212079:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1df:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212085:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212095:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212120:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212138:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+35:2395:x1875771511226880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 131us (10064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212145:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 265 00000100:00100000:2.0:1788876628.212158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 266 00000100:00100000:2.0:1788876628.212164:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2398:x1875771511227136:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212172:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212177:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 34 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212187:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 34 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212210:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212213:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212217:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212223:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212235:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212251:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+34:2398:x1875771511227136:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 87us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 266 00000100:00100000:2.0:1788876628.212269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 267 00000100:00100000:2.0:1788876628.212275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+33:2398:x1875771511227008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212283:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212288:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 33 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212303:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 33 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212314:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212318:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212322:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212330:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212341:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212359:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+33:2398:x1875771511227008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 83us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 267 00000100:00100000:2.0:1788876628.212378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 268 00000100:00100000:2.0:1788876628.212384:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+32:2398:x1875771511227392:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212393:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212398:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 32 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212407:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 32 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212424:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eddff011/0xf5bf0f7e313a639e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f57 expref: 32 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212433:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212436:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212439:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212446:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212460:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212476:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+31:2398:x1875771511227392:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 92us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 268 00000100:00100000:2.0:1788876628.212516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 269 00000100:00100000:2.0:1788876628.212523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+26:2398:x1875771511227264:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212531:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212537:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212545:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212563:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bb441c1/0xf5bf0f7e313a64b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fc0 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212574:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212578:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212582:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212588:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212621:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212645:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+25:2398:x1875771511227264:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 122us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212651:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 269 00000100:00100000:2.0:1788876628.212664:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 270 00000100:00100000:2.0:1788876628.212670:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+30:2395:x1875771511227520:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.212677:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.212683:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 30 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212692:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 30 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212708:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212711:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.212715:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212722:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212733:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.212751:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+30:2395:x1875771511227520:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 81us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.212756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 270 00010000:00010000:2.0:1788876628.212804:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a347536c/0xf5bf0f7e313a62be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f03 expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.212815:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532276352:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.212831:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212841:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212848:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212863:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212870:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.212893:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876628.213051:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3663:x1875771532276096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19557us (19775us total) trans 8589934834 rc 0/0 00010000:00010000:3.0:1788876628.213057:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788876628.213059:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00010000:00010000:3.0:1788876628.213066:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213073:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.213077:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213091:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213107:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213113:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313ae83c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213132:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.213135:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213142:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.213144:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213153:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213172:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213183:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313ae87b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.213218:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.213221:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.213224:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.216493:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313a624e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046ed9 expref: 28 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.216513:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532275840:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.216537:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.216538:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.216548:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.216554:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.216559:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.216561:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.216568:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.216569:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.216576:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.216614:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876628.216782:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532276736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18786us (18884us total) trans 8589934835 rc 0/0 00000100:00100000:0.0:1788876628.216792:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00010000:00010000:1.0:1788876628.216835:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876628.216860:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532277760 00000100:00100000:2.0:1788876628.216867:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532277760 00000100:00100000:2.0:1788876628.216905:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1788876628.216914:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3664:x1875771532277760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876628.216940:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:490 count 1 00010000:00010000:2.0:1788876628.216962:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.216978:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 24 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.216987:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ea:0x0].0x0 since=68s v=(0 0) 00010000:00010000:2.0:1788876628.216991:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.216997:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217029:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 24 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217042:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 24 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.217056:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532278016:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.217135:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4780 going to sleep for 11 seconds 00010000:00010000:2.0:1788876628.217277:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217287:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217296:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217303:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217312:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788876628.217347:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532275584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28257us (29312us total) trans 8589934836 rc 0/0 00000100:00100000:1.0:1788876628.217355:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00010000:00010000:1.0:1788876628.217382:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217390:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217398:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.217408:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+62:3665:x1875771532274304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32862us (33505us total) trans 4294967547 rc 0/0 00010000:00010000:1.0:1788876628.217411:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.217415:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00010000:00010000:1.0:1788876628.217420:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788876628.217451:0:43966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217460:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217468:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.217475:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.217481:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3662:x1875771532273536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32633us (32835us total) trans 4294967548 rc 0/0 00010000:00010000:2.0:1788876628.217484:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:1.0:1788876628.217487:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00010000:00010000:1.0:1788876628.217508:0:43962:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217517:0:43962:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217524:0:43962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217531:0:43962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217540:0:43962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000100:00100000:2.0:1788876628.217542:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+56:3662:x1875771532274432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31656us (32845us total) trans 8589934837 rc 0/0 00000100:00100000:2.0:1788876628.217547:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1788876628.217599:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+62:3662:x1875771532273664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30872us (32832us total) trans 4294967549 rc 0/0 00000100:00100000:1.0:1788876628.217627:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00010000:00010000:1.0:1788876628.217660:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710ae47d/0xf5bf0f7e313a632e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f2d expref: 27 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.217679:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532276480:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876628.217694:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217703:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217711:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217720:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217727:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217736:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00000100:00100000:1.0:1788876628.217794:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532276224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24329us (27126us total) trans 8589934838 rc 0/0 00000100:00100000:1.0:1788876628.217800:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00010000:00010000:1.0:1788876628.217819:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217828:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217838:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217847:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.217855:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1788876628.218361:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788876628.218369:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218379:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218383:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218394:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218411:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218419:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313ae889 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218443:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788876628.218447:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218454:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218457:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218464:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218474:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218481:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae86d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218493:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788876628.218497:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218503:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218507:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218520:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218531:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218539:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313ae843 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218550:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788876628.218554:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218561:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218564:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218571:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218580:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218587:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000add7761/0xf5bf0f7e313ae84a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218660:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876628.218665:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218672:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218675:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218683:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218693:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218701:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002638d7ba/0xf5bf0f7e313ae851 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218712:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876628.218716:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218722:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218725:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218738:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218747:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218754:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008282bd2d/0xf5bf0f7e313ae85f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218765:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876628.218768:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218775:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218778:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218786:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218794:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218802:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313ae874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218818:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.218822:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218828:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.218832:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218839:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218847:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218855:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313ae858 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.218866:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.218868:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.218869:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.219375:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3662:x1875771532274560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32855us (34581us total) trans 8589934839 rc 0/0 00000100:00100000:1.0:1788876628.219384:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00010000:00010000:1.0:1788876628.219459:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219470:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219480:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219487:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219511:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788876628.219645:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+56:3665:x1875771532275200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32778us (33362us total) trans 8589934840 rc 0/0 00000100:00100000:1.0:1788876628.219655:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00010000:00010000:1.0:1788876628.219670:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.219675:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219683:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.219687:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219695:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219709:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219716:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313ae866 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.219730:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.219732:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.219733:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.219739:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.219741:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.219742:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.221389:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.221953:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.221976:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.221996:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876628.222007:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:43955:1875771532277376:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.222021:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532277504:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.222032:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222035:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222061:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227648 00000100:00100000:3.0:1788876628.222067:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227648 00010000:00010000:3.0:1788876628.222099:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 25 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227776 00000100:00100000:3.0:1788876628.222137:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227776 00010000:00010000:3.0:1788876628.222150:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 26 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222167:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511227904 00000100:00100000:3.0:1788876628.222169:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511227904 00010000:00010000:3.0:1788876628.222178:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 27 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222205:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 271 00000100:00100000:3.0:1788876628.222214:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+27:2396:x1875771511227648:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.222228:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.222234:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 27 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.222238:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 272 00000100:00100000:2.0:1788876628.222246:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+27:2396:x1875771511227776:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.222247:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 27 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222253:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.222257:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 27 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222270:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 27 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222285:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.222289:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.222296:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222305:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222322:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876628.222349:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd43dbc2/0xf5bf0f7e313a6526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fea expref: 27 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222362:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1788876628.222363:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+26:2396:x1875771511227776:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 118us (386us total) trans 0 rc 0/0 00010000:00010000:3.0:1788876628.222365:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00000100:00100000:2.0:1788876628.222370:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 272 00010000:00010000:3.0:1788876628.222370:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222376:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.222388:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 273 00010000:00010000:3.0:1788876628.222393:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.222394:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+25:2396:x1875771511227904:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.222402:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.222407:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 25 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222410:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+25:2396:x1875771511227648:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 199us (463us total) trans 0 rc 0/0 00010000:00010000:2.0:1788876628.222417:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 25 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 271 00010000:00010000:2.0:1788876628.222435:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001048062f/0xf5bf0f7e313a6596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047014 expref: 24 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222437:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222445:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222446:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.222449:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.222453:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222460:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.222477:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.222495:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+23:2396:x1875771511227904:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 100us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.222501:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 273 00010000:00010000:3.0:1788876628.222525:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222534:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.222553:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.222686:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8455:1875771532278016:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.222699:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.222710:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3662:x1875771532276992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19213us (20948us total) trans 4294967550 rc 0/0 00000100:00100000:3.0:1788876628.222718:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00010000:00010000:1.0:1788876628.222820:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.222830:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.222847:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.222853:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.222867:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.222886:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.222897:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae890 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.222923:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.222926:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.222928:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876628.223965:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.223980:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.223991:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.224001:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.224030:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.224156:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3663:x1875771532275968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29590us (30789us total) trans 4294967551 rc 0/0 00010000:00010000:2.0:1788876628.224200:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.224207:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224214:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.224218:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224227:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224243:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224251:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313ae882 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224268:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.224270:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.224272:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.224502:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.224516:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.224527:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.224535:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.224567:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.224706:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3662:x1875771532277120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21126us (22877us total) trans 4294967552 rc 0/0 00010000:00010000:2.0:1788876628.224758:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.224763:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224772:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.224775:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224784:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224797:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224809:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ebdf36/0xf5bf0f7e313ae897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.224824:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.224826:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.224827:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.225698:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003458fa4c/0xf5bf0f7e313a6606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704703e expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.225712:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532277632:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.225733:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.225743:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.225750:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.225759:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.225766:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.225793:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876628.225801:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.225807:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.225814:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.225817:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.225825:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.225840:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.225847:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d277be/0xf5bf0f7e313ae89e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.225861:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.225862:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.225864:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876628.225906:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3664:x1875771532277248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22176us (24010us total) trans 4294967553 rc 0/0 00000004:00080000:1.0:1788876628.225925:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c93480/2, rc 0, transno 4294967553 00000100:00100000:1.0:1788876628.225943:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532277248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.228445:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532277888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.228523:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.228579:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c91880/2, rc 0, transno 4294967552 00000100:00100000:1.0:1788876628.228590:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532277120:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.228618:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c3c90000/2, rc 0, transno 4294967550 00000100:00100000:1.0:1788876628.228622:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532276992:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.228633:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25d180/2, rc 0, transno 4294967549 00000100:00100000:1.0:1788876628.228637:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532273664:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.228647:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797b480/2, rc 0, transno 8589934839 00000100:00100000:1.0:1788876628.228656:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532274560:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876628.228665:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25dc00/2, rc 0, transno 4294967548 00000100:00100000:1.0:1788876628.228668:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532273536:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.228677:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7979180/2, rc 0, transno 8589934837 00000100:00100000:1.0:1788876628.228680:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532274432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.228693:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876628.228699:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532278144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876628.228725:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876628.228763:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f41cd880/2, rc 0, transno 4294967551 00000100:00100000:1.0:1788876628.228768:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532275968:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788876628.228776:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb259880/2, rc 0, transno 8589934834 00000100:00100000:1.0:1788876628.228780:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532276096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876628.228799:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532277888 00000100:00100000:1.0:1788876628.228804:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532277888 00000100:00100000:0.0:1788876628.230450:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1788876628.230482:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278144 00000100:00100000:0.0:1788876628.230487:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278144 00000100:00100000:0.0:1788876628.230518:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1788876628.230527:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+64:3662:x1875771532278144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876628.230557:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:491 count 1 00010000:00010000:0.0:1788876628.230580:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.230614:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.230624:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1eb:0x0].0x0 since=68s v=(0 0) 00010000:00010000:0.0:1788876628.230629:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1eb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.230634:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.230666:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.230685:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.230698:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532278272:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.230765:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb600 going to sleep for 11 seconds 00000004:00080000:0.0:1788876628.230804:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa783100/2, rc 0, transno 8589934835 00000100:00100000:0.0:1788876628.230810:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532276736:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.230821:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25aa00/2, rc 0, transno 8589934838 00000100:00100000:0.0:1788876628.230824:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532276224:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.230834:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb258000/2, rc 0, transno 8589934836 00000100:00100000:0.0:1788876628.230837:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532275584:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.230845:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797aa00/2, rc 0, transno 8589934840 00000100:00100000:0.0:1788876628.230849:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532275200:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788876628.230860:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e7979c00/2, rc 0, transno 4294967547 00000100:00100000:0.0:1788876628.230864:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532274304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788876628.231009:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.231128:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.231155:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.231173:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532279040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.231205:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.231223:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788876628.231229:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.231248:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.231263:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.231280:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.231303:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278528 00000100:00100000:0.0:1788876628.231308:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278528 00000100:00100000:0.0:1788876628.231328:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532279040 00000100:00100000:0.0:1788876628.231331:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532279040 00000100:00100000:0.0:1788876628.231345:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278400 00000100:00100000:0.0:1788876628.231347:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278400 00000100:00100000:0.0:1788876628.231358:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278912 00000100:00100000:0.0:1788876628.231361:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278912 00000100:00100000:0.0:1788876628.231375:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1788876628.231381:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+60:3665:x1875771532278528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.231394:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:486 count 1 00010000:00010000:0.0:1788876628.231409:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231422:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 26 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231429:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e6:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.231433:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.231437:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231457:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 26 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231474:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 26 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.231486:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532279296:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.231514:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.231529:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1788876628.231536:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+60:3665:x1875771532279040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.231548:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:489 count 1 00010000:00010000:0.0:1788876628.231559:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231571:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 26 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231578:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e9:0x0].0x0 since=68s v=(0 0) 00010000:00010000:0.0:1788876628.231582:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.231586:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231621:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 26 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231631:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 26 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.231647:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532279424:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.231669:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb000 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.231747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228032 00000100:00100000:0.0:1788876628.231751:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228032 00010000:00010000:0.0:1788876628.231770:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 22 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.231795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:0.0:1788876628.231802:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2397:x1875771511228032:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876628.231811:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.231816:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 22 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231830:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 22 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231849:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f6b55e/0xf5bf0f7e313a6676 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047068 expref: 22 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231863:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.231866:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.231872:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231887:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.231906:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.231931:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2397:x1875771511228032:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.231938:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 274 00000100:00100000:0.0:1788876628.235389:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532278784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.235467:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.235519:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788876628.235525:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532278656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.235546:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.235564:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532279168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.235582:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876628.235639:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278784 00000100:00100000:0.0:1788876628.235646:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278784 00000100:00100000:0.0:1788876628.235691:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532278656 00000100:00100000:0.0:1788876628.235694:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532278656 00000100:00100000:0.0:1788876628.235705:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532279168 00000100:00100000:0.0:1788876628.235707:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532279168 00000100:00100000:0.0:1788876628.235722:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1788876628.235730:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3665:x1875771532278400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.235760:0:43956:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:485 count 1 00010000:00010000:0.0:1788876628.235786:0:43956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.235815:0:43956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 26 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.235824:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e5:0x0].0x0 since=69s v=(0 0) 00010000:00010000:0.0:1788876628.235829:0:43956:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.235834:0:43956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.235870:0:43956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 26 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.235883:0:43956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 26 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.235896:0:43956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532279552:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.235941:0:43956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788876628.235958:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1788876628.235965:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3665:x1875771532278912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876628.235978:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:453 count 1 00010000:00010000:0.0:1788876628.235991:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.236002:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 26 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.236015:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1c5:0x0].0x0 since=70s v=(0 0) 00010000:00010000:0.0:1788876628.236019:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.236023:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.236041:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 26 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.236051:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 26 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.236060:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532279680:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876628.236082:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876628.236522:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1788876628.240549:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.240598:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532278272:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.240637:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.240735:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1788876628.240749:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3663:x1875771532278784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876628.240778:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:488 count 1 00010000:00010000:3.0:1788876628.240801:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.240817:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.240824:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e8:0x0].0x0 since=68s v=(0 0) 00010000:00010000:3.0:1788876628.240828:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.240833:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.240862:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.240873:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.240885:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532279808:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876628.240948:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876628.241337:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00010000:00010000:2.0:1788876628.241385:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.241386:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228160 00000100:00100000:3.0:1788876628.241393:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228160 00010000:00010000:2.0:1788876628.241394:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241403:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241410:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.241417:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241425:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.241441:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:3.0:1788876628.241447:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2398:x1875771511228160:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.241456:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.241462:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.241473:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.241490:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfa4562f/0xf5bf0f7e313a66e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047092 expref: 21 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.241500:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1eb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.241503:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1eb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.241508:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.241561:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3664:x1875771532277760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24647us (31218us total) trans 4294967554 rc 0/0 00000100:00100000:2.0:1788876628.241569:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1788876628.241584:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1788876628.241592:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3663:x1875771532278656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876628.241645:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:487 count 1 00010000:00010000:2.0:1788876628.241659:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241677:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 26 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241684:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e7:0x0].0x0 since=69s v=(0 0) 00010000:00010000:2.0:1788876628.241687:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.241690:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241710:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 26 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241721:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 26 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.241732:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532279936:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.241762:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4f00 going to sleep for 11 seconds 00000004:00080000:2.0:1788876628.241862:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb259c00/2, rc 0, transno 4294967554 00000100:00100000:2.0:1788876628.241874:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532277760:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876628.241894:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.241900:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241909:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.241913:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241923:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241936:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241944:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313ae8a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.241959:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.241961:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.241962:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876628.241976:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1788876628.241985:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+63:3663:x1875771532279168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876628.241999:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:490 count 1 00010000:00010000:3.0:1788876628.242002:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.242009:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.242020:0:43966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 26 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.242023:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876628.242026:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ea:0x0].0x0 since=68s v=(0 0) 00010000:00010000:2.0:1788876628.242029:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.242033:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.242043:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511228160:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 596us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.242049:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 275 00010000:00010000:2.0:1788876628.242055:0:43966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 26 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.242063:0:43966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 26 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.242072:0:43966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532280064:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876628.242095:0:43966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876628.242723:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1788876628.242739:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3662:x1875771532277888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876628.242757:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:484 count 1 00010000:00010000:1.0:1788876628.242772:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.242785:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.242793:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1e4:0x0].0x0 since=69s v=(0 0) 00010000:00010000:1.0:1788876628.242796:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.242800:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.242835:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 26 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.242851:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 26 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.242866:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532280192:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876628.243827:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6300 going to sleep for 11 seconds 00010000:00010000:1.0:1788876628.244719:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.244735:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.244747:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.244756:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.244779:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876628.245013:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.245020:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.245029:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.245034:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.245044:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.245064:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.245073:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049bc5332/0xf5bf0f7e313ae8ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.245098:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.245100:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.245102:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.249668:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.249690:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.249751:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.249767:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.249784:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.249859:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:43960:1875771532279296:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.249886:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.249991:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532279424:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.250010:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228288 00000100:00100000:3.0:1788876628.250157:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228288 00010000:00010000:3.0:1788876628.250213:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 27 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250245:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228416 00000100:00100000:3.0:1788876628.250250:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228416 00010000:00010000:3.0:1788876628.250378:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 28 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250402:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228544 00000100:00100000:3.0:1788876628.250408:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228544 00010000:00010000:3.0:1788876628.250449:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250467:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228800 00000100:00100000:3.0:1788876628.250471:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228800 00010000:00010000:3.0:1788876628.250489:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 30 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228672 00000100:00100000:3.0:1788876628.250659:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228672 00010000:00010000:3.0:1788876628.250675:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 31 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.250694:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 276 00000100:00100000:3.0:1788876628.250701:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+31:2397:x1875771511228288:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.250715:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.250720:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 31 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.250732:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 31 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.250754:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313a64ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fd5 expref: 31 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.250770:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.250774:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.250779:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.250788:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.250818:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.250870:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+30:2397:x1875771511228288:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 169us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.250877:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 276 00000100:00100000:3.0:1788876628.250897:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:2.0:1788876628.251048:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00100000:2.0:1788876628.251057:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+29:2397:x1875771511228544:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788876628.251062:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3662:x1875771532278144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20535us (22334us total) trans 4294967555 rc 0/0 00010000:00010000:2.0:1788876628.251066:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788876628.251071:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00010000:00010000:2.0:1788876628.251071:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251081:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 29 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251095:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.251098:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.251103:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251110:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.251112:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797a300/2, rc 0, transno 4294967555 00000100:00100000:1.0:1788876628.251122:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532278144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876628.251123:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876628.251142:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+29:2397:x1875771511228544:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 88us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.251149:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00100000:2.0:1788876628.251163:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:2.0:1788876628.251169:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+28:2397:x1875771511228800:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876628.251171:0:43956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061cd6191/0xf5bf0f7e313a647e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fab expref: 28 pid: 17045 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251178:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788876628.251182:0:43956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:43956:1875771532279552:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.251183:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 27 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251203:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 27 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251208:0:43956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251216:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876628.251217:0:43956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251219:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.251223:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251225:0:43956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251231:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251236:0:43956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251241:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876628.251244:0:43956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.251257:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+27:2397:x1875771511228800:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 89us (1489us total) trans 0 rc 0/0 00010000:00010000:1.0:1788876628.251259:0:43956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.251263:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:2.0:1788876628.251276:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 280 00000100:00100000:2.0:1788876628.251282:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+26:2397:x1875771511228672:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.251291:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876628.251295:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 26 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251309:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 26 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251321:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.251325:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.251559:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.251570:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876628.251584:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532278400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15854us (20334us total) trans 8589934841 rc 0/0 00010000:00010000:2.0:1788876628.251584:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876628.251591:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1788876628.251620:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+26:2397:x1875771511228672:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 338us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.251627:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 280 00010000:00010000:1.0:1788876628.251628:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.251633:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251645:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.251650:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251658:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251670:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251678:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae8c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.251694:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876628.251949:0:43966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532280064:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876628.251964:0:43966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252062:0:43952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba73962/0xf5bf0f7e313a567e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a6b expref: 25 pid: 10319 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.252074:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:43952:1875771532279680:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.252085:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252094:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252100:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252109:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252116:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.252136:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876628.252225:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532278912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16259us (20943us total) trans 8589934842 rc 0/0 00000100:00100000:0.0:1788876628.252231:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00010000:00010000:1.0:1788876628.252343:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.252348:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876628.252353:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.252360:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876628.252363:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.252371:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.252388:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.252395:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae8c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.252410:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.252412:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876628.252414:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788876628.252436:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fad80/2, rc 0, transno 8589934841 00000100:00100000:1.0:1788876628.252448:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278400:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788876628.252457:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f8700/2, rc 0, transno 8589934842 00000100:00100000:1.0:1788876628.252460:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.252790:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+24:2397:x1875771511228416:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.252803:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.252809:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 24 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.252822:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 24 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.252837:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058d380f0/0xf5bf0f7e313a663e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047053 expref: 24 pid: 8455 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.252847:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.252850:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.252855:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.252864:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.252919:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.253487:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.253693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+23:2397:x1875771511228416:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 2783us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.253707:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:3.0:1788876628.253772:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532279936:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.253791:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.253814:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.253823:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.253833:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.253841:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.253855:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876628.254500:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532278528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23112us (23338us total) trans 8589934843 rc 0/0 00000100:00100000:3.0:1788876628.254513:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000004:00080000:3.0:1788876628.254717:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9180/2, rc 0, transno 8589934843 00000100:00100000:3.0:1788876628.254734:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532278528:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.254792:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef32769/0xf5bf0f7e313a65ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047029 expref: 22 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.254805:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532279808:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876628.254822:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.254831:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.254837:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.254846:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.254854:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.254868:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876628.254963:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876628.254970:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.254979:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.254984:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.254992:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255010:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255018:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae8b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255037:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.255040:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255046:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.255050:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255057:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255067:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255073:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313ae8cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.255086:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.255088:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.255089:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876628.257470:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+64:3663:x1875771532278784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16718us (21995us total) trans 8589934844 rc 0/0 00000100:00100000:3.0:1788876628.257482:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00010000:00010000:3.0:1788876628.257805:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788876628.257840:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9500/2, rc 0, transno 8589934844 00000100:00100000:3.0:1788876628.257852:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532278784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876628.258353:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876628.258379:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511228928 00000100:00100000:3.0:1788876628.258386:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511228928 00010000:00010000:3.0:1788876628.258417:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876628.258449:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:3.0:1788876628.258458:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2395:x1875771511228928:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876628.258471:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876628.258477:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.258488:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.258511:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e60bb1b/0xf5bf0f7e313a66ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704707d expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.258593:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.258598:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ea:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876628.258622:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.258633:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.258660:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876628.258701:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2395:x1875771511228928:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 244us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876628.258708:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00010000:00010000:1.0:1788876628.259707:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.259724:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.259738:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.259745:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876628.259787:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876628.259988:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.259995:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.260003:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.260008:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.260017:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.260035:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.260044:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313ae8ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.260072:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.260074:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.260077:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876628.260199:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532279040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28648us (28977us total) trans 8589934845 rc 0/0 00000100:00100000:1.0:1788876628.260213:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000004:00080000:3.0:1788876628.260800:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fbb80/2, rc 0, transno 8589934845 00000100:00100000:3.0:1788876628.260816:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532279040:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876628.261077:0:43966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.261089:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.261100:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.261109:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.261133:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876628.261266:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+64:3663:x1875771532279168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19281us (25681us total) trans 8589934846 rc 0/0 00000100:00100000:2.0:1788876628.261274:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00010000:00010000:3.0:1788876628.261383:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876628.261389:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.261397:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876628.261400:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.261409:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.261424:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.261432:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313ae8dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.261448:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.261450:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876628.261452:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35fb100/2, rc 0, transno 8589934846 00010000:00010000:3.0:1788876628.261452:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876628.261464:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532279168:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876628.281720:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.281790:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876628.282416:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:43958:1875771532280192:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876628.282442:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.284624:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229056 00000100:00100000:0.0:1788876628.284636:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229056 00010000:00010000:0.0:1788876628.284679:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 21 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876628.284725:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229184 00000100:00100000:0.0:1788876628.284728:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229184 00010000:00010000:0.0:1788876628.284743:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 22 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876628.284744:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 282 00000100:00100000:2.0:1788876628.284755:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2398:x1875771511229056:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788876628.284761:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:0.0:1788876628.284766:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2398:x1875771511229184:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876628.284771:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.284772:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876628.284777:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 22 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.284777:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284789:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 22 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.284793:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284813:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ec46db2/0xf5bf0f7e313a640e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046f81 expref: 22 pid: 8453 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284830:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.284835:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876628.284840:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284851:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284878:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876628.284880:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313a655e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046fff expref: 22 pid: 8456 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.284892:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.284895:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876628.284898:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.284905:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.284923:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876628.284929:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511229184:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 161us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876628.284936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:2.0:1788876628.284939:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511229056:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 187us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876628.284944:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 282 00010000:00010000:0.0:1788876628.284958:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284967:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284976:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.284984:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876628.285007:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876628.285046:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.285056:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.285068:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.285074:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876628.285087:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788876628.285172:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3662:x1875771532277888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42439us (56649us total) trans 8589934847 rc 0/0 00000100:00100000:0.0:1788876628.285180:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1788876628.285277:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3663:x1875771532278656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43685us (49728us total) trans 8589934848 rc 0/0 00000100:00100000:3.0:1788876628.285283:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00010000:00010000:2.0:1788876628.285320:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876628.285326:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285335:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.285339:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788876628.285401:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f8380/2, rc 0, transno 8589934847 00000100:00100000:1.0:1788876628.285414:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532277888:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788876628.285417:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285429:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285436:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae8e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285454:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876628.285457:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285463:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876628.285465:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285472:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285481:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285488:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313ae8d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876628.285505:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.285506:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876628.285508:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876628.286552:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788876628.286583:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13f35f9f80/2, rc 0, transno 8589934848 00000100:00100000:3.0:1788876628.286590:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532278656:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876628.841704:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876629.481646:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532280320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876629.481723:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876629.482338:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280320 00000100:00100000:1.0:1788876629.482347:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280320 00000100:00100000:1.0:1788876629.482393:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1788876629.482402:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532280320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876629.482433:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788876629.482484:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532280320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876629.482491:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1788876629.482536:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532280320:0@lo:41:osp-pre-0-1.0 00000004:00080000:2.0:1788876629.482695:0:43312:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1617378091888ns, next at 1618378089329ns, rc = 0 00000100:00100000:2.0:1788876629.482712:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876629.482721:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532280448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876629.482752:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876629.482794:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280448 00000100:00100000:2.0:1788876629.482798:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280448 00000100:00100000:2.0:1788876629.482833:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1788876629.482842:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+63:3665:x1875771532280448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876629.482873:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923472384 avail 3691950080 00000100:00100000:2.0:1788876629.483517:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+63:3665:x1875771532280448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 675us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876629.483525:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00080000:2.0:1788876629.483545:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876629.483633:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532280448:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788876629.484515:0:43310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1617379911643ns, next at 1618379909749ns, rc = 0 00000100:00100000:2.0:1788876629.484643:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876629.484655:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876629.484696:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876629.485366:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280576 00000100:00100000:0.0:1788876629.485441:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280576 00000100:00100000:0.0:1788876629.485511:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1788876629.485522:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+64:3664:x1875771532280576:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788876629.485532:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788876629.485547:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923460096 avail 3691937792 00000100:00100000:0.0:1788876629.485630:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+64:3664:x1875771532280576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876629.485637:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1788876629.485982:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532280576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788876629.865045:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876630.504897:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876630.504918:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532280960:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.504984:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876630.505035:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280960 00000100:00100000:3.0:1788876630.505043:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280960 00000100:00100000:3.0:1788876630.505091:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1788876630.505099:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532280960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505161:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532280960:12345-0@lo:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876630.505169:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1788876630.505223:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532280960:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505260:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532281088:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505287:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876630.505332:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876630.505338:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532281472:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505358:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876630.505389:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532281600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505408:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876630.505430:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281600 00000100:00100000:3.0:1788876630.505433:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281600 00000100:00100000:3.0:1788876630.505459:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1788876630.505465:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532281600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505496:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532281600:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876630.505501:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1788876630.505523:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532281600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.505562:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876630.505568:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532281984:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505626:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532280704:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505660:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.505686:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532281216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505706:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.505721:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532281728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505738:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.505755:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788876630.505761:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532280832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505783:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.505796:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532281344:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505813:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.505827:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532281856:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505844:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876630.505867:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876630.505876:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281216 00000100:00100000:2.0:1788876630.505880:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281216 00000100:00100000:2.0:1788876630.505907:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281728 00000100:00100000:2.0:1788876630.505910:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281728 00000100:00100000:2.0:1788876630.505921:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281344 00000100:00100000:2.0:1788876630.505924:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281344 00000100:00100000:2.0:1788876630.505937:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1788876630.505943:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.505977:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532281216:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.505983:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1788876630.505995:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:2.0:1788876630.506001:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532281728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506027:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532281728:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.506036:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:2.0:1788876630.506046:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:2.0:1788876630.506052:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532281344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506077:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532281344:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.506083:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:2.0:1788876630.506100:0:43295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280704 00000100:00100000:2.0:1788876630.506104:0:43295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280704 00000100:00100000:2.0:1788876630.506128:0:43295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788876630.506134:0:43295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ca2e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532280704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506162:0:43295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ca2e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532280704:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.506167:0:43295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788876630.506205:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876630.506209:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876630.506228:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532281344:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506237:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532280704:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506245:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532281216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506253:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532281728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506307:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876630.506315:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532282112:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506338:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.506376:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532282240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506398:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876630.506418:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282240 00000100:00100000:2.0:1788876630.506421:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282240 00000100:00100000:2.0:1788876630.506439:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:2.0:1788876630.506444:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532282240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506470:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532282240:12345-0@lo:400:kworker.0 Request processed in 26us (72us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.506475:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:2.0:1788876630.506494:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532282240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.506727:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876630.506735:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532282368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876630.506760:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876630.506829:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282368 00000100:00100000:0.0:1788876630.506834:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282368 00000100:00100000:0.0:1788876630.506875:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1788876630.506882:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532282368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876630.506897:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923472384 avail 3691950080 00000100:00100000:0.0:1788876630.506932:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532282368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876630.506939:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00080000:2.0:1788876630.506995:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876630.507018:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532282368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876630.507103:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876630.507235:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281088 00000100:00100000:0.0:1788876630.507239:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281088 00000100:00100000:0.0:1788876630.507291:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281472 00000100:00100000:0.0:1788876630.507295:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281472 00000100:00100000:0.0:1788876630.507310:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282112 00000100:00100000:0.0:1788876630.507312:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282112 00000100:00100000:0.0:1788876630.507326:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281984 00000100:00100000:0.0:1788876630.507329:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281984 00000100:00100000:0.0:1788876630.507344:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1788876630.507350:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876630.507392:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532281088:12345-0@lo:400:kworker.0 Request processed in 42us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876630.507399:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1788876630.507411:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1788876630.507417:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876630.507444:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532281472:12345-0@lo:400:kworker.0 Request processed in 27us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876630.507450:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1788876630.507460:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1788876630.507465:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3664:x1875771532282112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876630.507496:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+63:3664:x1875771532282112:12345-0@lo:400:kworker.0 Request processed in 31us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876630.507502:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1788876630.507513:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1788876630.507519:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532281984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876630.507544:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3665:x1875771532281984:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876630.507550:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1788876630.507577:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532282112:0@lo:400:kworker.0 00000100:00080000:2.0:1788876630.507657:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876630.507930:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532281984:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.507940:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532281472:0@lo:400:kworker.0 00000100:00100000:3.0:1788876630.507950:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532281088:0@lo:400:kworker.0 00000100:00100000:1.0:1788876630.508093:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532280832 00000100:00100000:1.0:1788876630.508098:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532280832 00000100:00100000:1.0:1788876630.508141:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532281856 00000100:00100000:1.0:1788876630.508144:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532281856 00000100:00100000:1.0:1788876630.508160:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788876630.508167:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532280832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876630.508216:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532280832:12345-0@lo:400:kworker.0 Request processed in 48us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876630.508225:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788876630.508237:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1788876630.508243:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532281856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876630.508273:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532281856:12345-0@lo:400:kworker.0 Request processed in 30us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876630.508278:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1788876630.508429:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532280832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876630.508438:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532281856:0@lo:400:kworker.0 00000100:00100000:0.0:1788876630.508500:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532282496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876630.508532:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876630.508817:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282496 00000100:00100000:1.0:1788876630.508822:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282496 00000100:00100000:1.0:1788876630.508854:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1788876630.508860:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532282496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876630.508882:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876630.508994:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532282496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876630.509000:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1788876630.510408:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532282496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876630.701919:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876630.701960:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876630.701997:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876630.702017:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876630.702039:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876630.702065:0:43293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229312 00000100:00100000:2.0:1788876630.702074:0:43293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229312 00000100:00100000:2.0:1788876630.702120:0:43293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1788876630.702129:0:43293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511229312:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876630.702211:0:43293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511229312:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.702219:0:43293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1788876630.702250:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229440 00000100:00100000:2.0:1788876630.702254:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229440 00000100:00100000:2.0:1788876630.702287:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229568 00000100:00100000:2.0:1788876630.702290:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229568 00000100:00100000:2.0:1788876630.702310:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1553 00000100:00100000:2.0:1788876630.702316:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511229440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876630.702345:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511229440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.702350:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1553 00000100:00100000:2.0:1788876630.702362:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1554 00000100:00100000:2.0:1788876630.702369:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511229568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876630.702391:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511229568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.702398:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1554 00000100:00100000:2.0:1788876630.702415:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229696 00000100:00100000:2.0:1788876630.702419:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229696 00000100:00100000:2.0:1788876630.702440:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229824 00000100:00100000:2.0:1788876630.702442:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229824 00000100:00100000:2.0:1788876630.702462:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1138 00000100:00100000:2.0:1788876630.702468:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2395:x1875771511229696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876630.702493:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2395:x1875771511229696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.702503:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1138 00000100:00100000:2.0:1788876630.702514:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1139 00000100:00100000:2.0:1788876630.702521:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2395:x1875771511229824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876630.702541:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2395:x1875771511229824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876630.702547:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1139 00000100:00080000:2.0:1788876630.702564:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876630.702569:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876630.702571:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876630.702573:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788876630.889043:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876631.530841:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532282624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876631.530924:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876631.534705:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282624 00000100:00100000:0.0:1788876631.534723:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282624 00000100:00100000:0.0:1788876631.534779:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1788876631.534788:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532282624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876631.534818:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923460096 avail 3691937792 00000100:00100000:0.0:1788876631.538475:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532282624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3679us (7542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876631.538489:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1788876631.538693:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532282624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876631.913071:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876632.937823:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876633.960828:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788876634.091698:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967555 is committed 00000004:00080000:1.0:1788876634.095071:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788876634.095102:0:43289:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1788876634.095354:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934848 is committed 00000100:00100000:3.0:1788876634.095429:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876634.095495:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.095552:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283008 00000100:00100000:0.0:1788876634.095560:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283008 00000100:00100000:3.0:1788876634.095561:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876634.095582:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876634.095620:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284032:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876634.095634:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283520 00000100:00100000:0.0:1788876634.095637:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283520 00000100:00100000:3.0:1788876634.095642:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.095653:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284032 00000100:00100000:0.0:1788876634.095656:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284032 00000100:00100000:3.0:1788876634.095662:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876634.095676:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1788876634.095679:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.095684:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532283008:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876634.095698:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788876634.095703:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283136:0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876634.095709:0:43952:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:494 count 1 00000100:00100000:3.0:1788876634.095721:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876634.095734:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.095736:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283648:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788876634.095754:0:43952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.095762:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ee:0x0].0x0 since=73s v=(0 0) 00010000:00010000:0.0:1788876634.095767:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ee:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.095771:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.095799:0:43952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.095813:0:43952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 19 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.095830:0:43952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532284800:192.168.203.11@tcp:104: 00000100:00080000:2.0:1788876634.095839:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876634.095843:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876634.095853:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284544 00000100:00100000:2.0:1788876634.095856:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284544 00000100:00100000:0.0:1788876634.095895:0:43952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876634.095910:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283136 00000100:00100000:0.0:1788876634.095913:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283136 00000100:00100000:0.0:1788876634.095939:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1788876634.095945:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3664:x1875771532283520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876634.095957:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:497 count 1 00010000:00010000:0.0:1788876634.095968:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.095981:0:43958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 19 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.095988:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f1:0x0].0x0 since=73s v=(0 0) 00010000:00010000:0.0:1788876634.095991:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.095995:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.096004:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:2.0:1788876634.096010:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532284032:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876634.096013:0:43958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 19 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788876634.096021:0:43966:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:493 count 1 00010000:00010000:0.0:1788876634.096023:0:43958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 19 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.096032:0:43958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532284928:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876634.096035:0:43966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096046:0:43966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 18 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096052:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ed:0x0].0x0 since=73s v=(0 0) 00000100:00100000:0.0:1788876634.096054:0:43958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884600 going to sleep for 11 seconds 00010000:00010000:2.0:1788876634.096055:0:43966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ed:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876634.096060:0:43966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.096069:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1788876634.096076:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3664:x1875771532283136:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876634.096080:0:43966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 18 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096089:0:43966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 18 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.096099:0:43966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532285056:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876634.096126:0:43966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876634.096170:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1788876634.096178:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532284544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788876634.096210:0:8455:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:497 count 1 00010000:00010000:2.0:1788876634.096222:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096233:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 18 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096240:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f1:0x0].0x0 since=73s v=(0 0) 00010000:00010000:2.0:1788876634.096245:0:8455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876634.096248:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096267:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 18 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.096278:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.096287:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532285184:192.168.203.11@tcp:104: 00000100:00100000:2.0:1788876634.096311:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82780 going to sleep for 11 seconds 00000100:00100000:3.0:1788876634.097049:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788876634.097050:0:10319:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:454 count 1 00010000:00010000:0.0:1788876634.097066:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097075:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284160:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876634.097080:0:10319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 19 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.097087:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c6:0x0].0x0 since=75s v=(0 0) 00000100:00100000:3.0:1788876634.097097:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876634.097103:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.097107:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097113:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876634.097129:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876634.097130:0:10319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 19 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.097141:0:10319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 19 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.097161:0:10319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532285312:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876634.097168:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283648 00000100:00100000:3.0:1788876634.097173:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283648 00000100:00100000:3.0:1788876634.097199:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284160 00000100:00100000:3.0:1788876634.097202:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284160 00000100:00100000:0.0:1788876634.097203:0:10319:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788876634.097216:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284672 00000100:00100000:3.0:1788876634.097219:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284672 00000100:00100000:3.0:1788876634.097235:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1788876634.097242:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3664:x1875771532283648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876634.097257:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:498 count 1 00010000:00010000:3.0:1788876634.097270:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.097281:0:17045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.097289:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f2:0x0].0x0 since=73s v=(0 0) 00010000:00010000:3.0:1788876634.097292:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876634.097295:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.097297:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1788876634.097304:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+8:3664:x1875771532284160:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876634.097313:0:17045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 19 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788876634.097316:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:494 count 1 00010000:00010000:3.0:1788876634.097323:0:17045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 19 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.097327:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097332:0:17045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532285440:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876634.097338:0:43964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 18 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.097345:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ee:0x0].0x0 since=73s v=(0 0) 00010000:00010000:0.0:1788876634.097348:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ee:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.097351:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097358:0:17045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788876634.097371:0:43964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 18 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097373:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1788876634.097381:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3664:x1875771532284672:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788876634.097382:0:43964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.097391:0:43964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532285568:192.168.203.11@tcp:104: 00002000:00080000:3.0:1788876634.097392:0:43954:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:498 count 1 00010000:00010000:3.0:1788876634.097403:0:43954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.097412:0:43964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788876634.097414:0:43954:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 18 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.097421:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f2:0x0].0x0 since=73s v=(0 0) 00010000:00010000:3.0:1788876634.097424:0:43954:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876634.097427:0:43954:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.097445:0:43954:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 18 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.097454:0:43954:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 18 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.097464:0:43954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532285696:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876634.097487:0:43954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.099558:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532282752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876634.099670:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.099709:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876634.099729:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.099762:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876634.099786:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.099801:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532284288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876634.099827:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.099854:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788876634.101202:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282752 00000100:00100000:3.0:1788876634.101214:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282752 00000100:00100000:3.0:1788876634.101272:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283264 00000100:00100000:3.0:1788876634.101276:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283264 00000100:00100000:3.0:1788876634.101294:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283776 00000100:00100000:3.0:1788876634.101297:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283776 00000100:00100000:3.0:1788876634.101315:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284288 00000100:00100000:3.0:1788876634.101318:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284288 00000100:00100000:3.0:1788876634.101340:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1788876634.101349:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3662:x1875771532282752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876634.101382:0:43953:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:492 count 1 00010000:00010000:3.0:1788876634.101408:0:43953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101429:0:43953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 19 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101439:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ec:0x0].0x0 since=73s v=(0 0) 00010000:00010000:3.0:1788876634.101443:0:43953:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ec:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876634.101448:0:43953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101481:0:43953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 19 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101495:0:43953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 19 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.101509:0:43953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532285824:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788876634.101577:0:43953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c32349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876634.101626:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1788876634.101635:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+10:3662:x1875771532283264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876634.101647:0:43963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:495 count 1 00010000:00010000:3.0:1788876634.101659:0:43963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101675:0:43963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 19 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101682:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ef:0x0].0x0 since=73s v=(0 0) 00010000:00010000:3.0:1788876634.101685:0:43963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ef:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876634.101689:0:43963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101709:0:43963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 19 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.101719:0:43963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 19 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.101730:0:43963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532285952:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.101970:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532282880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876634.102020:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.102048:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876634.102069:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.102084:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876634.102104:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.102115:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532284416:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876634.102133:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876634.102177:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532282880 00000100:00100000:1.0:1788876634.102182:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532282880 00000100:00100000:1.0:1788876634.102205:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283392 00000100:00100000:1.0:1788876634.102207:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283392 00000100:00100000:1.0:1788876634.102216:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532283904 00000100:00100000:1.0:1788876634.102218:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532283904 00000100:00100000:1.0:1788876634.102226:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532284416 00000100:00100000:1.0:1788876634.102229:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532284416 00000100:00100000:1.0:1788876634.102240:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788876634.102246:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532283776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876634.102261:0:43961:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:491 count 1 00010000:00010000:1.0:1788876634.102278:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102293:0:43961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 18 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102302:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1eb:0x0].0x0 since=73s v=(0 0) 00010000:00010000:1.0:1788876634.102306:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1eb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.102310:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102332:0:43961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 18 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102344:0:43961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 18 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.102356:0:43961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532286080:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.102394:0:43961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.102563:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1788876634.102571:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532284288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876634.102585:0:43955:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:495 count 1 00010000:00010000:1.0:1788876634.102596:0:43955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102632:0:43955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 18 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102640:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ef:0x0].0x0 since=73s v=(0 0) 00010000:00010000:1.0:1788876634.102644:0:43955:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ef:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.102649:0:43955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102669:0:43955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 18 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.102681:0:43955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 18 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.102691:0:43955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532286208:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.102723:0:43955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.103231:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1788876634.103244:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532282880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876634.103259:0:43960:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:493 count 1 00010000:00010000:1.0:1788876634.103275:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103289:0:43960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 19 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103296:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1ed:0x0].0x0 since=73s v=(0 0) 00010000:00010000:1.0:1788876634.103300:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ed:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.103303:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103325:0:43960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 19 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103335:0:43960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 19 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.103346:0:43960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532286336:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.103377:0:43960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.103396:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1788876634.103404:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532283392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788876634.103417:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:496 count 1 00010000:00010000:1.0:1788876634.103429:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103441:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 19 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103448:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f0:0x0].0x0 since=73s v=(0 0) 00010000:00010000:1.0:1788876634.103451:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.103455:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103474:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 19 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103485:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 19 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.103502:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532286464:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.103526:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c86a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.103554:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1788876634.103562:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532283904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788876634.103574:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:492 count 1 00010000:00010000:1.0:1788876634.103586:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103597:0:8456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 18 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103634:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1ec:0x0].0x0 since=73s v=(0 0) 00010000:00010000:1.0:1788876634.103637:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ec:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.103641:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103660:0:8456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 18 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.103670:0:8456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 18 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.103680:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532286592:192.168.203.11@tcp:104: 00000100:00100000:1.0:1788876634.103714:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13effae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876634.103922:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1788876634.103933:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3662:x1875771532284416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876634.103946:0:43971:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:496 count 1 00010000:00010000:0.0:1788876634.103958:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.103969:0:43971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 18 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.103981:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1f0:0x0].0x0 since=73s v=(0 0) 00010000:00010000:0.0:1788876634.103983:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.103987:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.104007:0:43971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 18 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.104016:0:43971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 18 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.104025:0:43971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:43971:1875771532286720:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876634.104052:0:43971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876634.104559:0:43963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234780 going to sleep for 11 seconds 00000100:00100000:1.0:1788876634.107360:0:43958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:43958:1875771532284928:192.168.203.11@tcp:104: 00010000:00010000:1.0:1788876634.107391:0:43958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.107468:0:43952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:43952:1875771532284800:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876634.107481:0:43952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.107542:0:43966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:43966:1875771532285056:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.107557:0:43966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.114339:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114363:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114381:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114402:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114419:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114441:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114454:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114466:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114478:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114491:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114503:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114521:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.114545:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511229952 00000100:00100000:2.0:1788876634.114553:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511229952 00010000:00010000:2.0:1788876634.114631:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 20 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.114667:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230208 00000100:00100000:2.0:1788876634.114670:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230208 00010000:00010000:2.0:1788876634.114687:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 19 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.114700:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230080 00000100:00100000:2.0:1788876634.114703:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230080 00010000:00010000:2.0:1788876634.114714:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 21 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.114725:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231744 00000100:00100000:2.0:1788876634.114727:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231744 00000100:00100000:0.0:1788876634.115063:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230336 00000100:00100000:0.0:1788876634.115069:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230336 00010000:00010000:0.0:1788876634.115089:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 21 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115105:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230592 00000100:00100000:0.0:1788876634.115107:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230592 00010000:00010000:0.0:1788876634.115119:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 22 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115130:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230848 00000100:00100000:0.0:1788876634.115132:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230848 00010000:00010000:0.0:1788876634.115143:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 22 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115165:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231104 00000100:00100000:0.0:1788876634.115168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231104 00010000:00010000:0.0:1788876634.115180:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 23 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231360 00000100:00100000:0.0:1788876634.115192:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231360 00010000:00010000:0.0:1788876634.115202:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 23 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115213:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231616 00000100:00100000:0.0:1788876634.115216:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231616 00010000:00010000:0.0:1788876634.115226:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 24 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230464 00000100:00100000:0.0:1788876634.115239:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230464 00010000:00010000:0.0:1788876634.115250:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 24 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115262:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230720 00000100:00100000:0.0:1788876634.115264:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230720 00010000:00010000:0.0:1788876634.115276:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 25 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.115290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 284 00000100:00100000:0.0:1788876634.115299:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+24:2395:x1875771511229952:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.115313:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.115318:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 24 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115333:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 24 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115359:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008700ebcc/0xf5bf0f7e313a6836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047110 expref: 24 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115378:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ee:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.115382:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ee:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.115389:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115399:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115430:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.115482:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+23:2395:x1875771511229952:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 183us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.115490:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 284 00000100:00100000:0.0:1788876634.115510:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:0.0:1788876634.115516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+25:2395:x1875771511230208:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.115524:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.115530:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 25 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115540:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 25 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115557:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eb4fb37/0xf5bf0f7e313a67fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470fb expref: 25 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115567:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ed:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.115571:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ed:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.115576:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115584:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115630:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.115650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+24:2395:x1875771511230208:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 134us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.115657:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:0.0:1788876634.115679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00100000:0.0:1788876634.115685:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2395:x1875771511230080:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.115693:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.115699:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 22 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115715:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 22 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115727:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa356d9/0xf5bf0f7e313a6986 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704718e expref: 22 pid: 10319 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115736:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f1:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.115752:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.115757:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115766:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.115786:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.115805:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2395:x1875771511230080:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 120us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.115812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00100000:0.0:1788876634.116003:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1788876634.116011:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+23:2398:x1875771511230336:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116019:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116025:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 23 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116041:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 23 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116054:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ef:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116057:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ef:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116062:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116068:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116080:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116097:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+23:2398:x1875771511230336:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 88us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1788876634.116120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:0.0:1788876634.116125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511230592:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116132:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116137:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 20 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116157:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 20 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116175:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f0:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116178:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116182:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116191:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116202:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116219:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511230592:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 93us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116224:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:0.0:1788876634.116239:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:0.0:1788876634.116245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2398:x1875771511230848:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116253:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116258:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 22 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116267:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 22 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116278:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f0:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116281:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f0:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116285:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116297:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116308:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116325:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+22:2398:x1875771511230848:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 80us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116331:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:0.0:1788876634.116343:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:0.0:1788876634.116349:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2398:x1875771511231104:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116356:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116361:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 21 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116371:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 21 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116383:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f1:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116386:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f1:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116390:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116398:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116409:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116426:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+21:2398:x1875771511231104:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 77us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 290 00000100:00100000:0.0:1788876634.116447:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1788876634.116453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2398:x1875771511231360:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116461:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116465:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 19 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116475:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 19 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116487:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116490:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116494:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116501:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116513:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116530:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2398:x1875771511231360:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 76us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:0.0:1788876634.116548:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:0.0:1788876634.116556:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511231616:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116564:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116569:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 20 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116579:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 20 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116592:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116595:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116599:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116634:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116647:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.116661:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+20:2398:x1875771511231616:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 106us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.116667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:0.0:1788876634.116679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:0.0:1788876634.116686:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511230464:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.116693:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.116698:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 18 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116709:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 18 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116722:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ed:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.116725:0:6526:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ed:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.116730:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.116736:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.116978:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3cfaf4c/0xf5bf0f7e313a69f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471b8 expref: 18 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.116992:0:17045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17045:1875771532285440:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.117013:0:17045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117024:0:17045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117032:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117043:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117052:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117070:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.117262:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532283648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20019us (20283us total) trans 4294967556 rc 0/0 00000100:00100000:3.0:1788876634.117270:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00010000:00010000:3.0:1788876634.117306:0:43954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067090667/0xf5bf0f7e313a6a2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471cd expref: 19 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.117317:0:43954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:43954:1875771532285696:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.117330:0:43954:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117344:0:43954:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117351:0:43954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117359:0:43954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117366:0:43954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117382:0:43954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788876634.117471:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532284672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20091us (20340us total) trans 8589934849 rc 0/0 00000100:00100000:3.0:1788876634.117478:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1788876634.117500:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:3.0:1788876634.117509:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511230720:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788876634.117518:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876634.117524:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 18 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117533:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 18 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117550:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ec:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788876634.117553:0:6525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ec:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788876634.117558:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117565:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117578:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876634.117592:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511230720:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 85us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876634.117598:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 294 00010000:00010000:3.0:1788876634.117644:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876634.117651:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117659:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.117664:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117673:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117686:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117699:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6ca721/0xf5bf0f7e313ae90e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117717:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.117720:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117727:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.117730:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.117738:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118135:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118143:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313ae91c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118167:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118170:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118173:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118180:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118191:0:43966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118199:0:43966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118208:0:43966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118216:0:43966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118230:0:43966:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.118317:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532284032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22306us (22672us total) trans 8589934850 rc 0/0 00000100:00100000:3.0:1788876634.118324:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00010000:00010000:3.0:1788876634.118343:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.118348:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118356:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.118359:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118368:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118380:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118388:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c801ac35/0xf5bf0f7e313ae8f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118402:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118403:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118405:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118430:0:43955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001af79faf/0xf5bf0f7e313a68de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704714f expref: 17 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.118441:0:43955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:43955:1875771532286208:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.118457:0:43955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118467:0:43955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118474:0:43955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118484:0:43955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118492:0:43955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118511:0:43955:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.118583:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532284288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16012us (18764us total) trans 8589934851 rc 0/0 00000100:00100000:3.0:1788876634.118590:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00010000:00010000:3.0:1788876634.118630:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.118635:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118643:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.118646:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118655:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118667:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118675:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313ae938 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.118689:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118691:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.118693:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876634.118712:0:43953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:43953:1875771532285824:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.118724:0:43953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.118953:0:43957:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 20 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.118986:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:2.0:1788876634.118999:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+16:2395:x1875771511231744:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876634.119011:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876634.119017:0:43957:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 16 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119028:0:43957:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 16 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119044:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1eb:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788876634.119048:0:43957:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1eb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876634.119054:0:43957:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119063:0:43957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119080:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876634.119099:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+16:2395:x1875771511231744:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 106us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876634.119105:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00080000:2.0:1788876634.119161:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876634.119166:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876634.119188:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004258757/0xf5bf0f7e313a69be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471a3 expref: 15 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.119199:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8455:1875771532285184:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876634.119211:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119220:0:8455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119227:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119235:0:8455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119242:0:8455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.119257:0:8455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876634.119350:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532284544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23173us (23668us total) trans 8589934852 rc 0/0 00000100:00100000:2.0:1788876634.119358:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1788876634.119405:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.119488:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.119521:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876634.120027:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511230976 00000100:00100000:0.0:1788876634.120034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511230976 00010000:00010000:0.0:1788876634.120069:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 18 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.120089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231232 00000100:00100000:0.0:1788876634.120092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231232 00010000:00010000:0.0:1788876634.120104:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 19 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.120116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231488 00000100:00100000:0.0:1788876634.120118:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231488 00010000:00010000:0.0:1788876634.120132:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 15 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.120145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1788876634.120164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2398:x1875771511230976:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.120175:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.120182:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 19 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120193:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 19 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120210:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ef:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.120214:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ef:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.120219:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120227:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120243:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.120266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+19:2398:x1875771511230976:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 103us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.120273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1788876634.120288:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:0.0:1788876634.120294:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511231232:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.120301:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.120306:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 18 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120315:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 18 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120332:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.120335:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.120340:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120347:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120358:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.120371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511231232:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 77us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.120378:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:0.0:1788876634.120389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:0.0:1788876634.120395:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+15:2398:x1875771511231488:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876634.120403:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876634.120407:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 15 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120417:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 15 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120429:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ee:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788876634.120432:0:6524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1ee:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.120437:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120450:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120462:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876634.120475:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+15:2398:x1875771511231488:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 81us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.120482:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00010000:00010000:0.0:1788876634.120520:0:43964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008532aa2a/0xf5bf0f7e313a686e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047125 expref: 14 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.120532:0:43964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:43964:1875771532285568:192.168.203.11@tcp:104: 00010000:00010000:0.0:1788876634.120548:0:43964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120556:0:43964:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120563:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120572:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120579:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.120624:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788876634.121125:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934848 gen 2 00000004:00080000:3.0:1788876634.121132:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4035c00, transno 8589934790 00000004:00080000:3.0:1788876634.121143:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4036d80, transno 8589934791 00000004:00080000:3.0:1788876634.121146:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4034700, transno 8589934792 00000004:00080000:3.0:1788876634.121168:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4037b80, transno 8589934793 00000004:00080000:3.0:1788876634.121171:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eef62300, transno 8589934794 00000004:00080000:3.0:1788876634.121173:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eef62a00, transno 8589934795 00000004:00080000:3.0:1788876634.121175:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4037100, transno 8589934796 00000004:00080000:3.0:1788876634.121178:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eef60380, transno 8589934797 00000004:00080000:3.0:1788876634.121181:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad3aa00, transno 8589934798 00000004:00080000:3.0:1788876634.121183:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad38000, transno 8589934799 00000004:00080000:3.0:1788876634.121186:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad3a680, transno 8589934800 00000004:00080000:3.0:1788876634.121188:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fac08700, transno 8589934801 00000004:00080000:3.0:1788876634.121191:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed6a00, transno 8589934802 00000004:00080000:3.0:1788876634.121194:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed4000, transno 8589934803 00000004:00080000:3.0:1788876634.121196:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed4a80, transno 8589934804 00000004:00080000:3.0:1788876634.121199:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed7b80, transno 8589934805 00000004:00080000:3.0:1788876634.121201:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed7800, transno 8589934806 00000004:00080000:3.0:1788876634.121204:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3659c00, transno 8589934807 00000004:00080000:3.0:1788876634.121207:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785ca80, transno 8589934808 00000004:00080000:3.0:1788876634.121209:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785f480, transno 8589934809 00000004:00080000:3.0:1788876634.121212:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed7100, transno 8589934810 00000004:00080000:3.0:1788876634.121215:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fac08000, transno 8589934811 00000004:00080000:3.0:1788876634.121217:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fac0aa00, transno 8589934812 00000004:00080000:3.0:1788876634.121220:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785fb80, transno 8589934813 00000004:00080000:3.0:1788876634.121222:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fac08e00, transno 8589934814 00000004:00080000:3.0:1788876634.121226:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3036d80, transno 8589934815 00000004:00080000:3.0:1788876634.121228:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3034e00, transno 8589934816 00000004:00080000:3.0:1788876634.121231:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fac0a680, transno 8589934817 00000004:00080000:3.0:1788876634.121234:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cea00, transno 8589934818 00000004:00080000:3.0:1788876634.121237:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785f100, transno 8589934819 00000004:00080000:3.0:1788876634.121239:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785c000, transno 8589934820 00000004:00080000:3.0:1788876634.121242:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed6300, transno 8589934821 00000004:00080000:3.0:1788876634.121245:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35faa00, transno 8589934822 00000004:00080000:3.0:1788876634.121248:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed5880, transno 8589934823 00000004:00080000:3.0:1788876634.121250:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797ea00, transno 8589934824 00000004:00080000:3.0:1788876634.121253:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797c000, transno 8589934825 00000004:00080000:3.0:1788876634.121255:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa714a80, transno 8589934826 00000004:00080000:3.0:1788876634.121258:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa714380, transno 8589934827 00000004:00080000:3.0:1788876634.121260:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797f800, transno 8589934828 00000004:00080000:3.0:1788876634.121262:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed4380, transno 8589934829 00000004:00080000:3.0:1788876634.121264:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7978000, transno 8589934830 00000004:00080000:3.0:1788876634.121267:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25a680, transno 8589934831 00000004:00080000:3.0:1788876634.121269:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780e00, transno 8589934832 00000004:00080000:3.0:1788876634.121272:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c92680, transno 8589934833 00000004:00080000:3.0:1788876634.121274:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb259880, transno 8589934834 00000004:00080000:3.0:1788876634.121277:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa783100, transno 8589934835 00000004:00080000:3.0:1788876634.121279:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb258000, transno 8589934836 00000004:00080000:3.0:1788876634.121282:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7979180, transno 8589934837 00000004:00080000:3.0:1788876634.121284:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25aa00, transno 8589934838 00000004:00080000:3.0:1788876634.121286:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797b480, transno 8589934839 00000004:00080000:3.0:1788876634.121288:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797aa00, transno 8589934840 00000004:00080000:3.0:1788876634.121291:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fad80, transno 8589934841 00000004:00080000:3.0:1788876634.121293:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f8700, transno 8589934842 00000004:00080000:3.0:1788876634.121295:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9180, transno 8589934843 00000004:00080000:3.0:1788876634.121298:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9500, transno 8589934844 00000004:00080000:3.0:1788876634.121301:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fbb80, transno 8589934845 00000004:00080000:3.0:1788876634.121303:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fb100, transno 8589934846 00000004:00080000:3.0:1788876634.121306:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f8380, transno 8589934847 00000004:00080000:3.0:1788876634.121308:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9f80, transno 8589934848 00000100:00100000:3.0:1788876634.121315:0:3662:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a13e797ce00 x1875771532284288/t8589934851(8589934851) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788876650 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788876634.121325:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797ce00/2, rc 0, transno 8589934851 00000100:00100000:3.0:1788876634.121331:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532284288:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788876634.121353:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876634.121360:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121370:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.121374:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121386:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121401:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121410:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313ae900 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121429:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.121433:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121440:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.121443:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121451:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121461:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121469:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313ae915 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.121481:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.121483:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.121485:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788876634.122705:0:43309:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 7 in flight, 59 done 00010000:00010000:3.0:1788876634.122726:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876634.122851:0:3664:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967555 gen 2 00000004:00080000:3.0:1788876634.123106:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4036300, transno 4294967498 00000004:00080000:3.0:1788876634.123125:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f452c380, transno 4294967499 00000004:00080000:3.0:1788876634.123128:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f452d880, transno 4294967500 00000004:00080000:3.0:1788876634.123130:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4037800, transno 4294967501 00000004:00080000:3.0:1788876634.123133:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f452f800, transno 4294967502 00000004:00080000:3.0:1788876634.123135:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f452dc00, transno 4294967503 00000004:00080000:3.0:1788876634.123138:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f452d180, transno 4294967504 00000004:00080000:3.0:1788876634.123141:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad3ad80, transno 4294967505 00000004:00080000:3.0:1788876634.123143:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f4035180, transno 4294967506 00000004:00080000:3.0:1788876634.123146:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad3b100, transno 4294967507 00000004:00080000:3.0:1788876634.123160:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad38700, transno 4294967508 00000004:00080000:3.0:1788876634.123163:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff574a80, transno 4294967509 00000004:00080000:3.0:1788876634.123165:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13ff574000, transno 4294967510 00000004:00080000:3.0:1788876634.123167:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad39500, transno 4294967511 00000004:00080000:3.0:1788876634.123170:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c92d80, transno 4294967512 00000004:00080000:3.0:1788876634.123173:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed4700, transno 4294967513 00000004:00080000:3.0:1788876634.123175:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785d180, transno 4294967514 00000004:00080000:3.0:1788876634.123178:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd05180, transno 4294967515 00000004:00080000:3.0:1788876634.123180:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785f800, transno 4294967516 00000004:00080000:3.0:1788876634.123182:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c93100, transno 4294967517 00000004:00080000:3.0:1788876634.123185:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785e680, transno 4294967518 00000004:00080000:3.0:1788876634.123187:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd04000, transno 4294967519 00000004:00080000:3.0:1788876634.123189:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c47ebb80, transno 4294967520 00000004:00080000:3.0:1788876634.123192:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd07100, transno 4294967521 00000004:00080000:3.0:1788876634.123194:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd07b80, transno 4294967522 00000004:00080000:3.0:1788876634.123197:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3658a80, transno 4294967523 00000004:00080000:3.0:1788876634.123199:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd04700, transno 4294967524 00000004:00080000:3.0:1788876634.123201:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13cfd06300, transno 4294967525 00000004:00080000:3.0:1788876634.123204:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785ce00, transno 4294967526 00000004:00080000:3.0:1788876634.123206:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785d500, transno 4294967527 00000004:00080000:3.0:1788876634.123208:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cdc00, transno 4294967528 00000004:00080000:3.0:1788876634.123211:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3036a00, transno 4294967529 00000004:00080000:3.0:1788876634.123213:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35f9c00, transno 4294967530 00000004:00080000:3.0:1788876634.123216:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3035180, transno 4294967531 00000004:00080000:3.0:1788876634.123218:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13d3037800, transno 4294967532 00000004:00080000:3.0:1788876634.123220:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f35fb800, transno 4294967533 00000004:00080000:3.0:1788876634.123222:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed5180, transno 4294967534 00000004:00080000:3.0:1788876634.123225:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed7480, transno 4294967535 00000004:00080000:3.0:1788876634.123227:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797f100, transno 4294967536 00000004:00080000:3.0:1788876634.123230:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797ad80, transno 4294967537 00000004:00080000:3.0:1788876634.123232:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eeed6d80, transno 4294967538 00000004:00080000:3.0:1788876634.123234:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7978380, transno 4294967539 00000004:00080000:3.0:1788876634.123236:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7979500, transno 4294967540 00000004:00080000:3.0:1788876634.123238:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7978700, transno 4294967541 00000004:00080000:3.0:1788876634.123240:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25b480, transno 4294967542 00000004:00080000:3.0:1788876634.123243:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb258700, transno 4294967543 00000004:00080000:3.0:1788876634.123245:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25c700, transno 4294967544 00000004:00080000:3.0:1788876634.123248:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25ad80, transno 4294967545 00000004:00080000:3.0:1788876634.123250:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25df80, transno 4294967546 00000004:00080000:3.0:1788876634.123253:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e7979c00, transno 4294967547 00000004:00080000:3.0:1788876634.123255:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25dc00, transno 4294967548 00000004:00080000:3.0:1788876634.123257:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25d180, transno 4294967549 00000004:00080000:3.0:1788876634.123259:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c90000, transno 4294967550 00000004:00080000:3.0:1788876634.123262:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13f41cd880, transno 4294967551 00000004:00080000:3.0:1788876634.123264:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c91880, transno 4294967552 00000004:00080000:3.0:1788876634.123266:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c3c93480, transno 4294967553 00000004:00080000:3.0:1788876634.123269:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb259c00, transno 4294967554 00000004:00080000:3.0:1788876634.123272:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797a300, transno 4294967555 00000100:00100000:3.0:1788876634.123280:0:3664:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a13fa782d80 x1875771532283648/t4294967556(4294967556) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788876650 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788876634.123292:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa782d80/2, rc 0, transno 4294967556 00000100:00100000:3.0:1788876634.123297:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283648:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876634.123316:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797df80/2, rc 0, transno 8589934853 00000100:00100000:3.0:1788876634.123319:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284160:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876634.123328:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797c380/2, rc 0, transno 8589934849 00000100:00100000:3.0:1788876634.123332:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284672:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876634.123342:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797e300/2, rc 0, transno 8589934850 00000100:00100000:3.0:1788876634.123345:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284032:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876634.123355:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797e680/2, rc 0, transno 8589934852 00000100:00100000:3.0:1788876634.123357:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532284544:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788876634.123633:0:43311:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 7 in flight, 58 done 00000100:00100000:1.0:1788876634.124896:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876634.124920:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532286848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876634.125016:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.125264:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511231872 00000100:00100000:2.0:1788876634.125271:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511231872 00010000:00010000:2.0:1788876634.125305:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.125341:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:2.0:1788876634.125350:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+18:2398:x1875771511231872:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788876634.125362:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876634.125368:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125382:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125411:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d137b974/0xf5bf0f7e313a6756 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470bc expref: 18 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125427:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ec:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788876634.125432:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1ec:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788876634.125439:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125450:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125476:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876634.125510:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+17:2398:x1875771511231872:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 160us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876634.125518:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00010000:00010000:2.0:1788876634.125626:0:43963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000263f5f0/0xf5bf0f7e313a68a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704713a expref: 16 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876634.125639:0:43963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:43963:1875771532285952:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876634.125658:0:43963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125670:0:43963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125684:0:43963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125695:0:43963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125705:0:43963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125727:0:43963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876634.125886:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532283264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24252us (26154us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1788876634.125896:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000004:00080000:2.0:1788876634.125939:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa781500/2, rc 0, transno 4294967557 00000100:00100000:2.0:1788876634.125945:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283264:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876634.125974:0:43953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125984:0:43953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.125993:0:43953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126007:0:43953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126022:0:43953:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788876634.126094:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532282752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24746us (26425us total) trans 4294967558 rc 0/0 00000100:00100000:2.0:1788876634.126101:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000004:00080000:2.0:1788876634.126127:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb258e00/2, rc 0, transno 4294967558 00000100:00100000:2.0:1788876634.126131:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532282752:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788876634.126159:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876634.126165:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126173:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876634.126177:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126186:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126199:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126206:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313ae92a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126230:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876634.126233:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126238:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876634.126241:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126248:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126257:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126264:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313ae923 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.126278:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876634.126279:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876634.126281:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876634.126294:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.126868:0:43971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccbe3180/0xf5bf0f7e313a694e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047179 expref: 13 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.126884:0:43971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:43971:1875771532286720:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.126903:0:43971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.126913:0:43971:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.126920:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.126929:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.126937:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.126961:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.127073:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+14:3662:x1875771532284416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23142us (24938us total) trans 8589934854 rc 0/0 00000100:00100000:3.0:1788876634.127080:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00010000:00010000:3.0:1788876634.127116:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000881c45e2/0xf5bf0f7e313a67c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470e6 expref: 15 pid: 8456 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.127126:0:43960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:43960:1875771532286336:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.127138:0:43960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127178:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313a56b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046a80 expref: 14 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.127188:0:10319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10319:1875771532285312:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.127200:0:10319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127208:0:10319:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127214:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127229:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127236:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127251:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788876634.127332:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532283136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31255us (31608us total) trans 4294967559 rc 0/0 00000100:00100000:3.0:1788876634.127338:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00010000:00010000:3.0:1788876634.127360:0:43958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127369:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127377:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127384:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127396:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1788876634.127459:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532283520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31514us (31875us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1788876634.127468:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00010000:00010000:3.0:1788876634.127484:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876634.127489:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127497:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.127501:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127509:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127525:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127533:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313ae954 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127549:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876634.127552:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127559:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.127562:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127575:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127585:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127592:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313ae907 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127633:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.127637:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127643:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.127646:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127654:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127664:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127672:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005475ced0/0xf5bf0f7e313ae8f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127690:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127691:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127693:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127699:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127707:0:43952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127716:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127725:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127732:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127745:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.127817:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532283008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32133us (32322us total) trans 4294967561 rc 0/0 00000100:00100000:3.0:1788876634.127824:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00010000:00010000:3.0:1788876634.127840:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.127844:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127851:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.127855:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127864:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127874:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127882:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000005e171d/0xf5bf0f7e313ae8eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.127896:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127899:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.127900:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788876634.127926:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa781880/2, rc 0, transno 4294967559 00000100:00100000:3.0:1788876634.127933:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283136:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876634.127942:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb258a80/2, rc 0, transno 4294967561 00000100:00100000:3.0:1788876634.127946:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283008:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876634.127954:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa783480/2, rc 0, transno 4294967560 00000100:00100000:3.0:1788876634.127957:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532283520:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788876634.127985:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876634.128027:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+13:2398:x1875771511230464:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 11340us (13521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876634.128035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 293 00010000:00010000:3.0:1788876634.128080:0:43960:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128094:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128102:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128108:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128120:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.128200:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532282880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24960us (26180us total) trans 4294967562 rc 0/0 00000100:00100000:3.0:1788876634.128208:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00010000:00010000:3.0:1788876634.128223:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.128228:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128236:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.128239:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128248:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128258:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128266:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313ae93f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128279:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128281:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128282:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128363:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea0ca04/0xf5bf0f7e313a6916 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047164 expref: 12 pid: 8455 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.128373:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8453:1875771532286464:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.128385:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128394:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128403:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128412:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128420:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128438:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.128502:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532283392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25098us (26432us total) trans 4294967563 rc 0/0 00000100:00100000:3.0:1788876634.128509:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00010000:00010000:3.0:1788876634.128524:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.128529:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128536:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.128540:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128549:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128561:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128569:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7e2d90/0xf5bf0f7e313ae946 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128584:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128586:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128588:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128640:0:43961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f03d37a/0xf5bf0f7e313a671e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470a7 expref: 12 pid: 17045 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876634.128658:0:43961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:43961:1875771532286080:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.128671:0:43961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128680:0:43961:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128689:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128698:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128706:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128719:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.128795:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3662:x1875771532283776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26548us (29007us total) trans 8589934855 rc 0/0 00000100:00100000:3.0:1788876634.128802:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00010000:00010000:3.0:1788876634.128819:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876634.128823:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128836:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876634.128840:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128850:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128861:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128870:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313ae931 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.128885:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128886:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.128888:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876634.132991:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c13e1a2e/0xf5bf0f7e313a678e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370470d1 expref: 11 pid: 8453 timeout: 1721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.133080:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788876634.133115:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb259180/2, rc 0, transno 4294967562 00000100:00100000:2.0:1788876634.133123:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532282880:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876634.133135:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fa780700/2, rc 0, transno 4294967563 00000100:00100000:2.0:1788876634.133140:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283392:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876634.133162:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797d500/2, rc 0, transno 8589934854 00000100:00100000:2.0:1788876634.133167:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532284416:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876634.133177:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797fb80/2, rc 0, transno 8589934855 00000100:00100000:2.0:1788876634.133180:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876634.133267:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3664:x1875771532284160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35961us (36166us total) trans 8589934853 rc 0/0 00000100:00100000:0.0:1788876634.133277:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1788876634.133734:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.133878:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532286848 00000100:00100000:0.0:1788876634.133886:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532286848 00000100:00100000:0.0:1788876634.133935:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1788876634.133944:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3663:x1875771532286848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788876634.133973:0:43959:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:499 count 1 00010000:00010000:0.0:1788876634.133996:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.134016:0:43959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 11 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.134026:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f3:0x0].0x0 since=74s v=(0 0) 00010000:00010000:0.0:1788876634.134031:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788876634.134036:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.134069:0:43959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 11 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.134085:0:43959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 11 pid: 8456 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876634.134105:0:43959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532286976:192.168.203.11@tcp:104: 00000100:00100000:0.0:1788876634.134190:0:43959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876634.134409:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8456:1875771532286592:192.168.203.11@tcp:104: 00010000:00010000:3.0:1788876634.134430:0:8456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.134442:0:8456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.134451:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.134461:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.134470:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876634.134499:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788876634.134675:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3662:x1875771532283904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31113us (32568us total) trans 8589934856 rc 0/0 00000100:00100000:3.0:1788876634.134683:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00010000:00010000:2.0:1788876634.134760:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876634.134768:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.134776:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876634.134781:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.134791:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.134810:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.134818:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313ae94d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876634.134838:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876634.134840:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876634.134841:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788876634.134960:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e797ed80/2, rc 0, transno 8589934856 00000100:00100000:0.0:1788876634.134966:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532283904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876634.137947:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876634.138030:0:43959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:43959:1875771532286976:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788876634.138060:0:43959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.138136:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232000 00000100:00100000:1.0:1788876634.138143:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232000 00010000:00010000:1.0:1788876634.138187:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 12 pid: 8456 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876634.138224:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:1.0:1788876634.138232:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+12:2396:x1875771511232000:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788876634.138246:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876634.138251:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 12 pid: 8456 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.138263:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 12 pid: 8456 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.138284:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313a6a66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370471e2 expref: 12 pid: 8456 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.138301:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.138305:0:9553:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788876634.138311:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.138321:0:9553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.138350:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876634.138393:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511232000:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 162us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876634.138400:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 300 00010000:00010000:0.0:1788876634.138665:0:43959:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.138676:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.138686:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.138694:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876634.138712:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788876634.138938:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3663:x1875771532286848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4994us (5203us total) trans 4294967564 rc 0/0 00000100:00100000:0.0:1788876634.138945:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000004:00080000:2.0:1788876634.139027:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13e785d180/2, rc 0, transno 4294967564 00000100:00100000:2.0:1788876634.139034:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532286848:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788876634.139697:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876634.139706:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.139715:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876634.139720:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.139731:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.139809:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.139818:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e1715c7/0xf5bf0f7e313ae95b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876634.139842:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876634.139844:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876634.139846:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876634.600993:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876634.601064:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.601287:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287104 00000100:00100000:0.0:1788876634.601295:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287104 00000100:00100000:0.0:1788876634.601346:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1788876634.601355:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3663:x1875771532287104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876634.601382:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876634.601426:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3663:x1875771532287104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.601433:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1788876634.601520:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876634.602251:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876634.602263:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532287232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876634.602301:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876634.602332:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287232 00000100:00100000:0.0:1788876634.602336:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287232 00000100:00100000:0.0:1788876634.602368:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1788876634.602375:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532287232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876634.602400:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788876634.602435:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532287232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876634.602442:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1788876634.602474:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532287232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876634.606362:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532287360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876634.606426:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876634.606640:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287360 00000100:00100000:3.0:1788876634.606647:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287360 00000100:00100000:3.0:1788876634.606689:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1788876634.606698:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3665:x1875771532287360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876634.606727:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876634.606776:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+14:3665:x1875771532287360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876634.606783:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1788876634.606829:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532287360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788876634.989688:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788876635.009524:0:44163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 6a: mkdir + contained create ======= 10:10:33 (1788876633) 00000100:00100000:2.0:1788876635.076295:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.076333:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232128 00000100:00100000:2.0:1788876635.076342:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232128 00000100:00100000:2.0:1788876635.076395:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2397 00000100:00100000:2.0:1788876635.076407:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:33948:x1875771511232128:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876635.076426:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876635.076451:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313ae962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048832 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076520:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076536:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076550:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876635.076619:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876635.076623:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876635.076643:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076667:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313ae962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048832 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076683:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048832 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.076691:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe8fe00) 00010000:00010000:2.0:1788876635.076694:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876635.076697:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960e00, rc 0) 00000100:00100000:2.0:1788876635.076750:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33948:x1875771511232128:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 345us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.076758:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2397 00000100:00080000:2.0:1788876635.076779:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876635.089569:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.090228:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232256 00000100:00100000:2.0:1788876635.090240:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232256 00000100:00100000:2.0:1788876635.090299:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2398 00000100:00100000:2.0:1788876635.090310:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33948:x1875771511232256:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876635.090330:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876635.090352:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960200/0xf5bf0f7e313ae970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048839 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090411:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090427:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090439:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090452:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090459:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090465:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090522:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090531:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090538:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090544:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876635.090549:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090557:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090569:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe8fe00) 00010000:00010000:2.0:1788876635.090573:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876635.090577:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090584:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961200/0xf5bf0f7e313ae977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090596:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090633:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090640:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090646:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876635.090649:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090656:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090663:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee91ab1b (ffff8a13cfe8f400) 00010000:00010000:2.0:1788876635.090666:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876635.090669:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090675:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960400/0xf5bf0f7e313ae97e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090707:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960200/0xf5bf0f7e313ae970 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048839 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090722:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe8fe00) 00010000:00010000:2.0:1788876635.090725:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876635.090729:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960200/0xf5bf0f7e313ae970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048839 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876635.090738:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960200, rc 0) 00000100:00100000:2.0:1788876635.090794:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33948:x1875771511232256:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 485us (1232us total) trans 0 rc 301/301 00000100:00100000:2.0:1788876635.090802:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2398 00000100:00100000:1.0:1788876635.097992:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876635.098097:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232512 00000100:00100000:3.0:1788876635.098107:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232512 00000100:00100000:3.0:1788876635.098176:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2399 00000100:00100000:3.0:1788876635.098187:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33948:x1875771511232512:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1788876635.098248:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876635.098275:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960e00/0xf5bf0f7e313ae969 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048832 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098294:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cfe8fe00) 00010000:00010000:3.0:1788876635.098305:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876635.098385:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098399:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098409:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098421:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098428:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.098434:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099565:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099583:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099590:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876635.099687:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d49c316 reply state 00000000e8afc7ff transno 68719477397 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099697:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099703:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13f4518800) 00010000:00010000:3.0:1788876635.099706:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876635.099709:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788876635.099713:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x107:0x0]: returning size 4096 00010000:00010000:3.0:1788876635.099718:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099724:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099730:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099734:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876635.099738:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099744:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099755:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518200) 00010000:00010000:3.0:1788876635.099756:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876635.099759:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099764:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313ae985 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876635.099776:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d49c316 reply state 00000000e8afc7ff transno 68719477397 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099782:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876635.099787:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee91ab1b (ffff8a13f4518000) 00010000:00010000:3.0:1788876635.099789:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876635.099790:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788876635.099896:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:33948:x1875771511232512:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1708us (1911us total) trans 68719477397 rc 0/0 00000100:00100000:3.0:1788876635.099902:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2399 00000100:00100000:2.0:1788876635.624799:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532287488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876635.624870:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.624929:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287488 00000100:00100000:2.0:1788876635.624936:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287488 00000100:00100000:2.0:1788876635.624988:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1788876635.624999:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532287488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876635.625021:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876635.625062:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532287488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.625068:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00080000:2.0:1788876635.625103:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876635.625148:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532287488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876635.625387:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532287872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625432:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625452:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532288384:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625472:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625485:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625505:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625521:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788876635.625526:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532287744:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625549:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625576:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532288256:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625596:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625639:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625665:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876635.625689:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287744 00000100:00100000:3.0:1788876635.625692:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287744 00000100:00100000:3.0:1788876635.625729:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1788876635.625736:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532287744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625777:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532287744:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876635.625783:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1788876635.625804:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288896 00000100:00100000:3.0:1788876635.625808:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288896 00000100:00100000:3.0:1788876635.625830:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288768 00000100:00100000:3.0:1788876635.625833:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288768 00000100:00100000:3.0:1788876635.625852:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1788876635.625858:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3665:x1875771532288896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625887:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3665:x1875771532288896:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876635.625893:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1788876635.625904:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788876635.625910:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.625936:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532288768:12345-0@lo:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876635.625941:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788876635.626057:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532287744:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.626068:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788876635.626075:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532288896:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.626636:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287872 00000100:00100000:2.0:1788876635.626642:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287872 00000100:00100000:2.0:1788876635.626678:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288384 00000100:00100000:2.0:1788876635.626682:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288384 00000100:00100000:2.0:1788876635.626708:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288256 00000100:00100000:2.0:1788876635.626711:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288256 00000100:00100000:2.0:1788876635.626725:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1788876635.626731:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532287872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.626776:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532287872:12345-0@lo:400:kworker.0 Request processed in 46us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.626795:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:2.0:1788876635.626810:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1788876635.626816:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532288384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.626844:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532288384:12345-0@lo:400:kworker.0 Request processed in 29us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.626850:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1788876635.626862:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1788876635.626868:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532288256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.626894:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532288256:12345-0@lo:400:kworker.0 Request processed in 26us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.626900:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1788876635.626932:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532287616:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.626965:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.626992:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532288128:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627014:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.627030:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532288640:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627049:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.627070:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788876635.627157:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627187:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.627207:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627228:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.627243:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532289024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627262:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.627288:0:43300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532287616 00000100:00100000:2.0:1788876635.627292:0:43300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532287616 00000100:00100000:2.0:1788876635.627320:0:43300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876635.627327:0:43300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627361:0:43300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532287616:12345-0@lo:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627368:0:43300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876635.627393:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288640 00000100:00100000:2.0:1788876635.627396:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288640 00000100:00100000:2.0:1788876635.627420:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1788876635.627427:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532288640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627458:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532288640:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627464:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1788876635.627481:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288000 00000100:00100000:2.0:1788876635.627485:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288000 00000100:00100000:2.0:1788876635.627510:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1788876635.627517:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532288000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627544:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532288000:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627550:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1788876635.627572:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288128 00000100:00100000:2.0:1788876635.627576:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288128 00000100:00100000:2.0:1788876635.627597:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532288512 00000100:00100000:2.0:1788876635.627623:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532288512 00000100:00100000:2.0:1788876635.627638:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289024 00000100:00100000:2.0:1788876635.627641:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289024 00000100:00100000:2.0:1788876635.627652:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1788876635.627658:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532288128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627688:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532288128:12345-0@lo:400:kworker.0 Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627694:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1788876635.627706:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1788876635.627712:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532288512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627739:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532288512:12345-0@lo:400:kworker.0 Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627744:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1788876635.627755:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1788876635.627760:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532289024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627785:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532289024:12345-0@lo:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.627790:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00080000:2.0:1788876635.627809:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876635.627812:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876635.627814:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876635.627844:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627855:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627863:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532289024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627870:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532287616:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627879:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532288128:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627887:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532288640:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627929:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532288256:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627941:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532287872:0@lo:400:kworker.0 00000100:00100000:2.0:1788876635.627951:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532288384:0@lo:400:kworker.0 00000100:00100000:0.0:1788876635.630547:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876635.633481:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532289152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876635.633551:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876635.635308:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289152 00000100:00100000:2.0:1788876635.635321:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289152 00000100:00100000:2.0:1788876635.635385:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1788876635.635395:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532289152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876635.635432:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876635.635506:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532289152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.635514:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1788876635.635566:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532289152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876635.821727:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.821779:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.821814:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.821845:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.821874:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876635.821904:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232768 00000100:00100000:2.0:1788876635.821914:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232768 00000100:00100000:2.0:1788876635.821963:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232896 00000100:00100000:2.0:1788876635.821966:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232896 00000100:00100000:2.0:1788876635.821996:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1561 00000100:00100000:2.0:1788876635.822005:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511232768:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876635.822079:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511232768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876635.822088:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1561 00000100:00100000:2.0:1788876635.822105:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1562 00000100:00100000:2.0:1788876635.822113:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511232896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876635.822149:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511232896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876635.822197:0:43301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511232640 00000100:00100000:1.0:1788876635.822201:0:43301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511232640 00000100:00100000:1.0:1788876635.822232:0:43301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1788876635.822238:0:43301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511232640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876635.822264:0:43301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511232640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876635.822271:0:43301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:2.0:1788876635.822486:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1562 00000100:00100000:2.0:1788876635.822510:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233024 00000100:00100000:2.0:1788876635.822514:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233024 00000100:00100000:2.0:1788876635.822658:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233152 00000100:00100000:2.0:1788876635.822662:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233152 00000100:00100000:0.0:1788876635.824869:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1143 00000100:00100000:3.0:1788876635.826026:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1144 00000100:00080000:0.0:1788876635.826111:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876635.828339:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511233024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876635.828427:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511233024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3546us (6646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876635.828437:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1143 00000100:00100000:1.0:1788876635.833065:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511233152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876635.833211:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511233152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7174us (11335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876635.833222:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1144 00010000:00010000:0.0:1788876636.010640:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788876636.072551:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967564 is committed 00000001:00080000:1.0:1788876636.075919:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934856 is committed 00000001:00080000:2.0:1788876636.077022:0:43289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477397 is committed 00010000:00010000:3.0:1788876636.077579:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077598:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077635:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077641:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876636.077646:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077657:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077674:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee91ab1b (ffff8a13f4518000) 00010000:00010000:3.0:1788876636.077678:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876636.077684:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077691:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313ae98c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077715:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077725:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077734:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077739:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876636.077742:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077748:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077758:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13f4518800) 00010000:00010000:3.0:1788876636.077760:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876636.077763:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.077769:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313ae993 lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876636.161375:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.161463:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233280 00000100:00100000:0.0:1788876636.161478:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233280 00000100:00100000:0.0:1788876636.161542:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2400 00000100:00100000:0.0:1788876636.161553:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:33961:x1875771511233280:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1788876636.161585:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876636.161640:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae99a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048840 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161704:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161719:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161735:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876636.161783:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876636.161787:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876636.161808:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161831:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae99a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048840 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161847:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048840 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.161855:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbb00) 00010000:00010000:0.0:1788876636.161857:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876636.161861:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52800, rc 0) 00000100:00100000:0.0:1788876636.161928:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33961:x1875771511233280:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 376us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876636.161934:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2400 00000100:00100000:3.0:1788876636.170238:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876636.170287:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233408 00000100:00100000:1.0:1788876636.170305:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233408 00000100:00100000:1.0:1788876636.170397:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2401 00000100:00100000:1.0:1788876636.170411:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33961:x1875771511233408:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876636.170463:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876636.170558:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33961:x1875771511233408:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 150us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876636.170566:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2401 00000100:00100000:3.0:1788876636.173819:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.176113:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233536 00000100:00100000:0.0:1788876636.176127:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233536 00000100:00100000:0.0:1788876636.176206:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2402 00000100:00100000:0.0:1788876636.176216:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:33961:x1875771511233536:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876636.176251:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876636.176323:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:33961:x1875771511233536:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 108us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876636.176332:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2402 00000100:00100000:3.0:1788876636.184991:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.185062:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233664 00000100:00100000:0.0:1788876636.185076:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233664 00000100:00100000:0.0:1788876636.185167:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 921 00000100:00100000:0.0:1788876636.185178:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+11:33961:x1875771511233664:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876636.185209:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876636.185289:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+11:33961:x1875771511233664:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876636.185297:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 921 00000100:00080000:1.0:1788876636.186991:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876636.190494:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.190575:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511233792 00000100:00100000:0.0:1788876636.190589:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511233792 00000100:00100000:0.0:1788876636.190690:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 922 00000100:00100000:0.0:1788876636.190702:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+11:33961:x1875771511233792:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876636.190733:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876636.190801:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+11:33961:x1875771511233792:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 101us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876636.190809:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 922 00000100:00080000:1.0:1788876636.190892:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876636.266554:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.266681:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234048 00000100:00100000:0.0:1788876636.266692:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234048 00000100:00100000:0.0:1788876636.266752:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2403 00000100:00100000:0.0:1788876636.266761:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:33968:x1875771511234048:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:0.0:1788876636.266816:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876636.266846:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048840 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.266863:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bbb00) 00010000:00010000:0.0:1788876636.266874:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876636.266959:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.266972:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.266982:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.266998:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267005:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267011:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267418:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267426:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267436:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267441:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876636.267445:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267453:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267462:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb400) 00010000:00010000:0.0:1788876636.267465:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876636.267469:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267475:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876636.267490:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f819b14 reply state 00000000d2d2bc7b transno 68719477398 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267502:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.267508:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13ff5bb200) 00010000:00010000:0.0:1788876636.267511:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876636.267513:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876636.267632:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:33968:x1875771511234048:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 868us (1085us total) trans 68719477398 rc 0/0 00000100:00100000:0.0:1788876636.267640:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2403 00000100:00100000:2.0:1788876636.310981:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876636.311845:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234176 00000100:00100000:1.0:1788876636.311857:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234176 00000100:00100000:1.0:1788876636.311920:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2404 00000100:00100000:1.0:1788876636.311931:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:33971:x1875771511234176:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876636.311955:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876636.311979:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486e00/0xf5bf0f7e313ae9b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048847 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312043:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312057:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312069:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876636.312117:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876636.312121:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876636.312147:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312172:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486e00/0xf5bf0f7e313ae9b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048847 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312190:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048847 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.312199:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eee3d500) 00010000:00010000:1.0:1788876636.312202:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876636.312205:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486a00, rc 0) 00000100:00100000:1.0:1788876636.312260:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:33971:x1875771511234176:12345-192.168.203.11@tcp:101:rm.0 Request processed in 331us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876636.312267:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2404 00000100:00100000:1.0:1788876636.319185:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876636.319221:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234304 00000100:00100000:1.0:1788876636.319231:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234304 00000100:00100000:1.0:1788876636.319278:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2405 00000100:00100000:1.0:1788876636.319288:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:33971:x1875771511234304:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876636.319307:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876636.319328:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313ae9c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704884e expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319386:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319401:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319413:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319428:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319436:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319443:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319534:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319542:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319550:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876636.319593:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x108:0x0]: returning size 0 00000004:00200000:1.0:1788876636.319597:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876636.319630:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319642:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319650:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319657:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319668:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319674:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876636.319679:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319686:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319699:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eee3d500) 00010000:00010000:1.0:1788876636.319703:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876636.319707:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319715:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313ae9cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319727:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319734:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319741:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319746:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876636.319749:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319759:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319766:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13ff5bb200) 00010000:00010000:1.0:1788876636.319769:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876636.319772:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319778:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313ae9d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319801:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313ae9c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704884e expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319813:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704884e expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876636.319821:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x108:0x0].0x0 (ffff8a13eee3db00) 00010000:00010000:1.0:1788876636.319823:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788876636.319826:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487000, rc 0) 00000100:00100000:1.0:1788876636.319878:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:33971:x1875771511234304:12345-192.168.203.11@tcp:101:rm.0 Request processed in 591us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876636.319885:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2405 00000100:00100000:3.0:1788876636.330839:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876636.330881:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234560 00000100:00100000:0.0:1788876636.330891:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234560 00000100:00100000:0.0:1788876636.330946:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2406 00000100:00100000:0.0:1788876636.330956:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:33971:x1875771511234560:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876636.331005:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876636.331029:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313ae9d9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x108:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704884e expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331047:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x108:0x0].0x0 (ffff8a13eee3db00) 00010000:00010000:0.0:1788876636.331060:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048847 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331069:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eee3d500) 00010000:00010000:0.0:1788876636.331147:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876636.331171:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331183:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331193:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331203:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331210:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331216:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331297:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331305:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331311:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331469:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331477:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331485:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331492:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331499:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331505:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331529:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876636.331544:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331550:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331556:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331562:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876636.331566:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331573:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331580:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x108:0x0].0x0 (ffff8a13ff5bbb00) 00010000:00010000:0.0:1788876636.331583:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876636.331587:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331592:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313ae9ee lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331767:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331774:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331780:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331785:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876636.331788:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331799:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331807:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb400) 00010000:00010000:0.0:1788876636.331809:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876636.331811:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331817:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313ae9e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876636.331827:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2092aee reply state 000000001a6c7c16 transno 68719477399 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331836:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876636.331842:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13ff5bb200) 00010000:00010000:0.0:1788876636.331844:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876636.331846:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876636.331908:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:33971:x1875771511234560:12345-192.168.203.11@tcp:36:rm.0 Request processed in 953us (1076us total) trans 68719477399 rc 0/0 00000100:00100000:0.0:1788876636.331915:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2406 00010000:00010000:3.0:1788876636.334908:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876636.334923:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.334942:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876636.334950:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.334964:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.334986:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x108:0x0].0x0 (ffff8a13ff5bbb00) 00010000:00010000:3.0:1788876636.334989:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876636.334997:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.335006:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52200/0xf5bf0f7e313ae9f5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x108:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876636.335034:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876636.335036:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876636.335040:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876636.652596:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532289280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876636.652690:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876636.652862:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289280 00000100:00100000:3.0:1788876636.652871:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289280 00000100:00100000:3.0:1788876636.652928:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788876636.652937:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532289280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876636.652959:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876636.653023:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532289280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876636.653031:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1788876636.653216:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532289280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876637.034078:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876638.056772:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876639.086838:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876639.720844:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876639.720975:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532289536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876639.721056:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876639.722323:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289536 00000100:00100000:2.0:1788876639.722324:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532289664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876639.722331:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289536 00000100:00100000:2.0:1788876639.722364:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876639.722383:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289664 00000100:00100000:0.0:1788876639.722386:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289664 00000100:00100000:0.0:1788876639.722406:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1788876639.722416:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532289536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876639.722444:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876639.722485:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532289536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876639.722492:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1788876639.722510:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1788876639.722517:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532289664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876639.722531:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876639.722570:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532289664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876639.722575:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00080000:0.0:1788876639.722590:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876639.722594:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876639.722640:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967564 gen 2 00000004:00080000:0.0:1788876639.722646:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa782d80, transno 4294967556 00000004:00080000:0.0:1788876639.722655:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa781500, transno 4294967557 00000004:00080000:0.0:1788876639.722658:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb258e00, transno 4294967558 00000004:00080000:0.0:1788876639.722660:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa781880, transno 4294967559 00000004:00080000:0.0:1788876639.722663:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa783480, transno 4294967560 00000004:00080000:0.0:1788876639.722666:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb258a80, transno 4294967561 00000004:00080000:0.0:1788876639.722668:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb259180, transno 4294967562 00000004:00080000:0.0:1788876639.722670:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fa780700, transno 4294967563 00000004:00080000:0.0:1788876639.722672:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e785d180, transno 4294967564 00000100:00100000:0.0:1788876639.722682:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532289536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876639.722855:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934856 gen 2 00000004:00080000:2.0:1788876639.722859:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797c380, transno 8589934849 00000004:00080000:2.0:1788876639.722875:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797e300, transno 8589934850 00000004:00080000:2.0:1788876639.722878:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797ce00, transno 8589934851 00000004:00080000:2.0:1788876639.722880:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797e680, transno 8589934852 00000004:00080000:2.0:1788876639.722882:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797df80, transno 8589934853 00000004:00080000:2.0:1788876639.722884:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797d500, transno 8589934854 00000004:00080000:2.0:1788876639.722886:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797fb80, transno 8589934855 00000004:00080000:2.0:1788876639.722888:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13e797ed80, transno 8589934856 00000100:00100000:2.0:1788876639.722895:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532289664:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788876639.723760:0:43309:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000004:00080000:0.0:1788876639.724906:0:43311:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:3.0:1788876639.725146:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532289408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876639.725210:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876639.727283:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289408 00000100:00100000:1.0:1788876639.727295:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289408 00000100:00100000:1.0:1788876639.727357:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1788876639.727367:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532289408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876639.727402:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:1.0:1788876639.727419:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7aad880 x1875771532289408/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:35/0 lens 224/368 e 0 to 0 dl 1788876650 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876639.727508:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532289408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876639.727515:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1788876639.729299:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532289408:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788876640.111129:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876640.744757:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876640.744777:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532289792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876640.744849:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876640.744889:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532289920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876640.744915:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876640.744948:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289792 00000100:00100000:2.0:1788876640.744956:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289792 00000100:00100000:1.0:1788876640.744991:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532289920 00000100:00100000:1.0:1788876640.744997:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532289920 00000100:00100000:2.0:1788876640.745024:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1788876640.745036:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532289792:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876640.745040:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1788876640.745049:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532289920:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:2.0:1788876640.745069:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000004:00000024:1.0:1788876640.745080:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876640.745140:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532289792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876640.745142:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532289920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876640.745154:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1788876640.745163:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1788876640.745212:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532289920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876640.745226:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532289792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876640.745737:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532290304:0@lo:400:kworker.0 00000100:00100000:3.0:1788876640.745769:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876640.745787:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532290816:0@lo:400:kworker.0 00000100:00100000:3.0:1788876640.745805:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876640.745839:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532291328:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.745842:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290304 00000100:00100000:1.0:1788876640.745849:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290304 00000100:00100000:3.0:1788876640.745863:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876640.745884:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290816 00000100:00100000:3.0:1788876640.745885:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788876640.745889:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290816 00000100:00100000:3.0:1788876640.745894:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.745912:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291328 00000100:00100000:1.0:1788876640.745917:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291328 00000100:00100000:3.0:1788876640.745922:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876640.745938:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788876640.745943:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.745949:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532290304:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788876640.745967:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e785ea00 x1875771532290304/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876640.745970:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876640.745994:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290944 00000100:00100000:3.0:1788876640.745998:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290944 00000100:00100000:1.0:1788876640.746015:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532290304:12345-0@lo:400:kworker.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876640.746023:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1788876640.746037:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532290816:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876640.746058:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e785ce00 x1875771532290816/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876640.746085:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532290816:12345-0@lo:400:kworker.0 Request processed in 56us (279us total) trans 0 rc 0/0 00000100:00080000:0.0:1788876640.746207:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876640.746212:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876640.746214:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876640.746242:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1788876640.746257:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788876640.746264:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532291328:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788876640.746276:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e785e300 x1875771532291328/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876640.746297:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:1.0:1788876640.746308:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532291328:12345-0@lo:400:kworker.0 Request processed in 44us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876640.746316:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788876640.746331:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788876640.746337:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532290944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746366:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532290944:12345-0@lo:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.746367:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.746404:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876640.746430:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532290560:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.746448:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876640.746458:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532291072:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746475:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1788876640.746480:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876640.746502:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290560 00000100:00100000:2.0:1788876640.746502:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788876640.746508:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290560 00000100:00100000:2.0:1788876640.746511:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532290176:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746541:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1788876640.746549:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532290560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.746555:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:1.0:1788876640.746564:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eeed6680 x1875771532290560/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876640.746578:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532290688:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746625:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532290560:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.746628:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876640.746637:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1788876640.746646:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532291200:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746651:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290688 00000100:00100000:1.0:1788876640.746656:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290688 00000100:00100000:2.0:1788876640.746672:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876640.746678:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1788876640.746687:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.746704:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532290560:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746725:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532290688:12345-0@lo:400:kworker.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.746729:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532290688:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746742:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788876640.746758:0:43294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290048 00000100:00100000:2.0:1788876640.746762:0:43294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290048 00000100:00100000:1.0:1788876640.746780:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532290944:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746795:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532290304:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.746797:0:43294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788876640.746808:0:43294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746811:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532290816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876640.746822:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532291328:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.748702:0:43294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532290048:12345-0@lo:400:kworker.0 Request processed in 1893us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.748712:0:43294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788876640.748759:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290432 00000100:00100000:2.0:1788876640.748764:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290432 00000100:00100000:2.0:1788876640.748801:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291072 00000100:00100000:2.0:1788876640.748805:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291072 00000100:00100000:2.0:1788876640.748899:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291200 00000100:00100000:2.0:1788876640.748903:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291200 00000100:00100000:2.0:1788876640.748928:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788876640.748937:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.748978:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532290432:12345-0@lo:400:kworker.0 Request processed in 43us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.748985:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788876640.748997:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788876640.749004:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.749033:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532291072:12345-0@lo:400:kworker.0 Request processed in 31us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.749040:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788876640.750306:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788876640.750319:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.750375:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532291200:12345-0@lo:400:kworker.0 Request processed in 61us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.750382:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788876640.750409:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532290176 00000100:00100000:2.0:1788876640.750415:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532290176 00000100:00100000:2.0:1788876640.750448:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1788876640.750454:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532290176:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876640.750469:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac02a00 x1875771532290176/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876640.750498:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532290176:12345-0@lo:400:kworker.0 Request processed in 43us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.750504:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1788876640.752158:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532290432:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.752219:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532290176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.752230:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532291200:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.752239:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876640.752249:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532291072:0@lo:400:kworker.0 00000100:00080000:0.0:1788876640.753239:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876640.753246:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876640.753249:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876640.943631:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876640.943662:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876640.943687:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876640.943712:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876640.943729:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876640.943752:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235072 00000100:00100000:3.0:1788876640.943761:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235072 00000100:00100000:3.0:1788876640.943811:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235200 00000100:00100000:3.0:1788876640.943814:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235200 00000100:00100000:3.0:1788876640.943835:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1148 00000100:00100000:3.0:1788876640.943844:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511235072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876640.943904:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511235072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 61us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876640.943912:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1148 00000100:00100000:3.0:1788876640.943928:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1149 00000100:00100000:3.0:1788876640.943935:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511235200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876640.943955:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511235200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876640.943961:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1149 00000100:00080000:3.0:1788876640.943990:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876640.943995:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876640.944316:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234816 00000100:00100000:1.0:1788876640.944321:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234816 00000100:00100000:1.0:1788876640.944867:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234944 00000100:00100000:1.0:1788876640.944872:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234944 00000100:00100000:1.0:1788876640.944905:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1569 00000100:00100000:1.0:1788876640.944913:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2398:x1875771511234816:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:1.0:1788876640.944936:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e785ed80 x1875771511234816/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:36/0 lens 224/224 e 0 to 0 dl 1788876651 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876640.945251:0:43295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234688 00000100:00100000:2.0:1788876640.945256:0:43295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234688 00000100:00100000:2.0:1788876640.945379:0:43295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:2.0:1788876640.945388:0:43295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511234688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876640.945495:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2398:x1875771511234816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 581us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876640.945503:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1569 00000100:00100000:1.0:1788876640.945521:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1570 00000100:00100000:1.0:1788876640.945527:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511234944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876640.945554:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511234944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876640.945561:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1570 00000100:00080000:3.0:1788876640.945762:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876640.945767:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876640.946473:0:43295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511234688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1009us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876640.946483:0:43295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00010000:00010000:2.0:1788876641.129784:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876641.769491:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532291456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876641.769563:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876641.769692:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291456 00000100:00100000:3.0:1788876641.769702:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291456 00000100:00100000:3.0:1788876641.769758:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1788876641.769767:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532291456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876641.769799:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876641.769851:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532291456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876641.769861:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1788876641.769906:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532291456:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876642.153784:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788876642.281156:0:43289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477399 is committed 00010000:00010000:1.0:1788876642.281619:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281640:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281649:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281657:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876642.281664:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281675:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281699:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13ff5bb200) 00010000:00010000:1.0:1788876642.281704:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876642.281710:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281718:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52a00/0xf5bf0f7e313ae9af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281741:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281747:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281752:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281757:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876642.281761:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281767:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281775:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13ff5bb200) 00010000:00010000:1.0:1788876642.281778:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876642.281782:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.281789:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52800/0xf5bf0f7e313ae9e7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1788876642.754400:0:44558:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1788876642.854397:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876642.854487:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235328 00000100:00100000:1.0:1788876642.854496:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235328 00000100:00100000:1.0:1788876642.854566:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2407 00000100:00100000:1.0:1788876642.854578:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34038:x1875771511235328:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:1.0:1788876642.854597:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876642.854653:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048855 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854723:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854739:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854751:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876642.854802:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876642.854806:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876642.854826:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854851:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313ae9fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048855 expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854869:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048855 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876642.854879:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:1.0:1788876642.854882:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876642.854886:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487800, rc 0) 00010000:00000080:1.0:1788876642.854894:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f452c380 x1875771511235328/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:38/0 lens 576/688 e 0 to 0 dl 1788876653 ref 1 fl Interpret:/600/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788876642.854954:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34038:x1875771511235328:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 379us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876642.854961:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2407 00000100:00080000:3.0:1788876642.855303:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876642.865056:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876642.865543:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235456 00000100:00100000:1.0:1788876642.865553:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235456 00000100:00100000:0.0:1788876642.865838:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2408 00000100:00100000:0.0:1788876642.865850:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34038:x1875771511235456:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:0.0:1788876642.865871:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876642.865889:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313aea0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704885c expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.865950:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.865965:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.865977:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.865993:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866000:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866006:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866107:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866117:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866124:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876642.866159:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x107:0x0]: returning size 4096 00000004:00200000:0.0:1788876642.866163:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876642.866180:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866192:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866198:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866205:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866210:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876642.866214:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866223:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866234:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13eb147000) 00010000:00010000:0.0:1788876642.866237:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876642.866241:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866252:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53400/0xf5bf0f7e313aea11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866524:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866532:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866538:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866542:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876642.866545:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866552:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866561:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee91ab1b (ffff8a13ff5bb400) 00010000:00010000:0.0:1788876642.866564:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876642.866567:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866572:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53800/0xf5bf0f7e313aea18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866631:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52e00/0xf5bf0f7e313aea0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704885c expref: 9 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866646:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704885c expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876642.866653:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13ff5bb700) 00010000:00010000:0.0:1788876642.866656:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788876642.866658:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53c00, rc 0) 00010000:00000080:0.0:1788876642.866665:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f452d880 x1875771511235456/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:38/0 lens 592/688 e 0 to 0 dl 1788876653 ref 1 fl Interpret:/600/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876642.866726:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34038:x1875771511235456:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 879us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876642.866734:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2408 00000100:00100000:1.0:1788876642.871324:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876642.871430:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235712 00000100:00100000:3.0:1788876642.871440:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235712 00000100:00100000:3.0:1788876642.871496:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2409 00000100:00100000:3.0:1788876642.871505:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34038:x1875771511235712:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:3.0:1788876642.871667:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.871684:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.871695:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.871709:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.871716:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.871723:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872079:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872193:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872200:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872206:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876642.872210:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872217:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872229:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13ff5bb700) 00010000:00010000:3.0:1788876642.872232:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876642.872236:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872242:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313aea26 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876642.872254:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009696a8cc reply state 0000000020665756 transno 68719477400 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872264:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876642.872270:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x1a603d0b (ffff8a13fae0b500) 00010000:00010000:3.0:1788876642.872272:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876642.872274:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1788876642.872302:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb25ea00 x1875771511235712/t68719477400(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:38/0 lens 520/448 e 0 to 0 dl 1788876653 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876642.872472:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:34038:x1875771511235712:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 967us (1156us total) trans 68719477400 rc 0/0 00000100:00100000:3.0:1788876642.872480:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2409 00010000:00010000:0.0:1788876643.176784:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.200806:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788876644.791145:0:44656:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788876644.791200:0:44656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.791214:0:44656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.791222:0:44656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.791230:0:44656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.791432:0:44656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788876644.791439:0:44656:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788876644.791464:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788876644.791468:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788876644.791473:0:44656:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788876644.791495:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13efede000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788876644.791684:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876644.791693:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.791701:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a800 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:3.0:1788876644.791706:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.791715:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876644.791722:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876644.791728:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788876644.791731:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788876644.791734:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788876644.791759:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.791765:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788876644.791910:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.791919:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a800/0xf5bf0f7e313a85fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8604 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.791934:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876644.791936:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876644.791938:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876644.792025:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532291584:0@lo:39:umount.0 00000100:00100000:2.0:1788876644.792103:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876644.792269:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291584 00000100:00100000:3.0:1788876644.792277:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291584 00000100:00100000:3.0:1788876644.792384:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:3.0:1788876644.792393:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532291584:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788876644.792415:0:6540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a871c 00000100:00080000:3.0:1788876644.792430:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13eefda800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1788876644.792456:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f452f800 x1875771532291584/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:40/0 lens 224/224 e 0 to 0 dl 1788876655 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876644.792500:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532291584:12345-0@lo:39:umount.0 Request processed in 108us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876644.792507:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000020:00000080:3.0:1788876644.792517:0:6540:0:(genops.c:885:class_export_put()) final put ffff8a13f3696800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788876644.792559:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876644.792599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f3696800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876644.792665:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13eefda800 for lustre-MDT0000 00000100:00080000:2.0:1788876644.792696:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13efede000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876644.792704:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532291584:0@lo:39:umount.0 00000100:00100000:0.0:1788876644.792896:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532291712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876644.792927:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876644.792968:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788876644.792970:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788876644.792974:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788876644.792982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291712 00000100:00100000:3.0:1788876644.792986:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291712 00000100:00100000:3.0:1788876644.793023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788876644.793031:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532291712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876644.793041:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876644.793057:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8bc00/0xf5bf0f7e313a8604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a85fd expref: 24 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.793070:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876644.793109:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532291712:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876644.793119:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788876644.793142:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532291712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876644.795168:0:44656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795183:0:44656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795191:0:44656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795198:0:44656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795262:0:44656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876644.795270:0:44656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795278:0:44656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795285:0:44656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.795292:0:44656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797218:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876644.797230:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797240:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876644.797244:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797253:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876644.797260:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876644.797265:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876644.797268:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788876644.797307:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797314:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876644.797344:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797352:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313a851d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8524 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797366:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876644.797369:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797374:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73400 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876644.797378:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797384:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876644.797391:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876644.797396:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876644.797398:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788876644.797410:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797415:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876644.797440:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797449:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.797450:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.797452:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876644.797460:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876644.797476:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532291968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.797534:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876644.797587:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876644.797595:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532291840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.797641:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876644.797680:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291968 00000100:00100000:2.0:1788876644.797687:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291968 00000100:00100000:2.0:1788876644.797732:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532291840 00000100:00100000:2.0:1788876644.797735:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532291840 00000100:00100000:2.0:1788876644.797770:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788876644.797779:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532291968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876644.797790:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876644.797803:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40e00/0xf5bf0f7e313a862e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8627 expref: 24 pid: 43301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797815:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876644.797852:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3665:x1875771532291968:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.797858:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788876644.797873:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788876644.797879:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3662:x1875771532291840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876644.797887:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876644.797894:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72800/0xf5bf0f7e313a8524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a851d expref: 22 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.797903:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876644.797928:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3662:x1875771532291840:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.797934:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788876644.797987:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532291968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.798009:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532291840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876644.804843:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876644.804898:0:44656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876644.804909:0:44656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313a8627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a862e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876644.804928:0:44656:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788876644.804943:0:44656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.804950:0:44656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.804958:0:44656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.804966:0:44656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.804989:0:44656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876644.804996:0:44656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.805002:0:44656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.805008:0:44656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.805013:0:44656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876644.805094:0:44656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788876644.805099:0:44656:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788876644.805102:0:44656:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788876644.805137:0:44656:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788876644.805141:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788876644.805145:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788876644.805150:0:44656:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:0.0:1788876644.808781:0:44656:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:2.0:1788876644.809262:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876644.809271:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809281:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876644.809287:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809297:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876644.809304:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876644.809309:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788876644.809312:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788876644.809315:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788876644.809353:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809360:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876644.809386:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809393:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8b000/0xf5bf0f7e313a85ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a85f6 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809409:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876644.809413:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809418:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876644.809421:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809427:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876644.809432:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876644.809437:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876644.809439:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788876644.809440:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788876644.809453:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809458:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876644.809473:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809478:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313a8508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313a8516 expref: -99 pid: 43288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809487:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.809488:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.809490:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876644.809497:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876644.809512:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532292224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.809571:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876644.809634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292224 00000100:00100000:2.0:1788876644.809641:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292224 00000100:00100000:2.0:1788876644.809684:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788876644.809692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3663:x1875771532292224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876644.809704:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876644.809718:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40000/0xf5bf0f7e313a8516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8508 expref: 21 pid: 43294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809729:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876644.809776:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3663:x1875771532292224:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.809793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788876644.809839:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532292224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.809860:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532292096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876644.809883:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876644.809910:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292096 00000100:00100000:2.0:1788876644.809914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292096 00000100:00100000:2.0:1788876644.809937:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788876644.809943:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3665:x1875771532292096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876644.809951:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876644.809959:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff000/0xf5bf0f7e313a85f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a85ef expref: 20 pid: 43300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876644.809968:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876644.809992:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3665:x1875771532292096:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.809997:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788876644.810023:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532292096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876644.812625:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788876644.814162:0:43289:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477400 is committed 00000020:00000080:0.0:1788876644.814309:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1788876644.814318:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13f3692800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876644.814325:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a12c49fd000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876644.814330:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d1511800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876644.814336:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13eb2b1000 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 8 (0 0 2) 0 0 0 1: ffff8a12c5f20000 68719477400 stale:0 00000020:00080000:0.0:1788876644.814341:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13eb2b6000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788876644.814346:0:44656:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c4e34d40) has exports, disconnecting them 00000020:00080000:0.0:1788876644.814352:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13f3692800), last request at 1788876640 00000020:00000080:0.0:1788876644.814359:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8715 00000100:00080000:0.0:1788876644.814369:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13f3691800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876644.814391:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f3692800): rc 0 00000020:00000080:0.0:1788876644.814394:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13f3692800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788876644.814404:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a12c49fd000), last request at 1788876640 00000020:00000080:0.0:1788876644.814407:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a870e 00000100:00080000:0.0:1788876644.814412:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a12c49f9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876644.814419:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c49fd000): rc 0 00000020:00000080:0.0:1788876644.814420:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a12c49fd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788876644.814423:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d1511800), last request at 1788876599 00000020:00000080:0.0:1788876644.814427:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8707 00000100:00080000:0.0:1788876644.814429:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13c8696800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876644.814436:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d1511800): rc 0 00000020:00000080:0.0:1788876644.814438:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13d1511800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788876644.814442:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13eb2b1000), last request at 1788876642 00000020:00000080:0.0:1788876644.814451:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8571 00000020:00010000:0.0:1788876644.814462:0:44656:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13eb2b1000: total 3 00000100:00080000:0.0:1788876644.814466:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13d0b33000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876644.814510:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13eb2b1000): rc 0 00000020:00080000:0.0:1788876644.814514:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13eb2b6000), last request at 1788876594 00000020:00000080:0.0:1788876644.814516:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a856a 00000100:00080000:0.0:1788876644.814521:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13d1515000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876644.814525:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13eb2b6000): rc 0 00000020:00000080:0.0:1788876644.814527:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b6000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1788876644.814534:0:44656:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6208151bae0 00000100:00080000:0.0:1788876644.814551:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788876644.814554:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788876644.815461:0:44656:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788876644.815489:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13ef00c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788876644.815507:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815518:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815525:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815530:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876644.815535:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815552:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815569:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x1a603d0b (ffff8a13fae0b500) 00010000:00010000:3.0:1788876644.815571:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876644.815576:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815582:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35000/0xf5bf0f7e313aea2d lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788876644.815622:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f3692800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788876644.815644:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788876644.815647:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934856 gen 3 00000004:00080000:0.0:1788876644.815657:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1788876644.815662:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876644.815681:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d1511800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876644.815696:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876644.815720:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f3691800 for lustre-MDT0000 00000020:00000080:3.0:1788876644.815725:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c49f9800 for lustre-MDT0000 00000020:00000080:3.0:1788876644.815728:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c8696800 for lustre-MDT0000 00000020:00000080:3.0:1788876644.815731:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d1515000 for lustre-MDT0000 00000020:00010000:3.0:1788876644.815741:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13eb2b1000: total 0 00010000:00010000:3.0:1788876644.815782:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13eb2b1000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788876644.815806:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53c00/0xf5bf0f7e313aea1f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704885c expref: 3 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815840:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487800/0xf5bf0f7e313aea03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048855 expref: 2 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876644.815862:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13eb2b1000, canceled 2 locks, left on hash table 0. 00000100:00100000:2.0:1788876644.816145:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1875771532292480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876644.816173:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292352:0@lo:39:umount.0 00000100:00100000:2.0:1788876644.816232:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788876644.816294:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876644.816340:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292352 00000100:00100000:1.0:1788876644.816347:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292352 00000100:00100000:1.0:1788876644.816395:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1788876644.816404:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532292352:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788876644.816431:0:13623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85a2 00000100:00080000:1.0:1788876644.816438:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e62800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788876644.816455:0:13623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967322 00000100:00100000:1.0:1788876644.816579:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532292352:12345-0@lo:39:umount.0 Request processed in 175us (346us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788876644.816586:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00080000:1.0:1788876644.816652:0:44656:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788876644.816664:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13d212e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788876644.816672:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788876644.816674:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967564 gen 3 00000004:00080000:1.0:1788876644.816682:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788876644.816735:0:44656:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788876644.816754:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13f07aa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788876644.816905:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c4e34d40) has no exports 00000020:00080000:1.0:1788876644.817119:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c4e34d40) has no exports 00000100:00100000:2.0:1788876644.817930:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876644.817946:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875771532292864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876644.817967:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292608:0@lo:9:umount.0 00000100:00100000:2.0:1788876644.818005:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876644.818028:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292736:0@lo:9:umount.0 00000100:00100000:2.0:1788876644.818047:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876644.818091:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef00c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876644.818097:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292352:0@lo:39:umount.0 00010000:00010000:2.0:1788876644.818113:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876644.818662:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292608 00000100:00100000:2.0:1788876644.818669:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292608 00000100:00100000:2.0:1788876644.818720:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292736 00000100:00100000:2.0:1788876644.818723:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292736 00000100:00100000:2.0:1788876644.818756:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1788876644.818765:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532292608:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876644.818794:0:43954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85cc 00000100:00080000:2.0:1788876644.818802:0:43954:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e63000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876644.818836:0:43954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934856 00000100:00100000:2.0:1788876644.818968:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532292608:12345-0@lo:9:umount.0 Request processed in 204us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.818975:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1788876644.818987:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1788876644.818994:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532292736:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876644.819004:0:43954:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85da 00000100:00080000:2.0:1788876644.819010:0:43954:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876644.819025:0:43954:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967564 00000100:00100000:2.0:1788876644.819105:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532292736:12345-0@lo:9:umount.0 Request processed in 111us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876644.819111:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00080000:2.0:1788876644.819149:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d212e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876644.819157:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876644.819159:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876644.819162:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292608:0@lo:9:umount.0 00000100:00080000:2.0:1788876644.819171:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07aa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876644.819178:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876644.819180:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876644.819182:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532292736:0@lo:9:umount.0 00010000:00010000:2.0:1788876644.819203:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.819208:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876644.821475:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876644.821485:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876644.840999:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876644.841019:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532292992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876644.841093:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876644.841139:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292992 00000100:00100000:0.0:1788876644.841146:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292992 00000100:00100000:0.0:1788876644.841195:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1788876644.841202:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3664:x1875771532292992:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788876644.841209:0:6544:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876644.841250:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3664:x1875771532292992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (155us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876644.841256:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:02020000:0.0:1788876644.841292:0:3664:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788876644.850945:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876644.850953:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876644.850958:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876644.850965:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876644.850969:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1587 00000100:00080000:0.0:1788876644.850979:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876644.851019:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb299c00 x1875771532293120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876644.851109:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532293120:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788876644.851177:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876644.851269:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293120 00000100:00100000:0.0:1788876644.851277:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293120 00000100:00100000:0.0:1788876644.851320:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1788876644.851327:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532293120:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788876644.851343:0:6545:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788876644.867030:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532293120:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 15694us (15845us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876644.867044:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000020:00000080:3.0:1788876644.868136:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b1000/f0204769-56bd-4f5c-ab97-74c450c9e072 00000100:00080000:3.0:1788876644.868782:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876644.868790:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876644.868799:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532293120:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:2.0:1788876644.869056:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.869059:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876644.869062:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788876644.869752:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b1000/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:0.0:1788876644.869822:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0b33000 for lustre-MDT0000 00000020:00000080:1.0:1788876644.916561:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8586 00000020:00000080:1.0:1788876644.916577:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13ff365800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788876644.916594:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788876644.916698:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff365800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788876644.916716:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876644.916728:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788876644.916733:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a12c4e319c0) has no exports 00000020:00000080:0.0:1788876644.917161:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a857f 00000020:00000080:0.0:1788876644.917167:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13f4439000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876644.917220:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876644.917228:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788876644.917230:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13c511b800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788876644.917233:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788876644.917241:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876644.917773:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4439000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788876644.917820:0:44656:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cfe48180 - data ffff8a13f01f61b0/ffff8a12c3da9400 00000020:01000000:0.0:1788876644.917972:0:44656:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cfe48060 - data ffff8a13f035f0d8/ffff8a13fa5f9c00 00000100:00080000:3.0:1788876644.992948:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788876644.992957:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788876644.992972:0:44656:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13eb299880 x1875771532292352/t4294967323(4294967323) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876654 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876644.993002:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788876644.994760:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788876644.994767:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934856 gen 4 00000004:00080000:3.0:1788876644.994788:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876644.994791:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788876644.999206:0:43309:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788876644.999214:0:43309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x40:0x0] index 111 count 1 00000040:00080000:0.0:1788876644.999229:0:43309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 16 count 2 00000100:00080000:3.0:1788876645.006295:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788876645.006303:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967564 gen 4 00000004:00080000:3.0:1788876645.006330:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876645.006334:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788876645.007574:0:43311:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788876645.007580:0:43311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x42:0x0] index 111 count 1 00000040:00080000:1.0:1788876645.007592:0:43311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 16 count 2 00000020:00000080:3.0:1788876645.009178:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8539 00000020:00000080:3.0:1788876645.009188:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876645.009356:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788876645.010530:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a854e 00000020:00000080:3.0:1788876645.010539:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876645.010582:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788876645.010588:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876645.010596:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788876645.010618:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c4e30000) has no exports 00000004:01000000:3.0:1788876645.011254:0:44656:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788876645.011265:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85d3 00000020:00000080:3.0:1788876645.011392:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13f07ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876645.015120:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788876645.018382:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788876645.018417:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876645.018431:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876645.018436:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c5e3cd40) has no exports 00000020:00000080:3.0:1788876645.018455:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85c5 00000020:00000080:3.0:1788876645.018464:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a12c22f3800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788876645.019007:0:44656:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788876645.019011:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788876645.019015:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967564 gen 5 00000004:00080000:3.0:1788876645.019020:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876645.019022:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788876645.019064:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876645.019079:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876645.019085:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85b7 00000020:00000080:3.0:1788876645.019089:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a12c49ff800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876645.019093:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788876645.019097:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876645.019100:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876645.019102:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c5e399c0) has no exports 00000020:00000080:3.0:1788876645.019106:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a85b0 00000020:00000080:3.0:1788876645.019109:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13d2129800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788876645.019565:0:44656:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788876645.019568:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788876645.019570:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934856 gen 5 00000004:00080000:3.0:1788876645.019574:0:44656:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876645.019575:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788876645.019622:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876645.019627:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788876645.019638:0:44656:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788876645.019643:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a859b 00000020:00000080:3.0:1788876645.019647:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a12c49fd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876645.019650:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788876645.019653:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876645.019656:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876645.019658:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a13c79c4d40) has no exports 00000020:00000080:3.0:1788876645.020330:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8594 00000020:00000080:3.0:1788876645.020337:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13f5236000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876645.023055:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788876645.023068:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c22f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876645.023085:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07aa000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788876645.023095:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876645.023098:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788876645.023102:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876645.023187:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788876645.023193:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d2129800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876645.023197:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d212e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788876645.023200:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a12c49fb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876645.023202:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788876645.023205:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876645.023232:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788876645.023236:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f5236000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788876645.029992:0:44656:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788876645.030001:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788876645.030005:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788876645.030012:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876645.030065:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876645.030086:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876645.030113:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876645.030116:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876645.030122:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876645.030126:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788876645.030137:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876645.030239:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8555 00000020:00000080:0.0:1788876645.030246:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b2000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788876645.030251:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788876645.030256:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876645.030262:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788876645.030266:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c4e33380) has no exports 00000020:00000080:0.0:1788876645.030294:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876645.030298:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788876645.030302:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a855c 00000020:00000080:0.0:1788876645.030306:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b3000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788876645.030313:0:44656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13d0608000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788876645.030317:0:44656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608000 3 00000020:01000004:0.0:1788876645.030319:0:44656:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13d0608000 from lustre-MDT0000 00000020:00000080:0.0:1788876645.030334:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876645.030337:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788876645.030340:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788876645.030342:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788876645.030349:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788876645.030376:0:44656:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788876645.030380:0:44656:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788876645.030382:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788876645.030384:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876645.030386:0:44656:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788876645.030394:0:44656:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f4441800 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876645.030400:0:44656:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13fa7b9000 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876645.030404:0:44656:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c22ecd40) has exports, disconnecting them 00000020:00080000:0.0:1788876645.030408:0:44656:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13f4441800), last request at 1788876594 00000020:00000080:0.0:1788876645.030428:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8620 00000020:00010000:0.0:1788876645.030434:0:44656:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f4441800: total 2 00000100:00080000:0.0:1788876645.030437:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13f4442000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876645.030459:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13f4441800): rc 0 00000020:00080000:0.0:1788876645.030462:0:44656:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13fa7b9000), last request at 1788876594 00000020:00000080:0.0:1788876645.030500:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8501 00000020:00010000:0.0:1788876645.030504:0:44656:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13fa7b9000: total 2 00000100:00080000:0.0:1788876645.030507:0:44656:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7bf000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876645.030517:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13fa7b9000): rc 0 00000020:00080000:0.0:1788876645.030521:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c22ecd40) has no exports 00000100:00100000:0.0:1788876645.030574:0:43293:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13effa9600:43293] 0 exiting: rc = 1 00000100:00100000:1.0:1788876645.030899:0:43301:0:(service.c:3183:ptlrpc_main()) ll_mgs_0004: service thread [ffff8a13c66e8800:43301] 4 exiting: rc = 0 00000020:00000080:1.0:1788876645.030954:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ef00c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788876645.030962:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a12c49fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876645.030964:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788876645.030967:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876645.031018:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788876645.031022:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13eb2b6800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788876645.031024:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788876645.031028:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788876645.031053:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eb2b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788876645.035754:0:6528:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f4441800: total 0 00010000:00010000:2.0:1788876645.035765:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876645.035846:0:6528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f4441800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788876645.035886:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13f4407a00/0xf5bf0f7e313a8700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047beb expref: 5 pid: 43301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.035907:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73a00/0xf5bf0f7e313a86f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bdd expref: 4 pid: 43300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.035919:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72200/0xf5bf0f7e313a86eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047bd6 expref: 3 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.035930:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8b200/0xf5bf0f7e313a86f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37047be4 expref: 2 pid: 43301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.035941:0:6528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f4441800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788876645.035960:0:6528:0:(genops.c:885:class_export_put()) final put ffff8a13f4441800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:2.0:1788876645.035982:0:6528:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13fa7b9000: total 1 00010000:00010000:2.0:1788876645.036000:0:6528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13fa7b9000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788876645.036015:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313a8658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8651 expref: 14 pid: 43295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036027:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8a000/0xf5bf0f7e313a86d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a86cf expref: 13 pid: 43301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036038:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40600/0xf5bf0f7e313a8666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a865f expref: 12 pid: 43300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036047:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8aa00/0xf5bf0f7e313a86c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a86c1 expref: 11 pid: 43295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036060:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313a8682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a867b expref: 10 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036083:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13f4406200/0xf5bf0f7e313a86e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a86dd expref: 9 pid: 43295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036094:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40a00/0xf5bf0f7e313a8674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a866d expref: 8 pid: 43301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788876645.036101:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4441800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00010000:00010000:2.0:1788876645.036104:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8b400/0xf5bf0f7e313a8690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8689 expref: 7 pid: 43295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036112:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff600/0xf5bf0f7e313a869e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8697 expref: 6 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036124:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13f4406400/0xf5bf0f7e313a86ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a86a5 expref: 5 pid: 43295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788876645.036133:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f4442000 for MGS 00010000:00010000:2.0:1788876645.036133:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40400/0xf5bf0f7e313a863c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8635 expref: 4 pid: 43294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036142:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13f4407000/0xf5bf0f7e313a86ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a86b3 expref: 3 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036302:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefec00/0xf5bf0f7e313a864a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313a8643 expref: 2 pid: 43293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876645.036314:0:6528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13fa7b9000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788876645.036328:0:6528:0:(genops.c:885:class_export_put()) final put ffff8a13fa7b9000/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00010000:00010000:2.0:1788876645.036342:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876645.036344:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876645.036346:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876645.036353:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876645.036390:0:43294:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13d1a10600:43294] 1 exiting: rc = 0 00000100:00100000:2.0:1788876645.036492:0:43300:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8a12c1acd400:43300] 3 exiting: rc = 0 00000100:00100000:2.0:1788876645.036557:0:43295:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a12c200ac00:43295] 2 exiting: rc = 0 00000100:00100000:1.0:1788876645.036660:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036677:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036683:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036688:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036693:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036698:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036704:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036709:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036715:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036720:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036735:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036740:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036747:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036752:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036756:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036761:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036767:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036772:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036777:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036789:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036796:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036802:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036808:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036813:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036820:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036826:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036832:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036837:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036842:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036847:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036851:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036856:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036861:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036872:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036884:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036890:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036895:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036901:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036906:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036911:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036916:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036920:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036926:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036931:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036936:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036941:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036946:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036952:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036957:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036962:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036968:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036973:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036979:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036984:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036989:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036994:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.036999:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037004:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037009:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037014:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037019:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037024:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037028:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788876645.037032:0:44656:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788876645.037587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7b9000/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:0.0:1788876645.037635:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fa7bf000 for MGS 00000020:01000000:0.0:1788876645.043668:0:44656:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c2532960 - data ffff8a12c1c20510/ffff8a12c3692400 00000020:01000000:0.0:1788876645.043872:0:44656:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13d300fa80 - data ffff8a13ee81cbd0/ffff8a13fae71000 00000020:00000080:0.0:1788876645.044326:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a84fa 00000020:00000080:0.0:1788876645.044334:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13fa7b9800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788876645.044350:0:44656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13d0608000 from MGS, refs=2 00000020:01000004:0.0:1788876645.044353:0:44656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608000 2 00000020:01000004:0.0:1788876645.044356:0:44656:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13d0608000 from MGS 00000020:00000080:0.0:1788876645.044373:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876645.044380:0:44656:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788876645.044383:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13fa7bd800/MGS 00000020:00000080:0.0:1788876645.044385:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7bd800/MGS for MGS 00000020:01000000:0.0:1788876645.044392:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788876645.044511:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788876645.044516:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876645.044525:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788876645.044532:0:44656:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a13efedd000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876645.044538:0:44656:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c25eb380) has exports, disconnecting them 00000020:00080000:0.0:1788876645.044544:0:44656:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a13efedd000), last request at 1788876594 00000020:00000080:0.0:1788876645.044548:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a8612 00000020:00080000:0.0:1788876645.044558:0:44656:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13efedd000): rc 0 00000020:00000080:0.0:1788876645.044561:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13efedd000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788876645.047692:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876645.047707:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13efedd000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788876645.048643:0:44656:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788876645.048653:0:44656:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788876645.048657:0:44656:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788876645.048671:0:44656:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788876645.048699:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13efede000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788876645.048889:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788876645.048902:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788876645.048909:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13c4c3e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788876645.048913:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c4c3e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788876645.048920:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788876645.049002:0:44656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608000 1 00000020:00000080:1.0:1788876645.049011:0:44656:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313a84ec 00000020:00000080:1.0:1788876645.049017:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13fa7bf800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788876645.049027:0:44656:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788876645.049035:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876645.049046:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876645.049050:0:44656:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788876645.049054:0:44656:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c25ecd40) has no exports 00000020:00000080:3.0:1788876645.111905:0:44656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876645.111919:0:44656:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788876645.111927:0:44656:0:(genops.c:885:class_export_put()) final put ffff8a13c5f9f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876645.111931:0:44656:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f9f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788876645.111945:0:44656:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788876645.112087:0:44656:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13d0608800 00000020:02000400:3.0:1788876645.112161:0:44656:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788876645.234975:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788876645.864855:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876645.864864:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876645.864869:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876645.864877:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1632 00000100:00080000:1.0:1788876645.864884:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788876645.864890:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876645.864914:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25c000 x1875771532293376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876645.865002:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.865080:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.865114:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532294272:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.865135:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.865157:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788876645.865162:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.865185:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.865201:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532294144:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.865221:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.865252:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293760 00000100:00100000:1.0:1788876645.865259:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293760 00000100:00100000:1.0:1788876645.865294:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294272 00000100:00100000:1.0:1788876645.865298:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294272 00000100:00100000:1.0:1788876645.865327:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294144 00000100:00100000:1.0:1788876645.865330:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294144 00000100:00100000:1.0:1788876645.865342:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:1.0:1788876645.865351:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532294272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.865400:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532294272:12345-0@lo:400:kworker.0 Request processed in 50us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876645.865407:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:1.0:1788876645.865423:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:1.0:1788876645.865427:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532293760:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876645.865432:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876645.865591:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532293760:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876645.865599:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:1.0:1788876645.865652:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:1.0:1788876645.865656:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532294144:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876645.865661:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876645.865687:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532294144:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876645.865693:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00080000:1.0:1788876645.865719:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876645.865755:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788876645.865760:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788876645.865764:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788876645.865768:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876645.865772:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1587 00000100:00100000:3.0:1788876645.865866:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876645.865897:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876645.865917:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532294016:0@lo:400:kworker.0 00000100:00100000:3.0:1788876645.865937:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876645.865955:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788876645.865961:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532293248:0@lo:400:kworker.0 00000400:00000100:3.0:1788876645.865978:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532293248 offset 0 length 224: 4 00000100:00100000:3.0:1788876645.866000:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788876645.866020:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876645.866140:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532293376:0@lo:38:kworker.0 00000100:00100000:0.0:1788876645.866173:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876645.866328:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293376 00000100:00100000:3.0:1788876645.866334:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293376 00000100:00100000:3.0:1788876645.866370:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1788876645.866376:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532293376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876645.866393:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876645.866426:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532293376:12345-0@lo:38:kworker.0 Request processed in 49us (253us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876645.866433:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1788876645.866611:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293632 00000100:00100000:2.0:1788876645.866617:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293632 00000100:00100000:2.0:1788876645.866655:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294016 00000100:00100000:2.0:1788876645.866658:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294016 00000100:00100000:2.0:1788876645.866676:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1788876645.866685:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532293632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876645.866724:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532293632:12345-0@lo:400:kworker.0 Request processed in 42us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876645.866731:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1788876645.866744:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788876645.866750:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532294016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788876645.866881:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876645.866905:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25d880 x1875771532294400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876645.866922:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532294144:0@lo:400:kworker.0 00000100:00100000:2.0:1788876645.867016:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532294016:12345-0@lo:400:kworker.0 Request processed in 265us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876645.867023:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1788876645.867046:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532294528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876645.867119:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532294400:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788876645.867165:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788876645.867168:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788876645.867172:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788876645.867176:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876645.867180:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1587 00000100:00080000:1.0:1788876645.867185:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876645.867199:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa714a80 x1875771532294656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876645.867211:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.867230:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532294272:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.867258:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.867283:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293504 00000100:00100000:1.0:1788876645.867287:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293504 00000100:00100000:1.0:1788876645.867316:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532293888 00000100:00100000:1.0:1788876645.867319:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532293888 00000100:00100000:1.0:1788876645.867343:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788876645.867350:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532293888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876645.867386:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532293888:12345-0@lo:400:kworker.0 Request processed in 36us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876645.867395:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788876645.867407:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1788876645.867411:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3663:x1875771532293504:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876645.867416:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876645.867440:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3663:x1875771532293504:12345-0@lo:400:kworker.0 Request processed in 26us (1542us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876645.867446:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00080000:1.0:1788876645.867473:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876645.867478:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876645.867480:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876645.872492:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532293888:0@lo:400:kworker.0 00000100:00080000:3.0:1788876645.872513:0:3663:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876645.872519:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876645.872523:0:3663:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876645.872528:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876645.872532:0:3663:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1587 00000100:00080000:3.0:1788876645.872540:0:3663:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876645.872578:0:3663:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e785d500 x1875771532294784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876645.872615:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876645.872633:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532294016:0@lo:400:kworker.0 00000100:00100000:2.0:1788876645.872885:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.875383:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876645.875449:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788876645.875556:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294400 00000100:00100000:0.0:1788876645.875564:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294400 00000100:00100000:0.0:1788876645.875640:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:0.0:1788876645.875648:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532294400:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788876645.875671:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876645.875719:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532294400:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (341us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876645.875727:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00080000:1.0:1788876645.876107:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876645.876112:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532293376:0@lo:38:kworker.0 00000100:00100000:1.0:1788876645.876144:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532294656:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788876645.876180:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876645.876209:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532294784:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788876645.876235:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876645.876269:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876645.876275:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876645.876278:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532294400:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788876645.876355:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294656 00000100:00100000:0.0:1788876645.876360:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294656 00000100:00100000:0.0:1788876645.876392:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294784 00000100:00100000:0.0:1788876645.876395:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294784 00000100:00100000:0.0:1788876645.876412:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:0.0:1788876645.876417:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532294656:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788876645.876432:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876645.876479:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532294656:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 61us (298us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876645.876485:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:0.0:1788876645.876497:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1788876645.876501:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532294784:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788876645.876510:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876645.876535:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532294784:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 32us (299us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876645.876541:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00080000:1.0:1788876645.876720:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876645.876725:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876645.876728:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532294656:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788876645.876736:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876645.876740:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876645.876743:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532294784:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788876645.879214:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294528 00000100:00100000:3.0:1788876645.879230:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294528 00000100:00100000:3.0:1788876645.879339:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:3.0:1788876645.879349:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532294528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876645.879377:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876645.879451:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532294528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (6567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876645.880863:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1788876645.882396:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532294528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876646.064033:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876646.064088:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876646.064113:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511235840 offset 0 length 224: 4 00000100:00100000:3.0:1788876646.064132:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876646.064162:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876646.064201:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235968 00000100:00100000:3.0:1788876646.064210:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235968 00000100:00100000:3.0:1788876646.064249:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236096 00000100:00100000:3.0:1788876646.064252:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236096 00000100:00100000:3.0:1788876646.064291:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1573 00000100:00100000:3.0:1788876646.064302:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511236096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876646.064373:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511236096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876646.064381:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1573 00000100:00100000:1.0:1788876646.064624:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2417 00000100:00100000:1.0:1788876646.064631:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875771511235968:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:1.0:1788876646.064638:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:1.0:1788876646.064664:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875771511235968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (643us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876646.064669:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2417 00000100:00100000:3.0:1788876646.064796:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236224 00000100:00100000:3.0:1788876646.064801:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236224 00000100:00100000:3.0:1788876646.064832:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236352 00000100:00100000:3.0:1788876646.064834:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236352 00000100:00100000:3.0:1788876646.064853:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1152 00000100:00100000:3.0:1788876646.064859:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876646.064884:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876646.064890:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1152 00000100:00100000:3.0:1788876646.064910:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1153 00000100:00100000:3.0:1788876646.064916:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876646.064935:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876646.064941:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1153 00000100:00080000:3.0:1788876646.064957:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876646.064960:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876646.064962:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876646.100806:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876646.102544:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236480 00000100:00100000:1.0:1788876646.102558:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236480 00000100:00100000:1.0:1788876646.102622:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2418 00000100:00100000:1.0:1788876646.102630:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511236480:12345-192.168.203.11@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1788876646.102652:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876646.102725:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511236480:12345-192.168.203.11@tcp:38:ptlrpcd_01_00.0 Request processed in 94us (1928us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876646.102732:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2418 00010000:00010000:3.0:1788876646.254486:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876646.892120:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532294912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876646.892194:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876646.892292:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532294912 00000100:00100000:3.0:1788876646.892300:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532294912 00000100:00100000:3.0:1788876646.892346:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1788876646.892355:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532294912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876646.892385:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876646.892442:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532294912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876646.892449:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1788876646.892914:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532294912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876647.274102:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876648.297463:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876649.324313:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876650.347960:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876650.985909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876650.985920:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876650.985925:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876650.985937:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1633 00000100:00080000:0.0:1788876650.985947:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788876650.985956:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876650.985989:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb299880 x1875771532295296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876650.986010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876650.986016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876650.986021:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788876650.986021:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532295040:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876650.986044:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1633 00000100:00080000:0.0:1788876650.986048:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876650.986071:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876650.986096:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb299c00 x1875771532295424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876650.986118:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876650.986148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876650.986154:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876650.986158:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876650.986165:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1633 00000100:00080000:0.0:1788876650.986169:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876650.986175:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876650.986189:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876650.986198:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532295168:0@lo:400:kworker.0 00000100:00100000:0.0:1788876650.986199:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa781c00 x1875771532295680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1788876650.986225:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532295168 offset 0 length 224: 4 00000100:00080000:0.0:1788876650.986232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876650.986237:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876650.986240:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876650.986244:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1633 00000100:00080000:0.0:1788876650.986248:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876650.986251:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876650.986262:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295040 00000100:00100000:0.0:1788876650.986264:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa782d80 x1875771532295936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876650.986270:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295040 00000100:00100000:0.0:1788876650.986302:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876650.986331:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1788876650.986341:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532295040:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876650.986351:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788876650.986373:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876650.986379:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876650.986386:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532295552:0@lo:400:kworker.0 00000100:00100000:0.0:1788876650.986426:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876650.986426:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532295040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876650.986436:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1788876650.986463:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295552 00000100:00100000:0.0:1788876650.986467:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295552 00000100:00080000:2.0:1788876650.986485:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876650.986491:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876650.986504:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1788876650.986518:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532295552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876650.986557:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532295552:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876650.986597:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876650.986623:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788876650.986655:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876650.986685:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532295296:0@lo:38:kworker.0 00000100:00100000:1.0:1788876650.986709:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876650.986728:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532295424:0@lo:38:kworker.0 00000100:00100000:1.0:1788876650.986750:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876650.986768:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532295680:0@lo:38:kworker.0 00000100:00100000:1.0:1788876650.986787:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876650.986803:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532295936:0@lo:38:kworker.0 00000100:00100000:1.0:1788876650.986822:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876650.986882:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295296 00000100:00100000:1.0:1788876650.986886:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295296 00000100:00100000:1.0:1788876650.986911:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788876650.986917:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532295296:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876650.986947:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876650.986983:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532295296:12345-0@lo:38:kworker.0 Request processed in 66us (273us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876650.986990:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788876650.987008:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295808 00000100:00100000:1.0:1788876650.987011:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295808 00000100:00100000:1.0:1788876650.987047:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296064 00000100:00100000:1.0:1788876650.987051:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296064 00000100:00100000:1.0:1788876650.987066:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295424 00000100:00100000:1.0:1788876650.987069:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295424 00000100:00100000:1.0:1788876650.987077:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295680 00000100:00100000:1.0:1788876650.987079:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295680 00000100:00100000:1.0:1788876650.987086:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532295936 00000100:00100000:1.0:1788876650.987088:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532295936 00000100:00100000:1.0:1788876650.987099:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788876650.987105:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876650.987139:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532295808:12345-0@lo:400:kworker.0 Request processed in 34us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876650.987145:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788876650.987157:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788876650.987164:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876650.987195:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532296064:12345-0@lo:400:kworker.0 Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876650.987201:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788876650.987213:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1788876650.987217:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876650.987227:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876650.987267:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295424:12345-0@lo:38:kworker.0 Request processed in 48us (515us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876650.987273:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1788876650.987284:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1788876650.987288:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876650.987297:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876650.987319:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295680:12345-0@lo:38:kworker.0 Request processed in 29us (531us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876650.987325:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1788876650.987336:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1788876650.987340:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876650.987349:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788876650.987895:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788876650.988576:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788876650.988587:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967323 is committed 00000020:00000080:2.0:1788876650.988592:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a13d0e65800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876650.988631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e65800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788876650.988687:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e62800 for lustre-MDT0001 00000001:00100000:2.0:1788876650.989373:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876650.989377:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13d0e67800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876650.989395:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e67800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788876650.989429:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e63000 for lustre-OST0000 00000100:00100000:2.0:1788876650.989507:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532295552:0@lo:400:kworker.0 00000100:00100000:2.0:1788876650.989522:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532295808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876650.989572:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532295040:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876650.989630:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876650.989635:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876650.989638:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532295296:0@lo:38:kworker.0 00000100:00080000:2.0:1788876650.989648:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876650.989651:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876650.989654:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532295424:0@lo:38:kworker.0 00000100:00080000:2.0:1788876650.989663:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876650.989666:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876650.989668:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532295680:0@lo:38:kworker.0 00000100:00100000:2.0:1788876650.989703:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788876650.990657:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532295936:12345-0@lo:38:kworker.0 Request processed in 3311us (3829us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876650.990669:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00080000:1.0:1788876650.990723:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876650.990729:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876650.990734:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532295936:0@lo:38:kworker.0 00000001:00100000:2.0:1788876650.993220:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876650.993232:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13fa7bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876650.993304:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7bd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788876650.993360:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff363000 for lustre-OST0001 00000100:00100000:0.0:1788876651.002997:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1788876651.184206:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876651.184241:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511236608 offset 0 length 224: 4 00000100:00100000:3.0:1788876651.184261:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876651.184298:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876651.184331:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876651.184361:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236992 00000100:00100000:3.0:1788876651.184370:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236992 00000100:00100000:3.0:1788876651.184420:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237120 00000100:00100000:3.0:1788876651.184423:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237120 00000100:00100000:3.0:1788876651.184446:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1155 00000100:00100000:3.0:1788876651.184455:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876651.184525:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511236992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876651.184533:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1155 00000100:00100000:3.0:1788876651.184552:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1156 00000100:00100000:3.0:1788876651.184558:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511237120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876651.184581:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2397:x1875771511237120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876651.184587:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1156 00000100:00080000:3.0:1788876651.184731:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876651.184736:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876651.184908:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236736 00000100:00100000:1.0:1788876651.184913:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236736 00000100:00100000:1.0:1788876651.185122:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511236864 00000100:00100000:1.0:1788876651.185126:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511236864 00000100:00100000:2.0:1788876651.185181:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2422 00000100:00100000:2.0:1788876651.185188:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511236736:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788876651.185207:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876651.185208:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1576 00000100:00100000:1.0:1788876651.185215:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511236864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876651.185242:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511236864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876651.185242:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511236736:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 53us (1045us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876651.185249:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1576 00000100:00100000:2.0:1788876651.189634:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2422 00000100:00080000:0.0:1788876651.198156:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876651.370008:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876652.009455:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532296192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876652.009537:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876652.009631:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296192 00000100:00100000:3.0:1788876652.009639:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296192 00000100:00100000:3.0:1788876652.009720:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00080000:1.0:1788876652.009863:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876652.009939:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532296192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876652.009975:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876652.010041:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532296192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 311us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876652.010048:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1788876652.010145:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532296192:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876652.393335:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876653.418004:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876653.873336:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876653.873432:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876653.880657:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237248 00000100:00100000:2.0:1788876653.880678:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237248 00000100:00080000:1.0:1788876653.880810:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876653.880957:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237376 00000100:00100000:0.0:1788876653.880962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237376 00000100:00100000:0.0:1788876653.881061:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1788876653.881072:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511237248:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876653.881088:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:0.0:1788876653.881110:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x186:0x0] updating lvb size from disk: 0 -> 7 00002000:00010000:0.0:1788876653.881123:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x186:0x0] updating lvb mtime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881126:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x186:0x0] updating lvb ctime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881129:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x186:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788876653.881162:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851c6ce7/0xf5bf0f7e313a43ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370467bd expref: 11 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876653.881201:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x185:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788876653.881204:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x185:0x0] updating lvb mtime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881206:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x185:0x0] updating lvb ctime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881209:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x185:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788876653.881216:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d1f75cc/0xf5bf0f7e313a437d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046793 expref: 10 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876653.881238:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbe34b92/0xf5bf0f7e313a28b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704652b expref: 9 pid: 17045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876653.881250:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876653.881309:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511237248:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 238us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876653.881317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1788876653.881334:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1788876653.881340:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511237376:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788876653.881352:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:0.0:1788876653.881363:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x186:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788876653.881365:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x186:0x0] updating lvb mtime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881368:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x186:0x0] updating lvb ctime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881371:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x186:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788876653.881382:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313a43b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370467a8 expref: 11 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876653.881400:0:6525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x185:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:0.0:1788876653.881402:0:6525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x185:0x0] updating lvb mtime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881405:0:6525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x185:0x0] updating lvb ctime from disk: 0 -> 1788876424 00002000:00010000:0.0:1788876653.881406:0:6525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x185:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788876653.881414:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313a4345 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704677e expref: 10 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876653.881435:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000056d7286/0xf5bf0f7e313a28bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37046532 expref: 9 pid: 17045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876653.881447:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876653.881468:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511237376:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 128us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876653.881474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00080000:1.0:1788876653.883561:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876654.441128:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876655.464958:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876656.106045:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532296320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876656.106127:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876656.106213:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296320 00000100:00100000:2.0:1788876656.106223:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296320 00000100:00100000:2.0:1788876656.106282:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1788876656.106292:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532296320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876656.106325:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876656.106375:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532296320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876656.106386:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1788876656.106440:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532296320:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788876656.107076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876656.107081:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876656.107085:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876656.107095:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1638 00000100:00080000:1.0:1788876656.107099:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788876656.107105:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876656.107126:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25e300 x1875771532296576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876656.107142:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876656.107146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876656.107147:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876656.107151:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1638 00000100:00080000:1.0:1788876656.107153:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876656.107156:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876656.107173:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25f100 x1875771532296704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876656.107200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876656.107205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876656.107206:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876656.107210:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1638 00000100:00080000:1.0:1788876656.107212:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876656.107215:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876656.107254:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcc4a80 x1875771532296960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876656.107275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876656.107278:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876656.107280:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876656.107283:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1638 00000100:00080000:1.0:1788876656.107286:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876656.107289:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876656.107302:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcc5180 x1875771532297216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876656.107410:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876656.107462:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876656.107521:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532296576:0@lo:38:kworker.0 00000100:00100000:1.0:1788876656.107555:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876656.107652:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876656.107675:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532297088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876656.107707:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876656.108655:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876656.108664:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532296448:0@lo:400:kworker.0 00000400:00000100:3.0:1788876656.108692:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532296448 offset 0 length 224: 4 00000100:00100000:3.0:1788876656.108743:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876656.108770:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876656.108811:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297344 00000100:00100000:3.0:1788876656.108817:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297344 00000100:00100000:3.0:1788876656.108871:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297088 00000100:00100000:3.0:1788876656.108874:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297088 00000100:00100000:3.0:1788876656.108895:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1788876656.108902:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532297344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876656.108945:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532297344:12345-0@lo:400:kworker.0 Request processed in 43us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876656.108952:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:3.0:1788876656.108967:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:3.0:1788876656.108973:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876656.109011:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532297088:12345-0@lo:400:kworker.0 Request processed in 38us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876656.109017:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:3.0:1788876656.109060:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532297344:0@lo:400:kworker.0 00000100:00080000:3.0:1788876656.109084:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876656.109099:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296832 00000100:00100000:3.0:1788876656.109102:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296832 00000100:00100000:3.0:1788876656.109814:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1788876656.109821:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876656.110057:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532296832:12345-0@lo:400:kworker.0 Request processed in 234us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876656.110064:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1788876656.110112:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532296832:0@lo:400:kworker.0 00000100:00080000:3.0:1788876656.110136:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876656.110864:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296576 00000100:00100000:0.0:1788876656.110875:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296576 00000100:00100000:0.0:1788876656.110924:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788876656.110934:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532296576:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876656.110963:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876656.111039:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532296576:12345-0@lo:38:kworker.0 Request processed in 106us (3481us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876656.111050:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:1.0:1788876656.111393:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876656.111403:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876656.111407:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532296576:0@lo:38:kworker.0 00000100:00100000:1.0:1788876656.111420:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532296704:0@lo:38:kworker.0 00000100:00100000:1.0:1788876656.111467:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876656.111535:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532296960:0@lo:38:kworker.0 00000100:00100000:1.0:1788876656.111570:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876656.111597:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532297216:0@lo:38:kworker.0 00000100:00100000:1.0:1788876656.111722:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876656.111762:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296704 00000100:00100000:1.0:1788876656.111772:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296704 00000100:00100000:1.0:1788876656.111918:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532296960 00000100:00100000:1.0:1788876656.111923:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532296960 00000100:00100000:1.0:1788876656.111944:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297216 00000100:00100000:1.0:1788876656.111947:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297216 00000100:00100000:1.0:1788876656.111960:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1788876656.111965:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532296704:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876656.111980:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876656.112035:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532296704:12345-0@lo:38:kworker.0 Request processed in 68us (568us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876656.112104:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1788876656.112119:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:1.0:1788876656.112123:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532296960:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876656.112133:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876656.112196:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532296960:12345-0@lo:38:kworker.0 Request processed in 67us (621us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876656.112205:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:1.0:1788876656.112217:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:1.0:1788876656.112220:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532297216:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876656.112229:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876656.112261:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532297216:12345-0@lo:38:kworker.0 Request processed in 39us (539us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876656.112270:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00080000:1.0:1788876656.112305:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876656.112309:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876656.112312:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532296704:0@lo:38:kworker.0 00000100:00080000:1.0:1788876656.112498:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876656.112502:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876656.112505:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532296960:0@lo:38:kworker.0 00000100:00080000:1.0:1788876656.112513:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876656.112517:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876656.112519:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532297216:0@lo:38:kworker.0 00000100:00100000:2.0:1788876656.112940:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532297088:0@lo:400:kworker.0 00000100:00100000:1.0:1788876656.304864:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876656.304908:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876656.304944:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:1.0:1788876656.304972:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511237504 offset 0 length 224: 4 00000100:00100000:1.0:1788876656.305057:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876656.305096:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238016 00000100:00100000:1.0:1788876656.305106:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238016 00000100:00100000:1.0:1788876656.305172:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237888 00000100:00100000:1.0:1788876656.305175:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237888 00000100:00100000:1.0:1788876656.305201:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1158 00000100:00100000:1.0:1788876656.305212:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511238016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876656.305284:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511238016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876656.305292:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1158 00000100:00100000:1.0:1788876656.305308:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1159 00000100:00100000:1.0:1788876656.305314:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511237888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876656.305339:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511237888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876656.305344:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1159 00000100:00100000:2.0:1788876656.305435:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237632 00000100:00100000:2.0:1788876656.305440:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237632 00000100:00100000:2.0:1788876656.305479:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511237760 00000100:00100000:2.0:1788876656.305483:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511237760 00000100:00100000:2.0:1788876656.305508:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1579 00000100:00100000:2.0:1788876656.305516:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511237760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876656.305547:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511237760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876656.305553:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1579 00000100:00100000:2.0:1788876656.305565:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2426 00000100:00100000:2.0:1788876656.305569:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511237632:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788876656.305589:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876656.305645:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511237632:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 74us (791us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876656.305652:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2426 00000100:00080000:3.0:1788876656.310244:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876656.310257:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876656.310260:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876656.498280:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876657.129062:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532297472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876657.129141:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876657.129290:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297472 00000100:00100000:3.0:1788876657.129298:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297472 00000100:00100000:3.0:1788876657.129366:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1788876657.129379:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532297472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876657.129416:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876657.129479:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532297472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876657.129487:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1788876657.129585:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532297472:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788876657.519351:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876658.538741:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876659.561790:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876660.588993:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788876661.224892:0:3663:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876645/real 1788876645] req@ffff8a13eb25f800 x1875771532293248/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876661.224922:0:3663:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13eb25f800 x1875771532293248/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876661.224935:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788876661.224939:0:3663:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788876661.224942:0:3663:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788876661.224944:0:3663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788876661.224947:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13eb25f800 x1875771532293248/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876661.224965:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13eb29aa00 x1875771532295168/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876661.224976:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13eb25f480 x1875771532296448/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788876661.224988:0:3663:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788876661.224991:0:3663:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788876661.224993:0:3663:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788876661.224994:0:3663:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788876661.225007:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532293248:0@lo:400:kworker.0 00000100:00100000:2.0:1788876661.225144:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876661.225155:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532297600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876661.225215:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876661.225308:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297600 00000100:00100000:3.0:1788876661.225317:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297600 00000100:00100000:3.0:1788876661.225375:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1788876661.225384:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532297600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876661.225412:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876661.225461:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532297600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876661.225468:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1788876661.225535:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532296448:0@lo:400:kworker.0 00000100:00100000:1.0:1788876661.225557:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532295168:0@lo:400:kworker.0 00000100:00080000:2.0:1788876661.225638:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876661.225672:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532297600:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876661.225991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876661.225995:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788876661.225998:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876661.226002:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1582 00000100:00080000:0.0:1788876661.226009:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876661.226028:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa780700 x1875771532297728/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876661.226052:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876661.226056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876661.226057:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876661.226061:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1644 00000100:00080000:0.0:1788876661.226064:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876661.226068:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876661.226083:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa782d80 x1875771532297856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876661.226092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876661.226095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876661.226097:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876661.226100:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1644 00000100:00080000:0.0:1788876661.226103:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788876661.226106:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876661.226116:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa781500 x1875771532297984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876661.226171:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532298112:0@lo:400:kworker.0 00000100:00100000:3.0:1788876661.226204:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876661.226252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876661.226256:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876661.226258:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876661.226262:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1644 00000100:00080000:0.0:1788876661.226265:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788876661.226269:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876661.226282:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa782300 x1875771532298240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876661.226304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876661.226308:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876661.226309:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876661.226313:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1644 00000100:00080000:0.0:1788876661.226315:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788876661.226319:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876661.226329:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd7f480 x1875771532298496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876661.226354:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532298368:0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.226384:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876661.226409:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876661.226415:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532298624:0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.226435:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876661.226468:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298368 00000100:00100000:0.0:1788876661.226473:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298368 00000100:00100000:0.0:1788876661.226510:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298624 00000100:00100000:0.0:1788876661.226512:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298624 00000100:00100000:0.0:1788876661.226531:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:0.0:1788876661.226538:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532298368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.226576:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532298368:12345-0@lo:400:kworker.0 Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876661.226582:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:0.0:1788876661.226594:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:0.0:1788876661.226619:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.226647:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532298624:12345-0@lo:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876661.226653:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00080000:0.0:1788876661.226676:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876661.226701:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532298624:0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.226710:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532298368:0@lo:400:kworker.0 00000100:00100000:2.0:1788876661.226827:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532297728:0@lo:250:kworker.0 00000400:00000100:2.0:1788876661.226850:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532297728 offset 0 length 520: 4 00000100:00100000:2.0:1788876661.226868:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532297856:0@lo:38:kworker.0 00000100:00100000:2.0:1788876661.226891:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876661.226918:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532297984:0@lo:38:kworker.0 00000100:00100000:2.0:1788876661.226938:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876661.226969:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532298240:0@lo:38:kworker.0 00000100:00100000:2.0:1788876661.226989:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876661.227002:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532298496:0@lo:38:kworker.0 00000100:00100000:2.0:1788876661.227019:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876661.227046:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298112 00000100:00100000:2.0:1788876661.227050:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298112 00000100:00100000:2.0:1788876661.227077:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1788876661.227085:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532298112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.227147:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297856 00000100:00100000:0.0:1788876661.227151:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297856 00000100:00100000:0.0:1788876661.227172:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788876661.227178:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532297856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876661.227194:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876661.227229:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532297856:12345-0@lo:38:kworker.0 Request processed in 50us (337us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876661.227235:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788876661.227256:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532297984 00000100:00100000:0.0:1788876661.227260:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532297984 00000100:00100000:0.0:1788876661.227276:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298240 00000100:00100000:0.0:1788876661.227278:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298240 00000100:00100000:0.0:1788876661.227287:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298496 00000100:00100000:0.0:1788876661.227289:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298496 00000100:00100000:0.0:1788876661.227298:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1788876661.227303:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532297984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876661.227313:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876661.227337:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532297984:12345-0@lo:38:kworker.0 Request processed in 33us (398us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876661.227343:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:0.0:1788876661.227353:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:0.0:1788876661.227357:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532298240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876661.227365:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876661.227385:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532298240:12345-0@lo:38:kworker.0 Request processed in 27us (396us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876661.227391:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:0.0:1788876661.227402:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:0.0:1788876661.227405:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532298496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876661.227412:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876661.227434:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532298496:12345-0@lo:38:kworker.0 Request processed in 27us (413us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876661.227440:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00080000:0.0:1788876661.227456:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876661.227476:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876661.227481:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876661.227485:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532297856:0@lo:38:kworker.0 00000100:00080000:0.0:1788876661.227495:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876661.227499:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876661.227501:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532297984:0@lo:38:kworker.0 00000100:00080000:0.0:1788876661.227508:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876661.227510:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876661.227512:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532298240:0@lo:38:kworker.0 00000100:00080000:0.0:1788876661.227519:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876661.227521:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876661.227523:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532298496:0@lo:38:kworker.0 00000100:00100000:2.0:1788876661.234295:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532298112:12345-0@lo:400:kworker.0 Request processed in 7201us (8080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876661.234311:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1788876661.242203:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532298112:0@lo:400:kworker.0 00000100:00100000:0.0:1788876661.429299:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876661.430908:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238272 00000100:00100000:2.0:1788876661.430922:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238272 00000100:00100000:2.0:1788876661.430987:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2430 00000100:00100000:2.0:1788876661.430996:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511238272:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788876661.431020:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876661.431095:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511238272:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 99us (1808us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876661.431103:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2430 00000400:00000100:0.0:1788876661.438684:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511238144 offset 0 length 224: 4 00000100:00100000:0.0:1788876661.438725:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876661.438892:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238528 00000100:00100000:1.0:1788876661.438903:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238528 00000100:00100000:1.0:1788876661.439082:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1161 00000100:00100000:1.0:1788876661.439092:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511238528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876661.439168:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511238528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876661.439176:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1161 00000100:00080000:0.0:1788876661.439286:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876661.445131:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876661.445166:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876661.445240:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238656 00000100:00100000:3.0:1788876661.445252:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238656 00000100:00100000:3.0:1788876661.445328:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1162 00000100:00100000:3.0:1788876661.445338:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511238656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876661.445409:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511238656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876661.445418:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1162 00000100:00080000:2.0:1788876661.446223:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876661.446426:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238400 00000100:00100000:0.0:1788876661.446435:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238400 00000100:00100000:0.0:1788876661.446504:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1582 00000100:00100000:0.0:1788876661.446514:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511238400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876661.446572:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511238400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876661.446580:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1582 00000100:00080000:2.0:1788876661.446631:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788876661.609251:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876662.261382:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532298752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876662.261453:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876662.261515:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298752 00000100:00100000:3.0:1788876662.261523:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298752 00000100:00100000:3.0:1788876662.261572:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1788876662.261581:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532298752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876662.261629:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876662.261689:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532298752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876662.261697:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1788876662.261746:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532298752:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1788876662.454332:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511238784 offset 0 length 520: 4 00000100:00100000:2.0:1788876662.454369:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876662.454434:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876662.458725:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876662.458760:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876662.458783:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239296 00000100:00100000:2.0:1788876662.458792:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239296 00000100:00100000:2.0:1788876662.458836:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239168 00000100:00100000:2.0:1788876662.458840:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239168 00000100:00100000:2.0:1788876662.458876:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1163 00000100:00100000:2.0:1788876662.458886:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511239296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876662.458968:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511239296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876662.458979:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1163 00000100:00100000:2.0:1788876662.458997:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1164 00000100:00100000:2.0:1788876662.459004:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511239168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876662.459031:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511239168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876662.459037:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1164 00000100:00100000:1.0:1788876662.462510:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511238912 00000100:00100000:1.0:1788876662.462524:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511238912 00000100:00100000:1.0:1788876662.462584:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239040 00000100:00100000:1.0:1788876662.462587:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239040 00000100:00100000:1.0:1788876662.462640:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1583 00000100:00100000:1.0:1788876662.462651:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511239040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876662.462752:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511239040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 103us (8316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876662.465033:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2431 00000100:00100000:2.0:1788876662.465050:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511238912:12345-192.168.203.11@tcp:38:kworker.0 00000100:00100000:1.0:1788876662.465588:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1583 00010000:00020000:2.0:1788876662.466048:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876662.467525:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511238912:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 2469us (13146us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876662.467542:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2431 00010000:00010000:2.0:1788876662.635369:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876663.658907:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876664.683219:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876665.709231:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876666.345475:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876666.345489:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532298880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876666.345570:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876666.345673:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532298880 00000100:00100000:2.0:1788876666.345691:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532298880 00000100:00100000:2.0:1788876666.345756:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1788876666.345766:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532298880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876666.345798:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876666.345852:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532298880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876666.345859:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00080000:2.0:1788876666.345882:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876666.345932:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532298880:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876666.346421:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876666.346427:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788876666.346432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876666.346436:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876666.346440:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876666.346446:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1649 00000100:00080000:0.0:1788876666.346450:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876666.346455:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876666.346482:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35f8700 x1875771532299008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876666.346494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876666.346497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876666.346499:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876666.346501:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1649 00000100:00080000:0.0:1788876666.346504:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876666.346507:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876666.346517:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35f9180 x1875771532299136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876666.346549:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876666.346552:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876666.346554:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876666.346560:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1649 00000100:00080000:0.0:1788876666.346562:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876666.346566:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876666.346575:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35fbb80 x1875771532299392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876666.346592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876666.346596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876666.346598:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876666.346625:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1649 00000100:00080000:0.0:1788876666.346627:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876666.346631:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876666.346642:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35f8380 x1875771532299648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876666.346766:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532299264:0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.346816:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876666.346847:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876666.346853:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532299520:0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.346877:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876666.346917:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876666.346932:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.346958:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876666.346990:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299264 00000100:00100000:0.0:1788876666.346999:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299264 00000100:00100000:0.0:1788876666.347052:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1788876666.347063:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532299264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.347112:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532299264:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876666.347122:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1788876666.347147:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299520 00000100:00100000:0.0:1788876666.347150:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299520 00000100:00100000:0.0:1788876666.347174:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299776 00000100:00100000:0.0:1788876666.347177:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299776 00000100:00100000:0.0:1788876666.347195:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:0.0:1788876666.347201:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532299520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.347230:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532299520:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876666.347236:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:0.0:1788876666.347246:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1788876666.347252:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532299776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.347363:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532299776:12345-0@lo:400:kworker.0 Request processed in 111us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876666.347369:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1788876666.347418:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.347865:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532299520:0@lo:400:kworker.0 00000100:00100000:0.0:1788876666.347878:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532299264:0@lo:400:kworker.0 00000100:00100000:2.0:1788876666.348447:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532299008:0@lo:38:kworker.0 00000100:00100000:2.0:1788876666.348490:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876666.348538:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532299136:0@lo:38:kworker.0 00000100:00100000:2.0:1788876666.348560:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876666.348582:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532299392:0@lo:38:kworker.0 00000100:00100000:1.0:1788876666.348718:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299008 00000100:00100000:1.0:1788876666.348724:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299008 00000100:00100000:1.0:1788876666.348759:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1788876666.348766:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532299008:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876666.348785:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876666.348830:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532299008:12345-0@lo:38:kworker.0 Request processed in 59us (335us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876666.348837:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1788876666.348860:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299136 00000100:00100000:1.0:1788876666.348863:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299136 00000100:00100000:1.0:1788876666.348884:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1788876666.348888:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532299136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876666.348897:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876666.348936:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532299136:12345-0@lo:38:kworker.0 Request processed in 44us (372us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876666.348942:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:2.0:1788876666.349324:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876666.349358:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532299648:0@lo:38:kworker.0 00000100:00100000:2.0:1788876666.349382:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876666.349420:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876666.349425:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876666.349428:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532299008:0@lo:38:kworker.0 00000100:00080000:2.0:1788876666.349436:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876666.349439:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876666.349443:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532299136:0@lo:38:kworker.0 00000100:00100000:2.0:1788876666.349592:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299392 00000100:00100000:2.0:1788876666.349596:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299392 00000100:00100000:1.0:1788876666.349708:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299648 00000100:00100000:1.0:1788876666.349712:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299648 00000100:00100000:1.0:1788876666.349734:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1788876666.349740:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532299648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876666.349750:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876666.349784:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532299648:12345-0@lo:38:kworker.0 Request processed in 43us (401us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876666.349790:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00080000:1.0:1788876666.349816:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876666.349820:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876666.349822:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532299648:0@lo:38:kworker.0 00000100:00100000:2.0:1788876666.349946:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:2.0:1788876666.350113:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532299392:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876666.350123:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876666.350768:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532299392:12345-0@lo:38:kworker.0 Request processed in 655us (1442us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876666.350775:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00080000:2.0:1788876666.350811:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876666.350816:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876666.357465:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876666.357475:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876666.357480:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532299392:0@lo:38:kworker.0 00010000:00010000:1.0:1788876666.730083:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876667.370166:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532299904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876667.370237:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876667.370321:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532299904 00000100:00100000:3.0:1788876667.370330:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532299904 00000100:00100000:3.0:1788876667.370389:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1788876667.370398:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532299904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876667.370426:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876667.370473:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532299904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876667.370480:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:1.0:1788876667.370645:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532299904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876667.573088:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876667.573122:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876667.573129:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239424 00000100:00100000:0.0:1788876667.573139:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239424 00000100:00100000:1.0:1788876667.573147:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876667.573181:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239552 00000100:00100000:0.0:1788876667.573183:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239552 00000100:00100000:0.0:1788876667.573227:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1586 00000100:00100000:0.0:1788876667.573238:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511239552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876667.573244:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876667.573274:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2435 00000100:00100000:1.0:1788876667.573280:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511239424:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876667.573305:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876667.573331:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511239552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876667.573331:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511239424:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 49us (254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876667.573338:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2435 00000100:00100000:0.0:1788876667.573341:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1586 00000100:00100000:1.0:1788876667.573363:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239680 00000100:00100000:1.0:1788876667.573367:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239680 00000100:00100000:1.0:1788876667.573406:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239808 00000100:00100000:1.0:1788876667.573409:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239808 00000100:00100000:1.0:1788876667.573433:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1166 00000100:00100000:1.0:1788876667.573440:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511239680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876667.573465:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511239680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876667.573472:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1166 00000100:00100000:1.0:1788876667.573484:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1167 00000100:00100000:1.0:1788876667.573490:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511239808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876667.573511:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511239808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876667.573517:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1167 00000100:00080000:2.0:1788876667.577140:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876667.577151:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876667.577155:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876667.761972:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788876668.206940:0:45276:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788876668.206947:0:45276:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788876668.206949:0:45276:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788876668.207077:0:45276:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a12c62dc000 00000020:01000004:0.0:1788876668.207092:0:45276:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788876668.207105:0:45276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788876668.207120:0:45276:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c20199c0) 00000020:00000080:0.0:1788876668.207137:0:45276:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788876668.360286:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788876668.365354:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788876668.367254:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.367702:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.367966:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.368169:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.368491:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.368856:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.369119:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.369364:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.369656:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788876668.369961:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.370165:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.370475:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.371731:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788876668.372201:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.372403:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.372599:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.372931:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.373130:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.373438:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.373851:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.374432:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.374714:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.374969:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.375214:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.375454:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.375706:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.375949:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.376187:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.376524:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.376793:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.377054:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.377289:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.377584:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.378318:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.379885:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.384160:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.384678:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.384954:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.385162:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.385368:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.385568:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.385895:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788876668.386228:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.386729:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788876668.387027:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788876668.391031:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876668.391775:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788876668.391994:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876668.392399:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788876668.393595:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788876668.395367:0:45276:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788876668.396296:0:45276:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788876668.396502:0:45276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788876668.396511:0:45276:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788876668.396523:0:45276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aea3b 00000020:01000004:3.0:1788876668.396529:0:45276:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788876668.396540:0:45276:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788876668.396545:0:45276:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a12c62dc000 from MGS 00000020:01000004:3.0:1788876668.396549:0:45276:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788876668.396558:0:45276:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c22e8000) 00000020:00000080:3.0:1788876668.396570:0:45276:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788876668.396693:0:45276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c62dc000 from MGS, refs=2 00080000:01000000:3.0:1788876668.396699:0:45276:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788876668.396704:0:45276:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aea49 00010000:00010000:3.0:1788876668.396831:0:45276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788876668.418667:0:45276:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788876668.423962:0:45281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788876668.424016:0:45276:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788876668.424064:0:45276:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788876668.424761:0:45276:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788876668.425011:0:45276:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788876668.425196:0:45276:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788876668.425203:0:45276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788876668.426016:0:45276:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788876668.426023:0:45276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788876668.427903:0:45276:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788876668.427939:0:45276:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788876668.428258:0:45276:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788876668.428279:0:45276:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788876668.428280:0:45276:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788876668.428284:0:45276:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788876668.428289:0:45276:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 35, was 0): CONNECTING 00000100:00100000:0.0:1788876668.428294:0:45276:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:1.0:1788876668.777475:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876669.800864:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876670.824935:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876671.464919:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876661/real 1788876661] req@ffff8a13fa780700 x1875771532297728/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876671 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876671.464951:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13fa780700 x1875771532297728/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876671 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876671.464970:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876671.464979:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788876671.464999:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532297728:0@lo:250:kworker.0 10000000:01000000:0.0:1788876671.465074:0:45276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788876671.465094:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefe000/0xf5bf0f7e313a86c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a86c8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465105:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefe000/0xf5bf0f7e313a86c1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a86c8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465112:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788876671.465139:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465150:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefe000/0xf5bf0f7e313a86c1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a86c8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465170:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efeffc00/0xf5bf0f7e313a8635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a863c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465177:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efeffc00/0xf5bf0f7e313a8635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a863c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465182:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465186:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465190:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efeffc00/0xf5bf0f7e313a8635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a863c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465200:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73600/0xf5bf0f7e313a8643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a864a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465218:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73600/0xf5bf0f7e313a8643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a864a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465224:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465228:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465231:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73600/0xf5bf0f7e313a8643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a864a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465241:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efeff800/0xf5bf0f7e313a865f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a8666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465247:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efeff800/0xf5bf0f7e313a865f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a8666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465253:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465257:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465260:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efeff800/0xf5bf0f7e313a865f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a8666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465268:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313a866d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a8674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465275:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313a866d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a8674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465280:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465283:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465286:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313a866d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a8674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465294:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefea00/0xf5bf0f7e313a8689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a8690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465300:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefea00/0xf5bf0f7e313a8689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a8690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465306:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465309:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465312:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefea00/0xf5bf0f7e313a8689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a8690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465321:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a400/0xf5bf0f7e313a86a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a86ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465327:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a400/0xf5bf0f7e313a86a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a86ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465338:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465341:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465344:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a400/0xf5bf0f7e313a86a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a86ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465353:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a200/0xf5bf0f7e313a86dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a86e4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465359:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a200/0xf5bf0f7e313a86dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a86e4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465364:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465367:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465370:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8a200/0xf5bf0f7e313a86dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a86e4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465381:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8be00/0xf5bf0f7e313a8697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a869e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465387:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8be00/0xf5bf0f7e313a8697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a869e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465393:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465396:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465399:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8be00/0xf5bf0f7e313a8697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a869e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465411:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313a86b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a86ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465421:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313a86b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a86ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465427:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.465430:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465434:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313a86b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a86ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465444:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73000/0xf5bf0f7e313a8651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a8658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465450:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73000/0xf5bf0f7e313a8651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a8658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465456:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876671.465459:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465462:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73000/0xf5bf0f7e313a8651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a8658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465471:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313a867b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a8682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465477:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313a867b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a8682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465482:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876671.465486:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465489:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313a867b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a8682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.465501:0:45276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efeffe00/0xf5bf0f7e313a86cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313a86d6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.465506:0:45276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efeffe00/0xf5bf0f7e313a86cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313a86d6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.465511:0:45276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876671.465514:0:45276:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876671.465517:0:45276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efeffe00/0xf5bf0f7e313a86cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313a86d6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788876671.465533:0:45276:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 35, was 0): DISCONN 00000100:00080000:0.0:1788876671.465543:0:45276:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876671.465549:0:45276:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1649 00000100:00080000:0.0:1788876671.465555:0:45276:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876671.465560:0:45276:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876671.465593:0:45276:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35fbb80 x1875771532300032/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876671.465647:0:45276:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788876671.465752:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532300032:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788876671.465817:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.466285:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300032 00000100:00100000:0.0:1788876671.466294:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300032 00000100:00100000:0.0:1788876671.466334:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788876671.466341:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532300032:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788876671.466364:0:45282:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 1659 last 0 00000020:00000080:0.0:1788876671.466398:0:45282:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313aea50 00000100:00080000:0.0:1788876671.466526:0:45282:0:(import.c:65:import_set_state_nolock()) ffff8a13c486d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876671.466590:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532300032:12345-0@lo:250:mount.lustre.0 Request processed in 247us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.466597:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788876671.466727:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 17 00000100:00080000:1.0:1788876671.466735:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:1.0:1788876671.466742:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788876671.466746:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788876671.466749:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788876671.466751:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788876671.466770:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788876671.466782:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532300032:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788876671.466990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876671.466995:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876671.466997:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876671.467002:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1654 00000100:00080000:2.0:1788876671.467005:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876671.467010:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876671.467025:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3b480 x1875771532300288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876671.467037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876671.467040:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876671.467042:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876671.467045:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1654 00000100:00080000:2.0:1788876671.467047:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876671.467051:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876671.467060:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3a300 x1875771532300416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876671.467075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876671.467078:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876671.467080:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876671.467083:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1654 00000100:00080000:2.0:1788876671.467085:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876671.467089:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876671.467096:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39180 x1875771532300672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876671.467119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876671.467122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876671.467123:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876671.467126:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1654 00000100:00080000:2.0:1788876671.467128:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876671.467131:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876671.467139:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad38380 x1875771532301056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:2.0:1788876671.467176:0:8:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:2.0:1788876671.467191:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788876671.467195:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788876671.467196:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788876671.467198:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876671.467199:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876671.467200:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876671.467201:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876671.467202:0:8:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876671.467204:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876671.467205:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788876671.467332:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467369:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.467396:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467423:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.467445:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788876671.467450:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532300544:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467473:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.467491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532301312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876671.467513:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.467546:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301184 00000100:00100000:3.0:1788876671.467551:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301184 00000100:00100000:3.0:1788876671.467598:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1788876671.467633:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532301184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467672:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532301184:12345-0@lo:400:kworker.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.467678:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:3.0:1788876671.467701:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300544 00000100:00100000:3.0:1788876671.467705:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300544 00000100:00100000:3.0:1788876671.467733:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788876671.467739:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467768:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532300544:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.467774:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788876671.467793:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301312 00000100:00100000:3.0:1788876671.467796:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301312 00000100:00100000:3.0:1788876671.467823:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:3.0:1788876671.467829:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532301312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876671.467848:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876671.467892:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532301312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.467898:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:3.0:1788876671.467916:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876671.467920:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876671.467922:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876671.467948:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532300544:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467962:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532301312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876671.467971:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.467997:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300160 00000100:00100000:3.0:1788876671.468000:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300160 00000100:00100000:3.0:1788876671.468020:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788876671.468026:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3662:x1875771532300160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.468056:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3662:x1875771532300160:12345-0@lo:400:kworker.0 Request processed in 31us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.468062:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788876671.468082:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.468117:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532300928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.468138:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.468154:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876671.468160:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532300800:0@lo:400:kworker.0 00000100:00100000:3.0:1788876671.468179:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.468826:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532300288:0@lo:38:kworker.0 00000100:00100000:1.0:1788876671.468867:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.468931:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532300416:0@lo:38:kworker.0 00000100:00100000:1.0:1788876671.468954:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.468972:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532300672:0@lo:38:kworker.0 00000100:00100000:1.0:1788876671.468992:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.469009:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532301056:0@lo:38:kworker.0 00000100:00100000:1.0:1788876671.469030:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.469061:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300800 00000100:00100000:1.0:1788876671.469066:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300800 00000100:00100000:1.0:1788876671.469100:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300416 00000100:00100000:1.0:1788876671.469103:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300416 00000100:00100000:1.0:1788876671.469112:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300672 00000100:00100000:1.0:1788876671.469114:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300672 00000100:00100000:1.0:1788876671.469121:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301056 00000100:00100000:1.0:1788876671.469123:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301056 00000100:00100000:1.0:1788876671.469133:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788876671.469140:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532300800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876671.469180:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532300800:12345-0@lo:400:kworker.0 Request processed in 41us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876671.469189:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788876671.469220:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1788876671.469225:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532300416:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876671.469242:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876671.469275:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532300416:12345-0@lo:38:kworker.0 Request processed in 49us (321us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876671.469281:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1788876671.469293:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:1.0:1788876671.469297:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532300672:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876671.469306:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876671.469328:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532300672:12345-0@lo:38:kworker.0 Request processed in 30us (335us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876671.469333:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:1.0:1788876671.469344:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1788876671.469347:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532301056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876671.469355:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876671.469375:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532301056:12345-0@lo:38:kworker.0 Request processed in 26us (344us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876671.469380:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00080000:1.0:1788876671.469396:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876671.469424:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532300800:0@lo:400:kworker.0 00000100:00080000:1.0:1788876671.469446:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876671.469451:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876671.469454:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532300416:0@lo:38:kworker.0 00000100:00080000:1.0:1788876671.469462:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876671.469464:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876671.469467:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532300672:0@lo:38:kworker.0 00000100:00080000:1.0:1788876671.469474:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876671.469477:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876671.469480:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532301056:0@lo:38:kworker.0 00000020:01000000:2.0:1788876671.469996:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788876671.470011:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788876671.470013:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788876671.470015:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788876671.470017:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876671.470018:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876671.470020:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876671.470021:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876671.470022:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788876671.470024:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876671.470025:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788876671.470037:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788876671.470042:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788876671.470044:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788876671.470045:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788876671.470046:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876671.470047:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876671.470048:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876671.470049:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876671.470050:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788876671.470051:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876671.470052:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788876671.470065:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788876671.470100:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532301568:0@lo:253:kworker.0 00000100:00100000:2.0:1788876671.470143:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.470174:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876671.470180:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532301440:0@lo:253:kworker.0 00000100:00100000:2.0:1788876671.470278:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.470744:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876671.470755:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532301696:0@lo:253:kworker.0 00000100:00100000:0.0:1788876671.470794:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.470827:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300928 00000100:00100000:0.0:1788876671.470833:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300928 00000100:00100000:0.0:1788876671.470873:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788876671.470881:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532300928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876671.470940:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532300928:12345-0@lo:400:kworker.0 Request processed in 60us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.470947:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788876671.470990:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532300928:0@lo:400:kworker.0 00000100:00100000:0.0:1788876671.471013:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301568 00000100:00100000:0.0:1788876671.471016:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301568 00000100:00100000:0.0:1788876671.471033:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301440 00000100:00100000:0.0:1788876671.471035:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301440 00000100:00100000:0.0:1788876671.471045:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301696 00000100:00100000:0.0:1788876671.471047:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301696 00000100:00100000:0.0:1788876671.471058:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788876671.471064:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3665:x1875771532301568:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788876671.471085:0:45282:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:0.0:1788876671.471372:0:45276:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788876671.471383:0:45276:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788876671.471420:0:45276:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788876671.471425:0:45276:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788876671.471534:0:45276:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788876671.471808:0:45285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788876671.471899:0:45282:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 67 00000100:00100000:3.0:1788876671.473299:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532300288 00000100:00100000:3.0:1788876671.473314:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532300288 00000100:00100000:3.0:1788876671.473360:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1788876671.473372:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532300288:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876671.473398:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876671.473567:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532300288:12345-0@lo:38:kworker.0 Request processed in 193us (4694us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876671.473575:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:3.0:1788876671.473746:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876671.473753:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876671.473761:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532300288:0@lo:38:kworker.0 00000100:00100000:3.0:1788876671.473802:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1788876671.474955:0:45276:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788876671.474961:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788876671.474962:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876671.474964:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876671.474965:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876671.474966:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876671.474968:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876671.474969:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876671.474971:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876671.474973:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876671.474974:0:45276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876671.474978:0:45276:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788876671.474981:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788876671.474982:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876671.474983:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876671.474984:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876671.474985:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876671.474986:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876671.474987:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876671.474988:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876671.474990:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876671.474991:0:45276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876671.475040:0:45276:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788876671.475060:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532301824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788876671.475121:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.475331:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3665:x1875771532301440:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788876671.475362:0:45283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788876671.475380:0:45284:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1788876671.475387:0:45284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788876671.477907:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db6c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788876671.479013:0:45286:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788876671.479024:0:45286:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788876671.479028:0:45286:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788876671.479031:0:45286:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000100:00100000:3.0:1788876671.479121:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301824 00000100:00100000:3.0:1788876671.479131:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301824 00000040:00080000:1.0:1788876671.479445:0:45286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788876671.480312:0:45282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788876671.480343:0:45282:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788876671.482557:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788876671.482573:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532301696:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788876671.482746:0:45287:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788876671.484440:0:45282:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876671.484458:0:45282:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788876671.484924:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3665:x1875771532301568:12345-0@lo:253:kworker.0 Request processed in 13855us (14775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.484936:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788876671.484971:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788876671.484981:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:45276:x1875771532301824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788876671.485018:0:45282:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788876671.485020:0:45282:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788876671.485023:0:45282:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1788876671.485027:0:45282:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1788876671.485098:0:3665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876671.485100:0:3665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788876671.485102:0:3665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876671.485103:0:3665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876671.485104:0:3665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876671.485106:0:3665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876671.485107:0:3665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876671.485109:0:3665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876671.485111:0:3665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876671.485114:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532301568:0@lo:253:kworker.0 00000100:00100000:0.0:1788876671.486141:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:45276:x1875771532301824:12345-0@lo:253:mount.lustre.0 Request processed in 1159us (11017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.486163:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788876671.486247:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532301824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788876671.486260:0:45276:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788876671.486263:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788876671.486264:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876671.486266:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876671.486267:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876671.486268:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876671.486269:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876671.486270:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876671.486272:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876671.486274:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876671.486275:0:45276:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788876671.486292:0:45276:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a12c62dc000 from lustre-MDT0000 10000000:01000000:2.0:1788876671.486321:0:45276:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788876671.486324:0:45276:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788876671.486333:0:45276:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a12c62dc000 10000000:01000000:2.0:1788876671.486337:0:45276:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788876671.486343:0:45276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a12c62dc000 10000000:01000000:2.0:1788876671.486345:0:45276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788876671.486349:0:45276:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a12c62dc000 from 1 10000000:01000000:2.0:1788876671.486352:0:45276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788876671.486386:0:45276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.486398:0:45276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.486408:0:45276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.486426:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532301952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876671.486461:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.486508:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 20000000:01000000:3.0:1788876671.486832:0:45283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788876671.487020:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532301952 00000100:00100000:0.0:1788876671.487027:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532301952 00000100:00100000:0.0:1788876671.487059:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788876671.487067:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:45276:x1875771532301952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876671.487078:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876671.487094:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe53a00/0xf5bf0f7e313aea5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aea57 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.487116:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe53a00/0xf5bf0f7e313aea5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aea57 expref: 8 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.487127:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe53a00/0xf5bf0f7e313aea5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aea57 expref: 8 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.487141:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53a00, rc 0) 00000100:00100000:0.0:1788876671.487185:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:45276:x1875771532301952:12345-0@lo:101:mount.lustre.0 Request processed in 118us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.487191:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788876671.487303:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532301952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876671.487316:0:45276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.487325:0:45276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876671.487342:0:45276:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788876671.487362:0:45276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.487370:0:45276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876671.487377:0:45276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788876671.487382:0:45276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788876671.487386:0:45276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a12c62dc000 10000000:01000000:2.0:1788876671.487389:0:45276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788876671.487392:0:45276:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788876671.487395:0:45276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788876671.487412:0:45276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.487419:0:45276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.487427:0:45276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.487440:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876671.487466:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.487493:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.487634:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302080 00000100:00100000:3.0:1788876671.487639:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302080 00000100:00100000:3.0:1788876671.487660:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788876671.487668:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:45276:x1875771532302080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876671.487675:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876671.487685:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae35c00/0xf5bf0f7e313aea6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aea65 expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.487700:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae35c00/0xf5bf0f7e313aea6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aea65 expref: 9 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.487708:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae35c00/0xf5bf0f7e313aea6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aea65 expref: 9 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.487715:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35c00, rc 0) 00000100:00100000:3.0:1788876671.487750:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532302080:12345-0@lo:101:mount.lustre.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.487756:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:1.0:1788876671.488314:0:45285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876671.488320:0:45285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876671.488336:0:45285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488346:0:45285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876671.488354:0:45285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000034960s 00010000:00010000:1.0:1788876671.488358:0:45285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488364:0:45285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488371:0:45285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488382:0:45285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488387:0:45285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876671.488391:0:45285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488399:0:45285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488410:0:45285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488418:0:45285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.488424:0:45285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aea73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.488517:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876671.488530:0:45276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.488539:0:45276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.488619:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876671.488654:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.488675:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.488899:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302208 00000100:00100000:0.0:1788876671.488905:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302208 00000100:00100000:0.0:1788876671.488930:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788876671.488938:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532302208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876671.489077:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532302208:12345-0@lo:501:mount.lustre.0 Request processed in 139us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.489086:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788876671.489172:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876671.489203:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876671.489252:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.489281:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.489464:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302336 00000100:00100000:3.0:1788876671.489469:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302336 00000100:00100000:3.0:1788876671.489500:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788876671.489507:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532302336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876671.491366:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532302336:12345-0@lo:503:mount.lustre.0 Request processed in 1851us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.491379:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788876671.491482:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532302336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876671.493720:0:45288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45288:1875771532302464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876671.493793:0:45288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.493834:0:45288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.493954:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302464 00000100:00100000:0.0:1788876671.493961:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302464 00000100:00100000:0.0:1788876671.494009:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788876671.494018:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45288:x1875771532302464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.495206:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45288:x1875771532302464:12345-0@lo:502:llog_process_th.0 Request processed in 1184us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876671.495222:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788876671.495325:0:45288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45288:1875771532302464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788876671.495359:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876671.495370:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.495373:0:45288:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788876671.495379:0:45288:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788876671.495382:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876671.495397:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c22e99c0) 00000020:00000080:3.0:1788876671.495419:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788876671.495425:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788876671.495515:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788876671.495523:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aea81 00000020:00000080:3.0:1788876671.495775:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788876671.495780:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876671.495784:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.495786:0:45288:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788876671.495789:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876671.495792:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.495793:0:45288:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788876671.495797:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876671.495805:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c22ecd40) 00000020:00000080:3.0:1788876671.495817:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788876671.495821:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788876671.495823:0:45288:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788876671.495825:0:45288:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788876671.495832:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788876671.495876:0:45288:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c62dc000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788876671.495899:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a13f4538000) 00000020:00000080:3.0:1788876671.495910:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788876671.495962:0:45288:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788876671.495967:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aea96 00000020:00000080:3.0:1788876671.496058:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788876671.496064:0:45288:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788876671.496068:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313aea9d 00080000:01000000:3.0:1788876671.496072:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788876671.496075:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aeaa4 20000000:01000000:2.0:1788876671.500473:0:45283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788876671.500491:0:45283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788876671.500714:0:45287:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788876671.500896:0:45285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876671.500902:0:45285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876671.500924:0:45285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500942:0:45285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876671.500951:0:45285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050667s 00010000:00010000:1.0:1788876671.500956:0:45285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500963:0:45285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500970:0:45285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500978:0:45285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500984:0:45285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876671.500988:0:45285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.500996:0:45285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.501010:0:45285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.501019:0:45285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.501031:0:45285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeaab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.501356:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:3665:x1875771532301440:12345-0@lo:253:kworker.0 Request processed in 27543us (31073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.501368:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1788876671.501477:0:3665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876671.501480:0:3665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788876671.501481:0:3665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876671.501482:0:3665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876671.501484:0:3665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876671.501485:0:3665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876671.501486:0:3665:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876671.501488:0:3665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876671.501490:0:3665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876671.501494:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532301440:0@lo:253:kworker.0 20000000:01000000:0.0:1788876671.507715:0:45287:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876671.507734:0:45287:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788876671.507843:0:45285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876671.507849:0:45285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876671.507870:0:45285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507897:0:45285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876671.507908:0:45285:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000060544s 00010000:00010000:1.0:1788876671.507913:0:45285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507921:0:45285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507929:0:45285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507937:0:45285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507943:0:45285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876671.507948:0:45285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507957:0:45285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507977:0:45285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507985:0:45285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.507992:0:45285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeab2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876671.508241:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532301696:12345-0@lo:253:kworker.0 Request processed in 25668us (37442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.508252:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1788876671.508353:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788876671.508356:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788876671.508358:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876671.508359:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876671.508360:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876671.508362:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876671.508364:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788876671.508366:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876671.508367:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788876671.508371:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532301696:0@lo:253:kworker.0 00010000:00010000:0.0:1788876671.652010:0:45288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1788876671.652140:0:45288:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 68719476736 lx: 0 gen 1 00000001:00080000:0.0:1788876671.652339:0:45288:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 64424509884 srv lr: 68719476736 lx: 0 gen 4 00000001:00000004:0.0:1788876671.652364:0:45288:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 17, last_transno is 68719476736 00000001:00080000:0.0:1788876671.652470:0:45288:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788876671.652523:0:45288:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c6746e40: xid 1875771511232512, transno 68719477397, client gen 4, slot idx 0 00000001:00080000:0.0:1788876671.652534:0:45288:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c6746600: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:0.0:1788876671.652539:0:45288:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13fa7da780: xid 1875771511213568, transno 68719477396, client gen 4, slot idx 2 00000001:00080000:0.0:1788876671.652544:0:45288:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13fa7dac00: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:0.0:1788876671.653200:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a12c201b380) 00000020:00000080:0.0:1788876671.653222:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788876671.653371:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788876671.653379:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aeace 00000020:00000080:3.0:1788876671.658035:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876671.665568:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313aead5 00000020:00000080:3.0:1788876671.667979:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788876671.667994:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876671.668003:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.668005:0:45288:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788876671.668008:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788876671.668011:0:45288:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788876671.668013:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788876671.668014:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788876671.668016:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788876671.668018:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.668020:0:45288:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788876671.668022:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876671.668027:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.668028:0:45288:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788876671.668032:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788876671.668075:0:45288:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788876671.668088:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876671.668091:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.668092:0:45288:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788876671.668095:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876671.668097:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876671.668098:0:45288:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788876671.668101:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788876671.668106:0:45288:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1788876671.668134:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876671.668149:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a13f5270000) 00000020:00000080:3.0:1788876671.668171:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788876671.668176:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788876671.668231:0:45288:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788876671.668236:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788876671.668242:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aeae3 00010000:00080000:3.0:1788876671.668273:0:45288:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c3408000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:0.0:1788876671.671329:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876671.671370:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876671.671401:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876671.671420:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876671.671451:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876671.671499:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240192 00000100:00100000:0.0:1788876671.671507:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240192 00000100:00100000:0.0:1788876671.671561:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240064 00000100:00100000:0.0:1788876671.671564:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240064 00000100:00100000:0.0:1788876671.671583:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1589 00000100:00100000:0.0:1788876671.671629:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511240192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876671.671709:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511240192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 117us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.671716:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1589 00000100:00100000:0.0:1788876671.671733:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2439 00000100:00100000:0.0:1788876671.671738:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511240064:12345-192.168.203.11@tcp:38:kworker.0 00000100:00100000:0.0:1788876671.671773:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511240064:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 34us (372us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876671.671779:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2439 00000100:00080000:0.0:1788876671.671812:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876671.671825:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240448 00000100:00100000:0.0:1788876671.671829:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240448 00000100:00100000:0.0:1788876671.671857:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240320 00000100:00100000:0.0:1788876671.671860:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240320 00000100:00100000:0.0:1788876671.671892:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1170 00000100:00100000:0.0:1788876671.671902:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511240448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876671.671929:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511240448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.671936:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1170 00000100:00100000:0.0:1788876671.671948:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1171 00000100:00100000:0.0:1788876671.671956:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511240320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876671.671979:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511240320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.671984:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1171 00000100:00080000:0.0:1788876671.671997:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876671.672000:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876671.674761:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511239936 00000100:00100000:3.0:1788876671.674774:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511239936 00000100:00100000:3.0:1788876671.674817:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1788876671.674825:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1875771511239936:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:3.0:1788876671.674856:0:45282:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 1659 last 0 00000020:00000080:3.0:1788876671.674959:0:45282:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313aeaea 00000100:00080000:3.0:1788876671.675100:0:45282:0:(import.c:65:import_set_state_nolock()) ffff8a13f35a9800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1788876671.675721:0:45288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000100:00100000:3.0:1788876671.675894:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511239936:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 1058us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.675904:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000020:00000080:1.0:1788876671.681806:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876671.681822:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788876671.681864:0:45288:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788876671.681896:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeaf1 00000100:00080000:1.0:1788876671.681908:0:45288:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788876671.681916:0:45288:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a12c3408000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876671.681955:0:45288:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcc5f80 x1875771532302592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876671.681985:0:45288:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788876671.682042:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876671.682046:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.682049:0:45288:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788876671.682052:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788876671.682055:0:45288:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788876671.682056:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876671.682058:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876671.682059:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788876671.682061:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.682063:0:45288:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788876671.682065:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788876671.682070:0:45288:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788876671.682073:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.682074:0:45288:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788876671.682077:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788876671.682080:0:45288:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1788876671.682105:0:45288:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788876671.682107:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876671.682120:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c25eb380) 00000020:00000080:1.0:1788876671.682136:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788876671.682141:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788876671.682207:0:45288:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788876671.682214:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788876671.682219:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aeaff 00010000:00080000:1.0:1788876671.682253:0:45288:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13fd3b4000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:2.0:1788876671.682375:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532302592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788876671.682449:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.682527:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302592 00000100:00100000:2.0:1788876671.682533:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302592 00000100:00100000:2.0:1788876671.682565:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1788876671.682573:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532302592:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788876671.682630:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1659 last 0 00000020:00000080:2.0:1788876671.682664:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeb06 00000004:00100000:2.0:1788876671.682678:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876671.682766:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a12c2590000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876671.682813:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532302592:12345-0@lo:38:llog_process_th.0 Request processed in 239us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.682820:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1788876671.682860:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788876671.682868:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788876671.682875:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788876671.682880:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788876671.682893:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788876671.682900:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532302592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788876671.682973:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532302720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876671.682998:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.683049:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302720 00000100:00100000:2.0:1788876671.683053:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302720 00000100:00100000:2.0:1788876671.683078:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1788876671.683084:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532302720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876671.683107:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876671.683140:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532302720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.683146:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1788876671.683176:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532302720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788876671.683511:0:45288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1788876671.686049:0:45288:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788876671.686087:0:45288:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788876671.686160:0:45288:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 15, last_idx 16 00000040:00080000:1.0:1788876671.689524:0:45288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876671.689564:0:45288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].17, 64 off9280 00000040:00080000:1.0:1788876671.698284:0:45288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x44:0x0].1, 64 off8256 00000040:00080000:1.0:1788876671.699902:0:45294:0:(llog.c:805:llog_process_thread()) index: 16, lh_last_idx: 17 synced_idx: 0 lgh_last_idx: 17 00000040:00080000:1.0:1788876671.699911:0:45294:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x40:0x0] at index 16 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788876671.703708:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876671.703725:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788876671.703771:0:45288:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788876671.703794:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeb0d 00000100:00080000:1.0:1788876671.703805:0:45288:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788876671.703811:0:45288:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13fd3b4000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876671.703845:0:45288:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcc5f80 x1875771532302848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876671.703867:0:45288:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788876671.703986:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532302848:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788876671.704058:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.704184:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302848 00000100:00100000:3.0:1788876671.704192:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302848 00000100:00100000:3.0:1788876671.704230:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1788876671.704238:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3661:x1875771532302848:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788876671.704264:0:43960:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1659 last 0 00000020:00000080:3.0:1788876671.704301:0:43960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeb14 00002000:00100000:3.0:1788876671.704314:0:43960:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13efeda000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788876671.704319:0:43960:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788876671.704321:0:43960:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788876671.704390:0:43960:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788876671.704412:0:43960:0:(import.c:65:import_set_state_nolock()) ffff8a13efedb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876671.704464:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532302848:12345-0@lo:8:llog_process_th.0 Request processed in 226us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.704472:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1788876671.704511:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876671.704519:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788876671.704526:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788876671.704532:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788876671.704534:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13fd3b4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1788876671.704770:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876671.704775:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.704778:0:45288:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788876671.704781:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788876671.704784:0:45288:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788876671.704786:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876671.704788:0:45288:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876671.704789:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788876671.704793:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.704794:0:45288:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788876671.704797:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788876671.704802:0:45288:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788876671.704806:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.704808:0:45288:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788876671.704811:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788876671.704815:0:45288:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1788876671.704835:0:45288:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788876671.704838:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876671.704849:0:45288:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c25e8000) 00000020:00000080:1.0:1788876671.704865:0:45288:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788876671.704870:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788876671.704941:0:45288:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788876671.704947:0:45288:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788876671.704953:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aeb22 00010000:00080000:1.0:1788876671.704979:0:45288:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ef173800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1788876671.705174:0:45288:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788876671.705239:0:45288:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788876671.705255:0:45288:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788876671.705408:0:45288:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 15, last_idx 16 00000040:00080000:1.0:1788876671.706432:0:45288:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876671.706472:0:45288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].17, 64 off9280 00000040:00080000:1.0:1788876671.706836:0:45288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x46:0x0].1, 64 off8256 00000040:00080000:2.0:1788876671.707264:0:45296:0:(llog.c:805:llog_process_thread()) index: 16, lh_last_idx: 17 synced_idx: 0 lgh_last_idx: 17 00000040:00080000:2.0:1788876671.707271:0:45296:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x42:0x0] at index 16 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788876671.708100:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876671.708121:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876671.708209:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.708415:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532302976 00000100:00100000:2.0:1788876671.708430:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532302976 00000004:00080000:3.0:1788876671.708544:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788876671.708557:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532302848:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788876671.708933:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1788876671.708949:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532302976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876671.708990:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876671.709079:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532302976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.709089:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1788876671.709172:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303104:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876671.709222:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.709257:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876671.709280:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.709315:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303104 00000100:00100000:3.0:1788876671.709324:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303104 00000100:00100000:0.0:1788876671.709343:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532302976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876671.709371:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788876671.709376:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303616 00000100:00100000:0.0:1788876671.709381:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876671.709383:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303616 00000100:00100000:3.0:1788876671.709428:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1788876671.709429:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.709443:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3665:x1875771532303104:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788876671.709460:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532304000:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876671.709472:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:491 count 1 00000100:00100000:0.0:1788876671.709487:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.709525:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303488 00000100:00100000:0.0:1788876671.709533:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303488 00000100:00100000:0.0:1788876671.709572:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304000 00000100:00100000:0.0:1788876671.709576:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304000 00000100:00100000:3.0:1788876671.709589:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3665:x1875771532303104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.709632:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1788876671.709655:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1788876671.709663:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3665:x1875771532303616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876671.709677:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:495 count 1 00000100:00080000:2.0:1788876671.709702:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876671.709730:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3665:x1875771532303616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 66us (447us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.709737:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1788876671.709750:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1788876671.709756:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3665:x1875771532303488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876671.709768:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:494 count 1 00000100:00100000:2.0:1788876671.709788:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876671.709811:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3665:x1875771532303488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 52us (387us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.709819:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:2.0:1788876671.709839:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.709846:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1788876671.709859:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532304000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788876671.709874:0:8456:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:498 count 1 00000100:00100000:2.0:1788876671.709876:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788876671.709918:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.709954:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788876671.709962:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532304000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 103us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876671.709966:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876671.709983:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1788876671.710001:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303232 00000100:00100000:3.0:1788876671.710006:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303232 00000100:00100000:2.0:1788876671.710013:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.710042:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303744 00000100:00100000:2.0:1788876671.710044:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303872:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788876671.710051:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303744 00000100:00100000:3.0:1788876671.710081:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303360 00000100:00100000:2.0:1788876671.710089:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.710090:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303360 00000100:00100000:3.0:1788876671.710131:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532303872 00000100:00100000:3.0:1788876671.710135:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532303872 00000100:00100000:0.0:1788876671.710183:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1788876671.710196:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3662:x1875771532303232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876671.710219:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:492 count 1 00000100:00100000:0.0:1788876671.710303:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3662:x1875771532303232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 110us (466us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876671.710311:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1788876671.710331:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1788876671.710338:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3662:x1875771532303744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876671.710351:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:496 count 1 00000100:00100000:0.0:1788876671.710397:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3662:x1875771532303744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876671.710404:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1788876671.710422:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1788876671.710431:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532303360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876671.710445:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:493 count 1 00000100:00100000:0.0:1788876671.710504:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532303360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 74us (493us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876671.710511:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1788876671.710530:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1788876671.710538:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532303872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788876671.710557:0:17045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:497 count 1 00000100:00100000:0.0:1788876671.710704:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532303872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 165us (620us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876671.710713:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000020:00000080:1.0:1788876671.710744:0:45288:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876671.710759:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788876671.710807:0:45288:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788876671.710845:0:45288:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeb29 00000100:00080000:1.0:1788876671.710857:0:45288:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788876671.710864:0:45288:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13ef173800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876671.710909:0:45288:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f480 x1875771532304128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:2.0:1788876671.710932:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25f100, transno 0 00000100:00080000:1.0:1788876671.710933:0:45288:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:2.0:1788876671.710943:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25f100/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.710964:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303360:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876671.710981:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606ed80, transno 0 00000004:00080000:2.0:1788876671.710985:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606ed80/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.710994:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303872:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876671.711008:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25f800, transno 0 00000004:00080000:2.0:1788876671.711010:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25f800/1, rc -2, transno 0 00000020:01000000:1.0:1788876671.711014:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788876671.711015:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303232:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1788876671.711023:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.711027:0:45288:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000004:00080000:2.0:1788876671.711029:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606d500, transno 0 00000020:01000000:1.0:1788876671.711033:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000004:00080000:2.0:1788876671.711035:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606d500/1, rc -2, transno 0 00000020:00000080:1.0:1788876671.711042:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1788876671.711045:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532303744:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1788876671.711048:0:45288:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788876671.711056:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788876671.711059:0:45288:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788876671.711062:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876671.711065:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.711067:0:45288:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788876671.711070:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876671.711073:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.711075:0:45288:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788876671.711079:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788876671.711117:0:45288:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45288:1875771532304256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.711370:0:45288:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.711410:0:45288:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9c780 going to sleep for 11 seconds 00000004:00080000:1.0:1788876671.711535:0:45294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 4 in flight, 4 done 00000040:00080000:1.0:1788876671.711541:0:45294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x40:0x0] index 112 count 5 00000040:00080000:1.0:1788876671.711561:0:45294:0:(llog.c:805:llog_process_thread()) index: 17, lh_last_idx: 17 synced_idx: 17 lgh_last_idx: 17 00000040:00080000:1.0:1788876671.711566:0:45294:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x44:0x0] at index 17 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1788876671.711583:0:45294:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788876671.711628:0:45294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1659607025386ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788876671.711634:0:45294:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788876671.711856:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304256 00000100:00100000:2.0:1788876671.711866:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304256 00000100:00100000:2.0:1788876671.711933:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788876671.711945:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:45288:x1875771532304256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876671.712111:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:45288:x1875771532304256:12345-0@lo:502:llog_process_th.0 Request processed in 169us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.712120:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:2.0:1788876671.713015:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25e300, transno 0 00000004:00080000:2.0:1788876671.713024:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25e300/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.713037:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303488:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876671.713050:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606c700, transno 0 00000004:00080000:2.0:1788876671.713053:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606c700/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.713057:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532304000:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876671.713066:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13eb25f480, transno 0 00000004:00080000:2.0:1788876671.713068:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13eb25f480/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.713071:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303104:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788876671.713079:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606ce00, transno 0 00000004:00080000:2.0:1788876671.713081:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606ce00/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.713084:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532303616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788876671.714584:0:45288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45288:1875771532304256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876671.714670:0:45288:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876671.714681:0:45288:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876671.714684:0:45288:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788876671.714689:0:45288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788876671.716180:0:45276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788876671.716215:0:45276:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788876671.716243:0:45276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.716258:0:45276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876671.716268:0:45276:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a12c62dc000 from 1 10000000:01000000:2.0:1788876671.716279:0:45276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788876671.716322:0:45276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.716331:0:45276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.716343:0:45276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.716370:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876671.716441:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.716479:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01240 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.718241:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532304128:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788876671.718328:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.718845:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304128 00000100:00100000:0.0:1788876671.718861:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304128 00000100:00100000:0.0:1788876671.718930:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1788876671.718939:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3661:x1875771532304128:12345-0@lo:8:llog_process_th.0 00000040:00080000:1.0:1788876671.718947:0:45294:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 16, last_idx 17 00000040:00080000:1.0:1788876671.718976:0:45294:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x40:0x0] at index 16 of catalog [0x1:0x2:0x0] 00010000:00080000:0.0:1788876671.718986:0:17045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1659 last 0 00000020:00000080:0.0:1788876671.719029:0:17045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeb37 00002000:00100000:0.0:1788876671.719049:0:17045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a13d212e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788876671.719054:0:17045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788876671.719058:0:17045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:1.0:1788876671.719156:0:45294:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00002000:00080000:0.0:1788876671.719843:0:17045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788876671.719897:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8a13d212d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876671.720018:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532304128:12345-0@lo:8:llog_process_th.0 Request processed in 1077us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.720028:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1788876671.720078:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304384 00000100:00100000:0.0:1788876671.720083:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304384 00000100:00100000:0.0:1788876671.720121:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788876671.720128:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:45276:x1875771532304384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876671.720140:0:45287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876671.720917:0:45287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aeb30 expref: -99 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.720957:0:45287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 9 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.720971:0:45287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 9 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.721112:0:45287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52000, rc 0) 00000100:00100000:0.0:1788876671.721243:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532304384:12345-0@lo:101:mount.lustre.0 Request processed in 1114us (4801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.721251:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788876671.723454:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876671.723485:0:45276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876671.723498:0:45276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876671.724141:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304512:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788876671.724210:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.724256:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.724480:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304512 00000100:00100000:0.0:1788876671.724495:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304512 00000100:00100000:1.0:1788876671.725818:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788876671.725833:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788876671.725843:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788876671.725849:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788876671.725853:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788876671.725896:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788876671.725896:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788876671.725909:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532304128:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788876671.725928:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532304512:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788876671.725968:0:45283:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788876671.726487:0:45283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788876671.726493:0:45283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788876671.726497:0:45283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788876671.726502:0:45283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 70 00000100:00100000:0.0:1788876671.726819:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532304512:12345-0@lo:256:mount.lustre.0 Request processed in 905us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.726830:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788876671.727167:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304512:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788876671.727976:0:45276:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788876671.728003:0:45276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.728015:0:45276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876671.728024:0:45276:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a12c62dc000 from 1 10000000:01000000:3.0:1788876671.728027:0:45276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876671.728072:0:45276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.728090:0:45276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.728103:0:45276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876671.728130:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876671.728196:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788876671.728760:0:45277:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788876671.730775:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532304640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876671.730843:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.730983:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876671.730990:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876671.731016:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.731056:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305280:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876671.731077:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.731129:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876671.731136:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305664:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876671.731172:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.731211:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305792:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788876671.731232:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.733657:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304640 00000100:00100000:3.0:1788876671.733674:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304640 00000100:00100000:3.0:1788876671.733737:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1788876671.733746:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532304640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876671.733769:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876671.733829:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532304640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.733836:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:3.0:1788876671.733903:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532304640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876671.733942:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13efdfc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876671.734070:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304768 00000100:00100000:2.0:1788876671.734075:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304768 00000100:00100000:2.0:1788876671.734094:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532304896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876671.734197:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305152 00000100:00100000:3.0:1788876671.734202:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305152 00000100:00100000:2.0:1788876671.734243:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.734264:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876671.734355:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.734391:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305280 00000100:00100000:3.0:1788876671.734394:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305280 00000100:00100000:2.0:1788876671.734590:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788876671.734668:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876671.734691:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.734750:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305536:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876671.734785:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305664 00000100:00100000:3.0:1788876671.734788:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305664 00000100:00100000:3.0:1788876671.734807:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305792 00000100:00100000:3.0:1788876671.734810:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305792 00000100:00100000:3.0:1788876671.734823:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532304896 00000100:00100000:3.0:1788876671.734825:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532304896 00000100:00100000:2.0:1788876671.734842:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.734873:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305408 00000100:00100000:3.0:1788876671.734876:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305408 00000100:00100000:2.0:1788876671.734912:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305024 00000100:00100000:2.0:1788876671.734915:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305024 00000100:00100000:3.0:1788876671.734942:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305536 00000100:00100000:3.0:1788876671.734949:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305536 00000100:00100000:3.0:1788876671.734965:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1788876671.734971:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532305152:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876671.735002:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1788876671.735039:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532305280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876671.735066:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:494 count 1 00002000:00080000:2.0:1788876671.735105:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:454 count 1 00000100:00100000:3.0:1788876671.735235:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3665:x1875771532305152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 263us (4217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.735241:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:3.0:1788876671.735254:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1788876671.735260:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3665:x1875771532305664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876671.735270:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:497 count 1 00000100:00100000:2.0:1788876671.735366:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3665:x1875771532305280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 328us (4287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876671.735372:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1788876671.735384:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1788876671.735389:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3665:x1875771532305792:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876671.735444:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+11:3665:x1875771532305664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 184us (4272us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.735450:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1788876671.735460:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1788876671.735465:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3662:x1875771532304896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876671.735474:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:492 count 1 00000100:00100000:3.0:1788876671.735514:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3662:x1875771532304896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48us (1270us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.735519:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00002000:00080000:2.0:1788876671.735538:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:498 count 1 00000100:00100000:3.0:1788876671.735568:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1788876671.735574:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3662:x1875771532305408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876671.735583:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:495 count 1 00000100:00100000:2.0:1788876671.735698:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3665:x1875771532305792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 308us (4464us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876671.735704:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1788876671.735720:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1788876671.735726:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3662:x1875771532305536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876671.735736:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:496 count 1 00000100:00100000:2.0:1788876671.735833:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3662:x1875771532305536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 108us (991us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876671.735839:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1788876671.735855:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1788876671.735860:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532305024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788876671.735869:0:43958:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:493 count 1 00000100:00100000:2.0:1788876671.735917:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532305024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57us (1224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876671.735923:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:2.0:1788876671.735945:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788876671.735994:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606ce00, transno 0 00000004:00080000:2.0:1788876671.735999:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606ce00/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.736011:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305024:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876671.736019:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606ca80, transno 0 00000004:00080000:2.0:1788876671.736021:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606ca80/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.736024:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305536:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876671.736030:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606c700, transno 0 00000004:00080000:2.0:1788876671.736032:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606c700/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.736034:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532304896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876671.736109:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532305408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 534us (1753us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.736115:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000004:00080000:2.0:1788876671.736261:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606e680, transno 0 00000004:00080000:2.0:1788876671.736264:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606e680/1, rc -2, transno 0 00000100:00100000:2.0:1788876671.736268:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305408:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876671.736394:0:45296:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 5 in progress, 4 in flight, 3 done 00000100:00100000:2.0:1788876671.736461:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788876671.736488:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788876671.736517:0:45296:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x42:0x0] index 112 count 6 00000040:00080000:2.0:1788876671.736533:0:45296:0:(llog.c:805:llog_process_thread()) index: 17, lh_last_idx: 17 synced_idx: 17 lgh_last_idx: 17 00000040:00080000:2.0:1788876671.736537:0:45296:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x46:0x0] at index 17 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788876671.736553:0:45296:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788876671.736576:0:45296:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1659631973285ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788876671.736581:0:45296:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788876671.736768:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532305920 00000100:00100000:3.0:1788876671.736774:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532305920 00000100:00100000:3.0:1788876671.736798:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1788876671.736803:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532305920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788876671.736815:0:43964:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:499 count 1 00000100:00100000:3.0:1788876671.737025:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532305920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 220us (534us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876671.737031:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000004:00080000:3.0:1788876671.737087:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606df80, transno 0 00000004:00080000:3.0:1788876671.737091:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606df80/1, rc -2, transno 0 00000100:00100000:3.0:1788876671.737096:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305792:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876671.737104:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606dc00, transno 0 00000004:00080000:3.0:1788876671.737106:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606dc00/1, rc -2, transno 0 00000100:00100000:3.0:1788876671.737109:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305664:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876671.737115:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606d500, transno 0 00000004:00080000:3.0:1788876671.737117:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606d500/1, rc -2, transno 0 00000100:00100000:3.0:1788876671.737120:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305280:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788876671.737127:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a12c606f100, transno 0 00000004:00080000:3.0:1788876671.737129:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a12c606f100/1, rc -2, transno 0 00000100:00100000:3.0:1788876671.737132:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532305152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788876671.737192:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788876671.737200:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:45276:x1875771532304768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876671.737208:0:45287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876671.737226:0:45287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae35a00/0xf5bf0f7e313aeb4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aeb45 expref: -99 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.737248:0:45287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae35a00/0xf5bf0f7e313aeb4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb45 expref: 10 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.737261:0:45287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae35a00/0xf5bf0f7e313aeb4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb45 expref: 10 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.737270:0:45287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35a00, rc 0) 00000100:00100000:3.0:1788876671.737313:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532304768:12345-0@lo:101:mount.lustre.0 Request processed in 114us (9117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.737319:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788876671.737355:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532304768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876671.737371:0:45276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.737381:0:45276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876671.737440:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876671.737465:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.737486:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13efdfc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876671.737738:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306048 00000100:00100000:1.0:1788876671.737744:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306048 00000100:00100000:1.0:1788876671.737770:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788876671.737776:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532306048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876671.737910:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532306048:12345-0@lo:501:mount.lustre.0 Request processed in 133us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876671.737918:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788876671.738398:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876671.738430:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876671.738476:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.738510:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13efdfc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.738527:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306176 00000100:00100000:3.0:1788876671.738531:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306176 00000100:00100000:3.0:1788876671.738564:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788876671.738570:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532306176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876671.738763:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532306176:12345-0@lo:503:mount.lustre.0 Request processed in 191us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.738770:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788876671.738812:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306176:0@lo:503:mount.lustre.0 00000004:00080000:3.0:1788876671.740750:0:45277:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788876671.740801:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a13fad3b480, transno 0 00000004:00080000:3.0:1788876671.740808:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a13fad3b480/1, rc -2, transno 0 00000100:00100000:3.0:1788876671.740815:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532305920:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788876671.741022:0:45296:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 4 done 00000040:00080000:2.0:1788876671.741104:0:45296:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 16, last_idx 17 00000040:00080000:2.0:1788876671.741125:0:45296:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x42:0x0] at index 16 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788876671.742032:0:45298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45298:1875771532306304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876671.742118:0:45298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.742442:0:45298:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01600 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.742486:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306304 00000100:00100000:3.0:1788876671.742495:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306304 00000100:00100000:3.0:1788876671.742589:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788876671.742757:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45298:x1875771532306304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876671.743364:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45298:x1875771532306304:12345-0@lo:502:llog_process_th.0 Request processed in 609us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.743374:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788876671.744859:0:45298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45298:1875771532306304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788876671.744924:0:45298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876671.744939:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876671.744941:0:45298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788876671.744948:0:45298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a12c62dc000 00000020:00000080:2.0:1788876671.744951:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788876671.744959:0:45298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876671.744962:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876671.744963:0:45298:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788876671.744965:0:45298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876671.744967:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876671.744969:0:45298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788876671.744972:0:45298:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a12c62dc000 00000020:00000080:2.0:1788876671.744974:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788876671.747749:0:45298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45298:1875771532306432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876671.747833:0:45298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.747919:0:45298:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01300 going to sleep for 11 seconds 00000100:00100000:3.0:1788876671.747995:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306432 00000100:00100000:3.0:1788876671.748003:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306432 00000100:00100000:3.0:1788876671.748046:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788876671.748055:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45298:x1875771532306432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876671.748242:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45298:x1875771532306432:12345-0@lo:502:llog_process_th.0 Request processed in 187us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876671.748249:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876671.748479:0:45298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45298:1875771532306432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788876671.748509:0:45298:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876671.748518:0:45298:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876671.748521:0:45298:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788876671.748526:0:45298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788876671.748790:0:45276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788876671.748812:0:45276:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876671.748834:0:45276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.748847:0:45276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876671.748914:0:45276:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788876671.748917:0:45276:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a12c62dc000 10000000:01000000:3.0:1788876671.748920:0:45276:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a12c62dc000 10000000:01000000:3.0:1788876671.748924:0:45276:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788876671.748930:0:45276:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a12c62dc000 from 1 10000000:01000000:3.0:1788876671.748934:0:45276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788876671.748960:0:45276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.748969:0:45276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.748979:0:45276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876671.748996:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876671.749029:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.756196:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123300 going to sleep for 11 seconds 00000100:00100000:1.0:1788876671.756368:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306560 00000100:00100000:1.0:1788876671.756377:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306560 00000100:00100000:1.0:1788876671.756426:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788876671.756435:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532306560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876671.756451:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876671.756469:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeb5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aeb53 expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.756496:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb53 expref: 11 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.756508:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeb5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb53 expref: 11 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.756517:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486000, rc 0) 00000100:00100000:1.0:1788876671.756574:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532306560:12345-0@lo:101:mount.lustre.0 Request processed in 140us (7545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876671.756581:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788876671.756754:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876671.756771:0:45276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.756781:0:45276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876671.756858:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876671.756900:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.756925:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123300 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.756996:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306688 00000100:00100000:0.0:1788876671.757001:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306688 00000100:00100000:0.0:1788876671.757031:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788876671.757038:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532306688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876671.757166:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532306688:12345-0@lo:501:mount.lustre.0 Request processed in 128us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.757173:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788876671.757242:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876671.757267:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876671.757376:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.757397:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123300 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.757442:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306816 00000100:00100000:0.0:1788876671.757447:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306816 00000100:00100000:0.0:1788876671.757470:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788876671.757477:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532306816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876671.757559:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532306816:12345-0@lo:503:mount.lustre.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.757566:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788876671.757728:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532306816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876671.758204:0:45301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532306944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.758242:0:45301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.758350:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532306944 00000100:00100000:0.0:1788876671.758355:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532306944 00000100:00100000:0.0:1788876671.758387:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788876671.758394:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532306944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876671.758468:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532306944:12345-0@lo:502:llog_process_th.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.758476:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788876671.758558:0:45301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876671.758572:0:45301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532306944:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788876671.758664:0:45301:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788876671.758679:0:45301:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c25ecd40) 00000020:00000080:1.0:1788876671.758702:0:45301:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788876671.758790:0:45301:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c62dc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788876671.758794:0:45301:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c62dc000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788876671.758797:0:45301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c62dc000 4 00010000:00080000:1.0:1788876671.758828:0:45301:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13f07ab000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1788876671.760393:0:45301:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1788876671.760576:0:45301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788876671.760642:0:45301:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788876671.760655:0:45301:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313aeb68 00000100:00080000:1.0:1788876671.760664:0:45301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788876671.760670:0:45301:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13f07ab000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876671.760700:0:45301:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c000 x1875771532307072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876671.760724:0:45301:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788876671.760803:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532307072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876671.760865:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.766187:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307072 00000100:00100000:1.0:1788876671.766201:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307072 00000100:00100000:1.0:1788876671.766235:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:1.0:1788876671.766243:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532307072:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876671.766402:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532307072:12345-0@lo:38:llog_process_th.0 Request processed in 158us (5535us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788876671.766409:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1788876671.769461:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788876671.769474:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876671.769481:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788876671.769486:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532307072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876671.773580:0:45301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532307200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876671.774921:0:45301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.780397:0:45301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876671.781277:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307200 00000100:00100000:1.0:1788876671.781288:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307200 00000100:00100000:1.0:1788876671.781345:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788876671.781355:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c7940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532307200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.781552:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c7940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532307200:12345-0@lo:502:llog_process_th.0 Request processed in 198us (6635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876671.781560:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788876671.784831:0:45301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532307200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.785227:0:45301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532307328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876671.785297:0:45301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.785329:0:45301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.785464:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307328 00000100:00100000:0.0:1788876671.785470:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307328 00000100:00100000:0.0:1788876671.785543:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788876671.785552:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c7943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532307328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876671.785692:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c7943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45301:x1875771532307328:12345-0@lo:502:llog_process_th.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.785700:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788876671.785768:0:45301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45301:1875771532307328:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788876671.785787:0:45301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788876671.792353:0:45276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788876671.792397:0:45276:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788876671.792428:0:45276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.792440:0:45276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788876671.792499:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788876671.792501:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876671.792502:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876671.792504:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876671.792505:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876671.792506:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876671.792507:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876671.792509:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876671.792511:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876671.792512:0:45276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788876671.792516:0:45276:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788876671.792518:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788876671.792520:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876671.792522:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876671.792523:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876671.792524:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876671.792525:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876671.792526:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876671.792527:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876671.792528:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876671.792529:0:45276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788876671.792553:0:45276:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788876671.792572:0:45276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532307456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788876671.792670:0:45276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876671.792702:0:45276:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876671.792772:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307456 00000100:00100000:1.0:1788876671.792779:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307456 00000100:00100000:1.0:1788876671.792825:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788876671.792835:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:45276:x1875771532307456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788876671.792859:0:45283:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788876671.792873:0:45283:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788876671.795868:0:45283:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876671.795894:0:45283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788876671.796001:0:45285:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876671.796006:0:45285:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876671.796026:0:45285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.796044:0:45285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 11 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.796053:0:45285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.796091:0:45285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 11 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876671.796105:0:45285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 11 pid: 45287 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876671.796118:0:45285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45285:1875771532307584:0@lo:104: 00000100:00100000:1.0:1788876671.796173:0:45285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.796215:0:45285:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876671.796273:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307584 00000100:00100000:0.0:1788876671.796280:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307584 00000100:00100000:0.0:1788876671.796327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876671.796336:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:45285:x1875771532307584:12345-0@lo:104: 00010000:00010000:0.0:1788876671.796349:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796411:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788876671.796417:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:45285:x1875771532307584:12345-0@lo:104: Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.796424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788876671.796443:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876671.796449:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796456:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960e00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876671.796460:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796468:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876671.796475:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876671.796480:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876671.796506:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796512:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788876671.796531:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796538:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960e00/0xf5bf0f7e313aeb30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313aeb3e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796552:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876671.796554:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876671.796556:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876671.796576:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532307712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876671.796641:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.796682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307712 00000100:00100000:0.0:1788876671.796686:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307712 00010000:00010000:0.0:1788876671.796702:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 12 pid: 45287 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876671.796725:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788876671.796731:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:3663:x1875771532307712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876671.796741:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876671.796747:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 12 pid: 45287 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796757:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 12 pid: 45287 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796775:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796783:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788876671.796796:0:6525:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000791240s 00010000:00010000:0.0:1788876671.796800:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796806:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796812:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796822:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796827:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876671.796832:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796838:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796846:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876671.796854:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876671.796894:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:3663:x1875771532307712:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.796901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788876671.796936:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532307712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876671.797023:0:45285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe52000/0xf5bf0f7e313aeb3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313aeb30 expref: 11 pid: 45287 timeout: 1759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876671.797034:0:45285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:45285:1875771532307584:0@lo:104: 00010000:00010000:3.0:1788876671.797047:0:45285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.797056:0:45285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.797063:0:45285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876671.797069:0:45285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313aeb6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 45285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876671.797570:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3538050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:45276:x1875771532307456:12345-0@lo:253:mount.lustre.0 Request processed in 4735us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876671.797581:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788876671.797705:0:45276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:45276:1875771532307456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788876671.797717:0:45276:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788876671.797721:0:45276:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788876671.797723:0:45276:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876671.797725:0:45276:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876671.797726:0:45276:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876671.797727:0:45276:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876671.797729:0:45276:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876671.797730:0:45276:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876671.797732:0:45276:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876671.797733:0:45276:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876671.797734:0:45276:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788876671.797746:0:45276:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1788876671.809143:0:45276:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:3.0:1788876671.809522:0:45276:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788876671.809625:0:45306:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:1.0:1788876671.809629:0:45306:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:1.0:1788876671.809926:0:45307:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788876671.810853:0:45276:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788876671.812222:0:45308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532307840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876671.812308:0:45308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876671.812345:0:45308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7b40 going to sleep for 11 seconds 00000040:01000000:3.0:1788876671.812981:0:45276:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788876671.813030:0:45276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788876671.813572:0:45276:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788876671.813581:0:45276:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788876671.813655:0:45276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788876671.818579:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307840 00000100:00100000:2.0:1788876671.818620:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307840 00000100:00100000:2.0:1788876671.818670:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1788876671.818679:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532307840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.818797:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532307840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 119us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.818804:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1788876671.818866:0:45308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532307840:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788876671.818915:0:45308:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788876671.818954:0:45308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532307968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.818991:0:45308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.819013:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532307968 00000100:00100000:2.0:1788876671.819016:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532307968 00000100:00100000:2.0:1788876671.819035:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788876671.819040:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532307968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.819119:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532307968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.819125:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788876671.819141:0:45308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876671.819166:0:45308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532307968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.819227:0:45308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532308096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.819249:0:45308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876671.819267:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308096 00000100:00100000:2.0:1788876671.819270:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308096 00000100:00100000:2.0:1788876671.819290:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1788876671.819295:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532308096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876671.819334:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532308096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.819340:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:2.0:1788876671.819355:0:45308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01300 going to sleep for 11 seconds 00000100:00100000:2.0:1788876671.819365:0:45308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532308096:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788876671.825111:0:45276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788876671.827956:0:45308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532308224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788876671.828062:0:45308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876671.828104:0:45308:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876671.828284:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308224 00000100:00100000:2.0:1788876671.828293:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308224 00000100:00100000:2.0:1788876671.828346:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1788876671.828355:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532308224:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788876671.828896:0:45276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788876671.828966:0:45276:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788876671.829077:0:45276:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788876671.829840:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:45308:x1875771532308224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1482us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876671.829850:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1788876671.829947:0:45308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:45308:1875771532308224:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788876671.832132:0:45308:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1788876671.836007:0:45307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788876671.836100:0:45307:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788876671.836334:0:45308:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788876671.836339:0:45308:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788876671.836577:0:45276:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x44:0x0] (8/32) registered 00010000:00080000:3.0:1788876671.840306:0:45276:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 68719477397 00010000:00080000:1.0:1788876671.841337:0:45309:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 45309 00010000:02000000:1.0:1788876671.841385:0:45309:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788876671.841389:0:45309:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788876671.841393:0:45309:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1788876671.841468:0:45276:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788876671.841483:0:45276:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788876671.841501:0:45276:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788876671.841520:0:45276:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788876671.844082:0:45276:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788876671.844362:0:45276:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788876671.852000:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876672.491105:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532308352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876672.491187:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876672.494043:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308352 00000100:00100000:0.0:1788876672.494065:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308352 00000100:00100000:0.0:1788876672.494145:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1788876672.494157:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532308352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876672.494192:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491649600 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876672.494291:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532308352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876672.494297:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1788876672.494349:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532308352:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876672.874782:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876673.070584:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876673.070768:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240576 00000100:00100000:3.0:1788876673.070780:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240576 00000100:00100000:3.0:1788876673.070839:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1788876673.070849:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511240576:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.070866:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.070898:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313aeb76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048863 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.070926:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313aeb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048863 expref: 6 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.070937:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313aeb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048863 expref: 6 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.070945:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34800, rc 0) 00000100:00100000:3.0:1788876673.070996:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c353a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511240576:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 149us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.071002:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1788876673.083419:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876673.085708:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240704 00000100:00100000:3.0:1788876673.085724:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240704 00000100:00100000:3.0:1788876673.085829:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1788876673.085840:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ef13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511240704:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788876673.085866:0:45287:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788876673.085900:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788876673.085904:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788876673.085907:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788876673.085910:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788876673.085912:0:45287:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 71 00000100:00100000:3.0:1788876673.088252:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ef13ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511240704:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 2403us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.088265:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1788876673.098698:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876673.098814:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.099667:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240832 00000100:00100000:0.0:1788876673.099685:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240832 00000100:00100000:0.0:1788876673.099747:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2441 00000100:00100000:0.0:1788876673.099758:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511240832:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1788876673.099794:0:8722:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13d0f60800, cookie 0xf5bf0f7e313aeac0 00010000:00080000:0.0:1788876673.099801:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t68719477398 exp ffff8a13d0f60800 cur 1660 last 1788876671 00010000:02000400:0.0:1788876673.099810:0:8722:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1788876673.099816:0:8722:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1788876673.099836:0:8722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788876673.100013:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876673.100113:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511240832:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 Request processed in 354us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.100121:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2441 00000100:00100000:3.0:1788876673.102590:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511240960 00000100:00100000:3.0:1788876673.102619:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511240960 00000100:00100000:3.0:1788876673.102929:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1788876673.102941:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ef138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511240960:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.102959:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.102980:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313aeb7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704886a expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.103011:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313aeb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704886a expref: 7 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.103023:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313aeb7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704886a expref: 7 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.103032:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34000, rc 0) 00000100:00100000:3.0:1788876673.106676:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ef138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511240960:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 3719us (7970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.106695:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1788876673.109942:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.110182:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234048 00000100:00100000:0.0:1788876673.110192:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234048 00000100:00100000:0.0:1788876673.110256:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2442 00000100:00100000:0.0:1788876673.110267:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511234048:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:0.0:1788876673.110300:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 68719477398, current: 68719477398, replaying 00000100:00100000:0.0:1788876673.110319:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511234048:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 55us (390us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788876673.110325:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2442 00010000:00080000:3.0:1788876673.112524:0:45309:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1788876673.116669:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.116761:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241088 00000100:00100000:0.0:1788876673.116772:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241088 00000100:00100000:0.0:1788876673.116835:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1788876673.116846:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ef138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511241088:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.117056:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ef138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511241088:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 212us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.117065:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1788876673.118790:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.118936:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241216 00000100:00100000:0.0:1788876673.118946:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241216 00000100:00100000:0.0:1788876673.119000:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1788876673.119010:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ef138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511241216:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.119165:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ef138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511241216:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 155us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.119173:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1788876673.123982:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.124107:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241344 00000100:00100000:0.0:1788876673.124123:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241344 00000100:00100000:0.0:1788876673.124197:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1788876673.124208:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511241344:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.124228:0:45283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.124251:0:45283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe53400/0xf5bf0f7e313aeb84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048871 expref: -99 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.124298:0:45283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe53400/0xf5bf0f7e313aeb84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048871 expref: 9 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.124310:0:45283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe53400/0xf5bf0f7e313aeb84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048871 expref: 9 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.124319:0:45283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53400, rc 0) 00000100:00100000:0.0:1788876673.124377:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4582450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241344:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 171us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.124385:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1788876673.126568:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.126679:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241472 00000100:00100000:0.0:1788876673.126688:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241472 00000100:00100000:0.0:1788876673.126736:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1788876673.126745:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241472:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.126886:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5597450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241472:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.126893:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1788876673.135719:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.135804:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241600 00000100:00100000:0.0:1788876673.135813:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241600 00000100:00100000:0.0:1788876673.135869:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1788876673.135890:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241600:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.137359:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5596c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241600:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 1462us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.137372:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1788876673.153472:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876673.156116:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241728 00000100:00100000:0.0:1788876673.156131:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241728 00000100:00100000:0.0:1788876673.156197:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1788876673.156207:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511241728:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.156222:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.156240:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe53800/0xf5bf0f7e313aeb8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048878 expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.156270:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe53800/0xf5bf0f7e313aeb8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048878 expref: 10 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.156294:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe53800/0xf5bf0f7e313aeb8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048878 expref: 10 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.156305:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53800, rc 0) 00000100:00100000:0.0:1788876673.156394:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511241728:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 186us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.156401:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1788876673.167942:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876673.170701:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241856 00000100:00100000:3.0:1788876673.170716:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241856 00000100:00100000:3.0:1788876673.173018:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1788876673.173041:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511241856:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.173191:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5594450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511241856:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 159us (5257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788876673.173199:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 10000000:01000000:2.0:1788876673.323457:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788876673.323467:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a12c62dc000 from 71 10000000:01000000:2.0:1788876673.323474:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788876673.323526:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.323540:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.323553:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.323582:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.323692:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.323733:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01300 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.323756:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308480 00000100:00100000:2.0:1788876673.323764:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308480 00000100:00100000:2.0:1788876673.323822:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788876673.323833:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532308480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.323849:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876673.323880:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313aeb99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aeb92 expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.323911:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313aeb99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb92 expref: 11 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.323925:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313aeb99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb92 expref: 11 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.323937:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7961a00, rc 0) 00000100:00100000:2.0:1788876673.323981:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5595c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532308480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.323992:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788876673.324042:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.324060:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.324070:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.324129:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.324162:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.324179:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01300 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.324196:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308608 00000100:00100000:2.0:1788876673.324199:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308608 00000100:00100000:2.0:1788876673.324226:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788876673.324233:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eefe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532308608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788876673.324247:0:45283:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788876673.324267:0:45283:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788876673.324271:0:45283:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 71 00000100:00100000:2.0:1788876673.324735:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eefe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532308608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 502us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.324742:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788876673.325088:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788876673.325141:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876673.325151:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.325161:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876673.325172:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788876673.325177:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:1.0:1788876673.325179:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788876673.325207:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.325217:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.325225:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.325240:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.325271:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.325311:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.325450:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308736 00000100:00100000:2.0:1788876673.325456:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308736 00000100:00100000:2.0:1788876673.325494:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788876673.325501:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eefe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532308736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.325509:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876673.325523:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7960800/0xf5bf0f7e313aeba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aeba0 expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.325545:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7960800/0xf5bf0f7e313aeba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeba0 expref: 12 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.325556:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7960800/0xf5bf0f7e313aeba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aeba0 expref: 12 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.325563:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960800, rc 0) 00000100:00100000:2.0:1788876673.325624:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eefe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532308736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.325631:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788876673.325662:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.325672:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.325682:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.325744:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.325769:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.325783:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01600 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.325795:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308864 00000100:00100000:2.0:1788876673.325799:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308864 00000100:00100000:2.0:1788876673.325822:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876673.325828:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eefe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532308864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.325956:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eefe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532308864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.325964:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876673.325994:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.326036:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.326071:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.326084:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.326094:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532308992 00000100:00100000:2.0:1788876673.326097:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532308992 00000100:00100000:2.0:1788876673.326114:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788876673.326119:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eefe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532308992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.326186:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eefe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532308992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.326193:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788876673.326226:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532308992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876673.334985:0:45376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788876673.335622:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788876673.335649:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788876673.335661:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.335673:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876673.335682:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788876673.335685:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788876673.335688:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788876673.335725:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.335738:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.335749:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.335774:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.335839:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.335894:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.335902:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309120 00000100:00100000:3.0:1788876673.335910:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309120 00000100:00100000:3.0:1788876673.335960:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788876673.335969:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532309120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.335983:0:45287:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.335995:0:45287:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313aebb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebae expref: -99 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.336019:0:45287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313aebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebae expref: 13 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.336030:0:45287:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313aebb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebae expref: 13 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.336039:0:45287:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34400, rc 0) 00000100:00100000:3.0:1788876673.336084:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.336091:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788876673.336110:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.336124:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.336134:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.336186:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.336212:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.336236:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.336375:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309248 00000100:00100000:3.0:1788876673.336380:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309248 00000100:00100000:3.0:1788876673.336411:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788876673.336418:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.336547:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.336554:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788876673.336578:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.336632:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.336676:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.336692:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.336862:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309376 00000100:00100000:3.0:1788876673.336867:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309376 00000100:00100000:3.0:1788876673.336906:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788876673.336912:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.342448:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5526us (5760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.342465:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788876673.342545:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788876673.343391:0:45378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788876673.347701:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788876673.347743:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788876673.347756:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.347769:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876673.347780:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788876673.347783:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:1.0:1788876673.347787:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876673.347835:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.347843:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.347857:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.347897:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.347966:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.348013:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.348092:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309504 00000100:00100000:0.0:1788876673.348100:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309504 00000100:00100000:0.0:1788876673.348163:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788876673.348174:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532309504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.348188:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.348202:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe52e00/0xf5bf0f7e313aebc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebbc expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.348227:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe52e00/0xf5bf0f7e313aebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebbc expref: 14 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.348239:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe52e00/0xf5bf0f7e313aebc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebbc expref: 14 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.348249:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52e00, rc 0) 00000100:00100000:0.0:1788876673.348310:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.348318:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788876673.348762:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876673.348780:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.348791:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.348862:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.348905:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.348969:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.351774:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309632 00000100:00100000:3.0:1788876673.351790:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309632 00000100:00100000:3.0:1788876673.352705:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788876673.352718:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.352910:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.352918:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788876673.353023:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.353078:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.353128:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.354189:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.358306:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309760 00000100:00100000:0.0:1788876673.358326:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309760 00000100:00100000:0.0:1788876673.358412:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788876673.358424:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.358633:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (5503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.358641:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788876673.358717:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876673.359673:0:45379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788876673.359913:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788876673.359941:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788876673.359953:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.359965:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876673.359975:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788876673.359978:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:0.0:1788876673.359981:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788876673.360021:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.360029:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.360038:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876673.360060:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.360121:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876673.360151:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.360216:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532309888 00000100:00100000:3.0:1788876673.360224:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532309888 00000100:00100000:3.0:1788876673.360266:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788876673.360320:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532309888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.360332:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.360346:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae35400/0xf5bf0f7e313aebd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebca expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.360368:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae35400/0xf5bf0f7e313aebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebca expref: 15 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.360378:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae35400/0xf5bf0f7e313aebd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebca expref: 15 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.360385:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35400, rc 0) 00000100:00100000:3.0:1788876673.360431:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532309888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.360437:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788876673.360588:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532309888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.360631:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.360640:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.360694:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.360722:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.360793:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b98f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.364365:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310016 00000100:00100000:3.0:1788876673.364380:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310016 00000100:00100000:3.0:1788876673.364526:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788876673.364536:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532310016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.364810:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532310016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.364818:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788876673.366103:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.366157:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.366213:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876673.366254:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876673.366722:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310144 00000100:00100000:1.0:1788876673.366728:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310144 00000100:00100000:1.0:1788876673.366776:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788876673.366785:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532310144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.366893:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532310144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876673.366900:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788876673.367008:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876673.368160:0:45380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788876673.368416:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788876673.368439:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788876673.368450:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.368460:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876673.368470:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788876673.368472:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788876673.368475:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788876673.368508:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.368516:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.368526:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.368546:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.368597:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.368652:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.368847:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310272 00000100:00100000:2.0:1788876673.368853:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310272 00000100:00100000:2.0:1788876673.368902:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788876673.368911:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532310272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.368921:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876673.368934:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313aebdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebd8 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.368955:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313aebdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebd8 expref: 16 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.368965:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313aebdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebd8 expref: 16 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.368973:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7961c00, rc 0) 00000100:00100000:2.0:1788876673.369011:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.369017:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788876673.369115:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876673.369129:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.369137:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.369197:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.369220:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.369248:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.369420:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310400 00000100:00100000:2.0:1788876673.369426:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310400 00000100:00100000:2.0:1788876673.369460:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788876673.369468:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.369773:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.369780:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788876673.369961:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.369991:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.370034:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.370096:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.370125:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310528 00000100:00100000:3.0:1788876673.370130:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310528 00000100:00100000:3.0:1788876673.370185:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788876673.370192:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.370976:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 782us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.370984:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788876673.371064:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876673.371854:0:45381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788876673.372162:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788876673.372184:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788876673.372194:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372205:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876673.372213:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788876673.372216:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:2.0:1788876673.372218:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788876673.372248:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372255:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372264:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.372282:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.372326:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.372559:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b98240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.372763:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310656 00000100:00100000:0.0:1788876673.372770:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310656 00000100:00100000:2.0:1788876673.372864:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876673.372883:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532310656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.372894:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876673.372906:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7961e00/0xf5bf0f7e313aebed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebe6 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372928:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7961e00/0xf5bf0f7e313aebed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebe6 expref: 17 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372938:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7961e00/0xf5bf0f7e313aebed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebe6 expref: 17 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.372947:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7961e00, rc 0) 00000100:00100000:2.0:1788876673.372983:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532310656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.372989:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876673.373024:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.373036:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.373044:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.373093:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.373115:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.373131:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310784 00000100:00100000:2.0:1788876673.373134:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310784 00000100:00100000:2.0:1788876673.373150:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876673.373155:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532310784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.373240:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532310784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.373246:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876673.373268:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b98240 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.373451:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.373477:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.373519:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.373539:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b98240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.373576:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532310912 00000100:00100000:0.0:1788876673.373580:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532310912 00000100:00100000:0.0:1788876673.373643:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788876673.373651:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532310912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.373727:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532310912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.373734:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788876673.373894:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532310912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876673.374534:0:45382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788876673.374579:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788876673.374620:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876673.374629:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.374637:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876673.374646:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876673.374649:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:2.0:1788876673.374652:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876673.374676:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.374684:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.374692:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876673.374707:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876673.374742:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876673.374764:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.374981:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311040 00000100:00100000:0.0:1788876673.374987:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311040 00000100:00100000:0.0:1788876673.375026:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788876673.375033:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532311040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.375042:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.375053:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe52600/0xf5bf0f7e313aebfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aebf4 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.375074:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe52600/0xf5bf0f7e313aebfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebf4 expref: 18 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.375084:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe52600/0xf5bf0f7e313aebfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aebf4 expref: 18 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.375091:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52600, rc 0) 00000100:00100000:0.0:1788876673.375127:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.375133:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788876673.375165:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.375176:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.375185:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876673.375228:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.375250:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876673.375268:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d29eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.375290:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311168 00000100:00100000:0.0:1788876673.375294:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311168 00000100:00100000:0.0:1788876673.375310:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876673.375315:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.375407:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.375413:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876673.375437:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.375460:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.375497:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876673.375509:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d29eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.375518:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311296 00000100:00100000:0.0:1788876673.375521:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311296 00000100:00100000:0.0:1788876673.375536:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788876673.375541:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.375635:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.375642:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788876673.375677:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876673.376949:0:45383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788876673.377110:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788876673.377130:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876673.377139:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.377150:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876673.377165:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788876673.377168:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 68 10000000:01000000:0.0:1788876673.377170:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876673.377197:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.377205:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.377213:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876673.377232:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.377467:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876673.377538:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838540 going to sleep for 11 seconds 00000100:00100000:2.0:1788876673.377574:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311424 00000100:00100000:2.0:1788876673.377750:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311424 00000100:00100000:2.0:1788876673.381269:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788876673.381295:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532311424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876673.381314:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876673.381335:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313aec09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec02 expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.381365:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313aec09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec02 expref: 19 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.381377:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313aec09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec02 expref: 19 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876673.381387:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960a00, rc 0) 00000100:00100000:2.0:1788876673.381478:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532311424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876673.381485:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788876673.381639:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.381659:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.381668:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.381739:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.381778:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.388828:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.391234:0:45287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311552 00000100:00100000:0.0:1788876673.391255:0:45287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311552 00000100:00100000:0.0:1788876673.391915:0:45287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788876673.391928:0:45287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532311552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788876673.391954:0:45287:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788876673.391977:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788876673.391981:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788876673.391984:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788876673.391987:0:45287:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788876673.391989:0:45287:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 71 00000100:00100000:0.0:1788876673.392153:0:45287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532311552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (10374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.392162:0:45287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788876673.392310:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788876673.392400:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788876673.392410:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392421:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.392432:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788876673.392435:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788876673.392438:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788876673.392469:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392477:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392487:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.392509:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.392544:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.392574:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.392596:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311680 00000100:00100000:3.0:1788876673.392624:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311680 00000100:00100000:3.0:1788876673.392649:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788876673.392657:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532311680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.392667:0:45283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.392684:0:45283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313aec17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec10 expref: -99 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392709:0:45283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313aec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec10 expref: 20 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392725:0:45283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313aec17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec10 expref: 20 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392733:0:45283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34e00, rc 0) 00000100:00100000:3.0:1788876673.392765:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532311680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.392771:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788876673.392800:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.392812:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.392820:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.392885:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.392910:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.392924:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.392935:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311808 00000100:00100000:3.0:1788876673.392939:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311808 00000100:00100000:3.0:1788876673.392955:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788876673.392961:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532311808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.393091:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532311808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.393098:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788876673.393126:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.393154:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.393196:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.393210:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.393221:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532311936 00000100:00100000:3.0:1788876673.393224:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532311936 00000100:00100000:3.0:1788876673.393239:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788876673.393245:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532311936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.401707:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532311936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8450us (8499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.401725:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788876673.401899:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532311936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788876673.419557:0:45384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788876673.419961:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788876673.419989:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788876673.420000:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420013:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.420022:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788876673.420026:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:3.0:1788876673.420029:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788876673.420068:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420075:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420085:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.420116:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.420187:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.420236:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.420300:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312064 00000100:00100000:0.0:1788876673.420306:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312064 00000100:00100000:0.0:1788876673.420357:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788876673.420367:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532312064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.420378:0:45284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.420390:0:45284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe53200/0xf5bf0f7e313aec25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec1e expref: -99 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420413:0:45284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe53200/0xf5bf0f7e313aec25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec1e expref: 21 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420424:0:45284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe53200/0xf5bf0f7e313aec25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec1e expref: 21 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420432:0:45284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53200, rc 0) 00000100:00100000:0.0:1788876673.420483:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532312064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.420490:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788876673.420577:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.420621:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420630:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.420647:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876673.420652:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420658:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.420664:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788876673.420666:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788876673.420668:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788876673.420684:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420690:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.420697:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.420714:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.420739:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.420762:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.420891:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312192 00000100:00100000:0.0:1788876673.420896:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312192 00000100:00100000:0.0:1788876673.420930:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788876673.420936:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532312192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.420944:0:45283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.420955:0:45283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe52a00/0xf5bf0f7e313aec33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec2c expref: -99 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420973:0:45283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe52a00/0xf5bf0f7e313aec33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec2c expref: 22 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420981:0:45283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe52a00/0xf5bf0f7e313aec33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec2c expref: 22 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.420987:0:45283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52a00, rc 0) 00000100:00100000:0.0:1788876673.421013:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532312192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.421019:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788876673.422920:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.422948:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.422960:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.422986:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788876673.422991:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.422999:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876673.423008:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788876673.423011:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:3.0:1788876673.423015:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876673.423047:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423054:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423063:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.423086:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.423144:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.423190:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.423210:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312320 00000100:00100000:3.0:1788876673.423216:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312320 00000100:00100000:3.0:1788876673.423272:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788876673.423281:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532312320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.423292:0:45282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876673.423306:0:45282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34200/0xf5bf0f7e313aec41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec3a expref: -99 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423325:0:45282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34200/0xf5bf0f7e313aec41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec3a expref: 23 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423335:0:45282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34200/0xf5bf0f7e313aec41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec3a expref: 23 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423342:0:45282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34200, rc 0) 00000100:00100000:3.0:1788876673.423380:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.423386:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788876673.423413:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876673.423422:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.423430:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876673.423481:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.423506:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876673.423518:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca040540 going to sleep for 11 seconds 00000100:00100000:3.0:1788876673.423533:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312448 00000100:00100000:3.0:1788876673.423536:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312448 00000100:00100000:3.0:1788876673.423550:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788876673.423556:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876673.424749:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1187us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876673.424758:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788876673.425934:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.426066:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.426150:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.426190:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.426241:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312576 00000100:00100000:0.0:1788876673.426249:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312576 00000100:00100000:0.0:1788876673.426305:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788876673.426314:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.426472:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.426480:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788876673.428426:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876673.440532:0:45385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788876673.443418:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788876673.443465:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788876673.443478:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.443492:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876673.446494:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788876673.446503:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:1.0:1788876673.446509:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788876673.446567:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.446586:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.446625:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.446659:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.446734:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.446777:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.446843:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312704 00000100:00100000:0.0:1788876673.446852:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312704 00000100:00100000:0.0:1788876673.446926:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788876673.446937:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532312704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876673.446955:0:45283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876673.446974:0:45283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13cfe53c00/0xf5bf0f7e313aec4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aec48 expref: -99 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.447001:0:45283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13cfe53c00/0xf5bf0f7e313aec4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec48 expref: 24 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.447013:0:45283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13cfe53c00/0xf5bf0f7e313aec4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aec48 expref: 24 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876673.447022:0:45283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53c00, rc 0) 00000100:00100000:0.0:1788876673.447076:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532312704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876673.447082:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788876673.448860:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876673.448898:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.448913:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876673.449004:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876673.449058:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876673.449106:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c351c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876673.449156:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312832 00000100:00100000:0.0:1788876673.449162:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312832 00000100:00100000:0.0:1788876673.449210:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788876673.449219:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532312832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876673.449328:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532312832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (269us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876673.449335:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788876673.449465:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532312832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788876673.449500:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788876673.449508:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876673.449515:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876673.906395:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876674.925174:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876675.947870:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876676.601018:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876676.601043:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532312960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876676.601114:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876676.601196:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532312960 00000100:00100000:0.0:1788876676.601204:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532312960 00000100:00100000:0.0:1788876676.601254:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1788876676.601264:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532312960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876676.601293:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876676.601347:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532312960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876676.601354:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:0.0:1788876676.601377:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876676.601406:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532312960:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788876676.615249:0:45560:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788876676.818538:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876676.818585:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876676.818637:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876676.818670:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876676.818864:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242112 00000100:00100000:2.0:1788876676.818877:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242112 00000100:00100000:2.0:1788876676.818943:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1590 00000100:00100000:2.0:1788876676.818954:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876676.819037:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876676.819045:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1590 00000100:00100000:2.0:1788876676.819070:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242368 00000100:00100000:2.0:1788876676.819074:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242368 00000100:00100000:2.0:1788876676.819099:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242240 00000100:00100000:2.0:1788876676.819102:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242240 00000100:00100000:2.0:1788876676.819122:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1172 00000100:00100000:2.0:1788876676.819128:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511242368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876676.819155:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511242368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876676.819161:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1172 00000100:00100000:2.0:1788876676.819172:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1173 00000100:00100000:2.0:1788876676.819178:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511242240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876676.819199:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511242240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876676.819206:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1173 00000100:00080000:2.0:1788876676.819224:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876676.819228:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876676.819230:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876676.819769:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511241984 00000100:00100000:0.0:1788876676.819777:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511241984 00000100:00100000:0.0:1788876676.819814:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1788876676.819821:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511241984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876676.819870:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511241984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 49us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876676.819877:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00010000:00010000:3.0:1788876676.969759:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876677.102004:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532313088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876677.102087:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.102156:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313088 00000100:00100000:1.0:1788876677.102165:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313088 00000100:00100000:2.0:1788876677.102245:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00080000:0.0:1788876677.102306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876677.102310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876677.102314:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876677.102320:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1659 00000100:00080000:0.0:1788876677.102324:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1788876677.102325:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532313216:0@lo:400:kworker.0 00000100:00080000:0.0:1788876677.102329:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876677.102348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa780700 x1875771532313344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876677.102358:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876677.102364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876677.102367:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876677.102369:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876677.102372:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1659 00000100:00080000:0.0:1788876677.102374:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876677.102377:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876677.102387:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa782d80 x1875771532313472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876677.102405:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313216 00000100:00100000:1.0:1788876677.102409:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313216 00000100:00080000:0.0:1788876677.102411:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876677.102414:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876677.102416:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876677.102419:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1659 00000100:00080000:0.0:1788876677.102421:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876677.102424:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876677.102433:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788876677.102434:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35f8000 x1875771532313728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876677.102439:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532313216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788876677.102449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876677.102452:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876677.102454:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876677.102456:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1659 00000100:00080000:0.0:1788876677.102459:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876677.102461:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876677.102470:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f35fb100 x1875771532313984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876677.102483:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532313216:12345-0@lo:400:kworker.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.102490:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788876677.102495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788876677.102498:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876677.102499:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876677.102502:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13f07ab000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876677.102511:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f45dad80 x1875771532314496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876677.102520:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532313600:0@lo:400:kworker.0 00000100:00100000:0.0:1788876677.102529:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532313344:0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.102545:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102552:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102569:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532313472:0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.102569:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532314368:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.102588:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102590:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102621:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532313728:0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.102625:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876677.102630:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532313856:0@lo:400:kworker.0 00000100:00100000:0.0:1788876677.102643:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102662:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532313984:0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.102663:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313472 00000100:00100000:1.0:1788876677.102667:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313472 00000100:00100000:0.0:1788876677.102683:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.102697:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532314496:0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.102698:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313728 00000100:00100000:1.0:1788876677.102700:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313728 00000100:00100000:0.0:1788876677.102715:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.102715:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313984 00000100:00100000:1.0:1788876677.102718:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313984 00000100:00100000:1.0:1788876677.102726:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314496 00000100:00100000:1.0:1788876677.102729:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314496 00000100:00100000:1.0:1788876677.102738:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1788876677.102742:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532313472:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876677.102762:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1664 last 0 00000100:00100000:2.0:1788876677.102773:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532313088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876677.102796:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000020:00000080:1.0:1788876677.102798:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313aec56 00000004:00100000:1.0:1788876677.102811:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788876677.102829:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532313088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 577us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.102835:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1788876677.102860:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313344 00000100:00100000:2.0:1788876677.102863:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313344 00000100:00100000:2.0:1788876677.102879:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1788876677.102883:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532313344:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788876677.102896:0:6544:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a13d15b8800, cookie 0xf5bf0f7e313aeab9 00010000:00080000:2.0:1788876677.102900:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a13d15b8800 cur 1664 last 1788876671 00000004:00100000:2.0:1788876677.102910:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876677.102932:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7bf000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788876677.102957:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876677.102974:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532313344:12345-0@lo:38:kworker.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.102981:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1788876677.102982:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532313472:12345-0@lo:38:kworker.0 Request processed in 239us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.103288:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313600 00000100:00100000:2.0:1788876677.103295:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313600 00000100:00100000:2.0:1788876677.103330:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314368 00000100:00100000:2.0:1788876677.103334:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314368 00000100:00100000:2.0:1788876677.103354:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1788876677.103361:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532313600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876677.103400:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532313600:12345-0@lo:400:kworker.0 Request processed in 40us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.103406:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1788876677.103417:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1788876677.103423:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532314368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876677.103459:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532314368:12345-0@lo:400:kworker.0 Request processed in 34us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.103473:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1788876677.103550:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:0.0:1788876677.103559:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532313728:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788876677.103568:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1788876677.103584:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:1.0:1788876677.103589:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532313984:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876677.103626:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1664 last 0 00000020:00000080:1.0:1788876677.103650:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313aec5d 00000004:00100000:1.0:1788876677.103658:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876677.103674:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13f07aa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876677.103716:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532313984:12345-0@lo:38:kworker.0 Request processed in 125us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.103723:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:1.0:1788876677.103736:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:1.0:1788876677.103740:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532314496:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876677.103752:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1664 last 0 00000020:00000080:1.0:1788876677.103775:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313aec64 00000004:00100000:1.0:1788876677.103782:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876677.103794:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13c72a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876677.103818:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532314496:12345-0@lo:38:kworker.0 Request processed in 77us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.103824:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:1.0:1788876677.103862:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532314240:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.103901:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.103934:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532313216:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.103951:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876677.103958:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532314112:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.103979:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.104000:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.104023:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532313600:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.104034:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532314368:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.104054:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314112 00000100:00100000:1.0:1788876677.104058:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314112 00000100:00100000:1.0:1788876677.104076:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532313856 00000100:00100000:1.0:1788876677.104079:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532313856 00000100:00100000:1.0:1788876677.104091:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1788876677.104097:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532314112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.104129:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532314112:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.104136:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1788876677.104147:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788876677.104153:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532313856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.104181:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532313856:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.104187:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788876677.104209:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532313856:0@lo:400:kworker.0 00000100:00100000:1.0:1788876677.104231:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532314112:0@lo:400:kworker.0 00010000:00080000:0.0:1788876677.105866:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1665 last 0 00000020:00000080:0.0:1788876677.105909:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313aec6b 00000004:00100000:0.0:1788876677.105924:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788876677.105955:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a13d060f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876677.106023:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532313728:12345-0@lo:38:kworker.0 Request processed in 2463us (3378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876677.106033:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00010000:00080000:3.0:1788876677.106139:0:45309:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788876677.106145:0:45309:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 68719477398 00000020:00080000:3.0:1788876677.106150:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.106154:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 68719477398, next_transno: 68719477398 00010000:00080000:3.0:1788876677.106158:0:45309:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (68719477398) 00000020:00080000:3.0:1788876677.106161:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.106172:0:45309:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511234048 t68719477398 from 192.168.203.11@tcp req@ffff8a13fad3b480 x1875771511234048/t0(68719477398) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:69/0 lens 528/0 e 0 to 0 dl 1788876684 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876677.106286:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532313088:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788876677.106323:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 17 00000100:00080000:3.0:1788876677.106333:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788876677.106338:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788876677.106341:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1788876677.106344:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788876677.106347:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:0.0:1788876677.107264:0:45309:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1043us 00000001:00100000:0.0:1788876677.110476:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788876677.110892:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:2.0:1788876677.117177:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876677.117188:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876677.117191:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876677.117214:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314240 00000100:00100000:2.0:1788876677.117224:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314240 00000100:00100000:2.0:1788876677.117302:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1788876677.117312:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532314240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876677.117409:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532314240:12345-0@lo:400:kworker.0 Request processed in 99us (13506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.117417:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1788876677.117634:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532314240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876677.117716:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532313344:0@lo:38:kworker.0 00010000:00080000:2.0:1788876677.117735:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13fa782d80 x1875771532313472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.117751:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 17 00010000:00080000:1.0:1788876677.117779:0:45583:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788876677.117783:0:45583:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788876677.117789:0:45583:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788876677.118629:0:45583:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1788876677.118885:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a13fa782d80 x1875771532313472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.118894:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788876677.118899:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788876677.118902:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788876677.118906:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532313472:0@lo:38:kworker.0 00010000:00080000:2.0:1788876677.118928:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13f35f8000 x1875771532313728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.118944:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 17 00000100:00080000:2.0:1788876677.119773:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13f35f8000 x1875771532313728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.119782:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788876677.119786:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788876677.119789:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788876677.119793:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532313728:0@lo:38:kworker.0 00010000:00080000:2.0:1788876677.119816:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13f35fb100 x1875771532313984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.119827:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 17 00000100:00080000:2.0:1788876677.120588:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13f35fb100 x1875771532313984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876702 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.120596:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788876677.120622:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788876677.120626:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788876677.120631:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532313984:0@lo:38:kworker.0 00010000:00080000:2.0:1788876677.120657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13f45dad80 x1875771532314496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788876677.120667:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 17 00000100:00080000:2.0:1788876677.120673:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788876677.120676:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788876677.120679:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788876677.120682:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532314496:0@lo:38:kworker.0 00000100:00100000:2.0:1788876677.120721:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532314624:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788876677.120779:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.120865:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314624 00000100:00100000:1.0:1788876677.120871:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314624 00000100:00100000:1.0:1788876677.120979:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1788876677.120986:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532314624:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788876677.121003:0:6544:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13fad3a680 x1875771532314624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788876688 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876677.121013:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532314624:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 28us (235us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876677.121019:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:0.0:1788876677.121044:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788876677.137190:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788876677.158217:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.158241:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.158258:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.158271:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.158279:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.158286:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159891:0:45309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159906:0:45309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159914:0:45309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159924:0:45309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876677.159929:0:45309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159937:0:45309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159953:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83a00) 00010000:00010000:0.0:1788876677.159956:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876677.159960:0:45309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159966:0:45309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aec72 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876677.159986:0:45309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ded6af27 reply state 00000000019a4d86 transno 68719477398 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.159997:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876677.160004:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83800) 00010000:00010000:0.0:1788876677.160006:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876677.160009:0:45309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788876677.160128:0:45309:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788876677.160149:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876677.160152:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477399 00000020:00080000:0.0:1788876677.160157:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876677.160159:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477399 00000100:00100000:2.0:1788876677.167114:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.167780:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511234560 00000100:00100000:1.0:1788876677.167792:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511234560 00000100:00100000:1.0:1788876677.167866:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2447 00000100:00100000:1.0:1788876677.167876:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511234560:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:1.0:1788876677.167895:0:8722:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 68719477399, current: 68719477399, replaying 00000100:00100000:1.0:1788876677.167917:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511234560:12345-192.168.203.11@tcp:36:rm.0 Request processed in 43us (811us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876677.167923:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2447 00000020:00080000:3.0:1788876677.167978:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.167982:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 68719477399, next_transno: 68719477399 00010000:00080000:3.0:1788876677.167986:0:45309:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (68719477399) 00000020:00080000:3.0:1788876677.167989:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.167999:0:45309:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511234560 t68719477399 from 192.168.203.11@tcp req@ffff8a13fad39c00 x1875771511234560/t0(68719477399) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:73/0 lens 512/0 e 0 to 0 dl 1788876688 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788876677.168088:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168103:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168115:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168127:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168139:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168145:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168243:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168253:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.168260:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788876677.173478:0:45277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477398 is committed 00010000:00010000:1.0:1788876677.173551:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173834:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173855:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173861:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876677.173867:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173876:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173896:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83800) 00010000:00010000:1.0:1788876677.173900:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876677.173904:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.173911:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aec79 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177512:0:45309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177529:0:45309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177537:0:45309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177543:0:45309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876677.177546:0:45309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177555:0:45309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177570:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x108:0x0].0x0 (ffff8a13fae0b500) 00010000:00010000:3.0:1788876677.177573:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876677.177578:0:45309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177585:0:45309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313aec8e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x108:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177633:0:45309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177641:0:45309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177647:0:45309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177652:0:45309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876677.177654:0:45309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177660:0:45309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177667:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b400) 00010000:00010000:3.0:1788876677.177670:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876677.177672:0:45309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177677:0:45309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313aec80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876677.177689:0:45309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011944ba7 reply state 00000000d3a21372 transno 68719477399 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177704:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.177711:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83800) 00010000:00010000:3.0:1788876677.177713:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876677.177716:0:45309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788876677.177878:0:45309:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788876677.177901:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.177905:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477400 00000020:00080000:3.0:1788876677.177909:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876677.177911:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477400 00000100:00100000:2.0:1788876677.180000:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876677.180830:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511235712 00000100:00100000:0.0:1788876677.180840:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511235712 00000100:00100000:0.0:1788876677.180913:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2448 00000100:00100000:0.0:1788876677.180925:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511235712:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:0.0:1788876677.180943:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 68719477400, current: 68719477400, replaying 00000100:00100000:0.0:1788876677.180967:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511235712:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 45us (976us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788876677.180973:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2448 00000020:00080000:1.0:1788876677.182715:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.182723:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 68719477400, next_transno: 68719477400 00010000:00080000:1.0:1788876677.182729:0:45309:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (68719477400) 00000020:00080000:1.0:1788876677.182732:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.182744:0:45309:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511235712 t68719477400 from 192.168.203.11@tcp req@ffff8a13fad3a300 x1875771511235712/t0(68719477400) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:73/0 lens 520/0 e 0 to 0 dl 1788876688 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788876677.182990:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183005:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183018:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183030:0:45309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183042:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183048:0:45309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183367:0:45309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183375:0:45309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183383:0:45309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183389:0:45309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876677.183393:0:45309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183401:0:45309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183414:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13c4c77500) 00010000:00010000:1.0:1788876677.183417:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876677.183422:0:45309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183428:0:45309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313aec95 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876677.183445:0:45309:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e4558b5 reply state 0000000059c23222 transno 68719477400 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183457:0:45309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.183464:0:45309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x1a603d0b (ffff8a13c4c77f00) 00010000:00010000:1.0:1788876677.183466:0:45309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876677.183469:0:45309:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788876677.183564:0:45309:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788876677.183581:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.183584:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477401 00000020:00080000:1.0:1788876677.183588:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.183590:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 68719477401 00000100:00100000:3.0:1788876677.191334:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.191443:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242496 00000100:00100000:1.0:1788876677.191454:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242496 00000100:00100000:1.0:1788876677.191513:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1593 00000100:00100000:1.0:1788876677.191522:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511242496:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788876677.191565:0:15659:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13cfcc4380 x1875771511242496/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:73/0 lens 224/0 e 0 to 0 dl 1788876688 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876677.191583:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511242496:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 63us (261us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876677.191590:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1593 00000020:00080000:1.0:1788876677.191827:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.191832:0:45309:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 68719477401 00010000:00080000:1.0:1788876677.191836:0:45309:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1788876677.191838:0:45309:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876677.191856:0:45309:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1788876677.191858:0:45309:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1788876677.191961:0:45309:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 17, last_transno is 73014444032 00000001:00100000:1.0:1788876677.195064:0:45277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:1.0:1788876677.195075:0:45277:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1788876677.195099:0:45277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719477400 is committed 00010000:00010000:3.0:1788876677.195214:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195228:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195237:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195243:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876677.195248:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195255:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195272:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195280:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313aec87 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195305:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195312:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195318:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195323:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876677.195325:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195332:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195340:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.195346:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487000/0xf5bf0f7e313aec9c lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 45309 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788876677.200462:0:45309:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788876677.200533:0:45309:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788876677.200551:0:45309:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a13fad3a680 x1875771532314624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:73/0 lens 224/0 e 0 to 0 dl 1788876688 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788876677.200751:0:45309:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13cfcc4380 x1875771511242496/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:73/0 lens 224/0 e 0 to 0 dl 1788876688 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788876677.200822:0:45309:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788876677.201879:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788876677.201892:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a12c606c700 x1875771532314624/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876693 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876677.201902:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a12c606c700 x1875771532314624/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876693 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876677.201914:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876677.201930:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788876677.201937:0:3661:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001b21984a): req@ffff8a13eb298000 x1875771532292992/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876660 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876677.201958:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532314624:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1788876677.202338:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.202380:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876677.202390:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532314752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876677.202416:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876677.202454:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532292992 00000100:00100000:1.0:1788876677.202461:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532292992 00000100:00100000:1.0:1788876677.202502:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314752 00000100:00100000:1.0:1788876677.202505:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314752 00000100:00100000:1.0:1788876677.202517:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1788876677.202524:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532292992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876677.202556:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876677.202592:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532292992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.202652:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1788876677.202670:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1788876677.202676:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532314752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876677.202790:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876677.202816:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532314752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.202822:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1788876677.202866:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532314752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876677.202874:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532292992:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1788876677.219729:0:45309:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620886e3e10 00100000:10000000:2.0:1788876677.219744:0:45309:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1788876677.220868:0:45295:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:3.0:1788876677.220931:0:45295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45295:1875771532314880:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788876677.221012:0:45295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876677.221050:0:45295:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c66cd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876677.221074:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532314880 00000100:00100000:3.0:1788876677.221083:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532314880 00000100:00100000:3.0:1788876677.221137:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1788876677.221148:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:45295:x1875771532314880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788876677.221179:0:43961:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -50 00002000:02000040:3.0:1788876677.221184:0:43961:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:609) 00000004:00080000:0.0:1788876677.221298:0:45297:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:0.0:1788876677.221321:0:45297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45297:1875771532315008:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788876677.221354:0:45297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.221371:0:45297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876677.223696:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315008 00000100:00100000:2.0:1788876677.223710:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315008 00000100:00100000:2.0:1788876677.223816:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1788876677.223827:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:45297:x1875771532315008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788876677.223869:0:43964:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 609 -> diff = -50 00002000:02000040:2.0:1788876677.223874:0:43964:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:609) 00002000:00010000:3.0:1788876677.234492:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.234508:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.234526:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.234530:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.234537:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.234553:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.234576:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.234584:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.234621:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876677.235810:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876677.235820:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.235832:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.235838:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.235859:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.235881:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.235890:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313aeca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.235914:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.235916:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.235918:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876677.236907:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.236916:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.236932:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.236936:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.236941:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.236956:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.236966:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.236974:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.236998:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876677.237060:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.237066:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237074:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.237077:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.237081:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237089:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237096:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237103:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237118:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788876677.237130:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876677.237134:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237142:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.237146:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237156:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237170:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237178:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313aecaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237195:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876677.237198:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237204:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.237207:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237215:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237224:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237231:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313aecb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237242:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.237243:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.237245:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876677.237296:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.237302:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237310:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.237313:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.237317:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237327:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237334:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237340:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237354:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876677.237388:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.237394:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237408:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.237411:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.237415:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237425:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237433:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237440:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237451:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788876677.237458:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876677.237461:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237468:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.237471:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237479:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237494:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237501:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313aecb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237513:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876677.237516:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237522:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.237526:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237533:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237543:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237551:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000407ca9/0xf5bf0f7e313aecbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237562:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.237564:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.237566:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876677.237633:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.237639:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237647:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.237651:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.237655:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237665:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.237673:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.240176:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.240187:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.240494:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.240532:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876677.240658:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.240666:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.240678:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.241660:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.241672:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241812:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241823:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241830:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241859:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788876677.241939:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.241945:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241953:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.241957:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.241961:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241970:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241978:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.241991:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242003:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788876677.242040:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242046:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242053:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242056:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242060:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242068:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242076:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242084:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242091:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788876677.242126:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242130:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242138:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242141:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242144:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242153:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242161:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242168:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242176:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788876677.242208:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242212:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242219:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242222:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242226:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242235:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242248:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242256:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242264:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788876677.242295:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242300:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242306:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242309:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242313:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242321:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242329:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242337:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242351:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788876677.242383:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242388:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242395:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242398:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242402:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242409:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242418:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242426:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242434:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788876677.242465:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242470:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242477:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.242480:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.242484:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242492:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242500:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242507:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.242514:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788876677.242545:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.242549:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243739:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788876677.243748:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243759:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.243764:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243775:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243794:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243802:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000868cb521/0xf5bf0f7e313aecc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243822:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788876677.243826:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243832:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.243836:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243854:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243865:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243872:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009426f730/0xf5bf0f7e313aeccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243886:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788876677.243890:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243896:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.243899:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243907:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243917:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243924:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313aecd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243937:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788876677.243940:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243947:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.243950:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243963:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243972:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243979:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313aecdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.243991:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788876677.243995:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244002:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.244005:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244013:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244023:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244031:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313aece2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244047:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788876677.244051:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244057:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.244060:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244066:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244076:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244083:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313aece9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244093:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876677.244096:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244103:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.244106:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244119:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244128:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244135:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313aecf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244145:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876677.244148:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244155:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.244158:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244166:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244175:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244182:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313aecf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244198:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876677.244202:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244209:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.244212:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244220:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244229:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244236:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313aecfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.244245:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.244247:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.244249:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.249316:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249321:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249329:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249347:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249359:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249368:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249399:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876677.249514:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.249520:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249529:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249532:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249537:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249546:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249555:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249575:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249584:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788876677.249639:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.249645:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249654:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249657:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249661:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249670:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249678:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249697:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249706:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788876677.249739:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.249744:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249753:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249756:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249760:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249769:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249783:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249790:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249798:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788876677.249831:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.249836:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249856:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249859:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249863:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249873:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249881:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249888:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249902:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788876677.249937:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.249942:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249950:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.249953:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.249957:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249965:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249973:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249980:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.249987:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788876677.250023:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250028:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250035:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250039:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250043:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250050:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250057:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250064:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250072:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788876677.250104:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250109:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250117:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250119:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250123:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250132:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250139:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250147:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250155:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788876677.250189:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250194:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250201:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250204:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250208:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250217:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250225:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250233:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250241:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788876677.250275:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250280:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250289:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250292:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250296:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250305:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250313:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250320:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250328:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788876677.250361:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250366:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250373:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250376:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250380:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250388:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250400:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250407:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250414:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788876677.250447:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250451:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250459:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250462:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250466:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250474:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250482:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250489:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250504:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788876677.250534:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250539:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250547:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250550:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250554:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250562:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250569:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250576:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250584:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788876677.250640:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250645:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250653:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250657:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250660:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250668:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250675:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250682:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250690:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788876677.250726:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250731:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250739:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250742:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250745:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250754:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250762:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250770:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250779:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788876677.250900:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250905:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250913:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x244:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.250915:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.250919:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250927:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250935:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250942:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250950:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788876677.250986:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.250991:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.250998:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.251001:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.251005:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251013:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251021:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251028:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251044:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788876677.251079:0:43961:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876677.251084:0:43961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251091:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x242:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:3.0:1788876677.251093:0:43961:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876677.251096:0:43961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251103:0:43961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251114:0:43961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251119:0:43961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.251127:0:43961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00080000:3.0:1788876677.251305:0:43961:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:3.0:1788876677.251405:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:45295:x1875771532314880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30255us (30389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876677.251414:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1788876677.251582:0:45295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45295:1875771532314880:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876677.251620:0:45295:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x261:0x0] from OST, last_created [0x280000401:0x261:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:0.0:1788876677.251688:0:45295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45295:1875771532315264:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788876677.251723:0:45295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.251744:0:45295:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788876677.251861:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532315136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876677.251891:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876677.251932:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315264 00000100:00100000:3.0:1788876677.251938:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315264 00000100:00100000:3.0:1788876677.251971:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1788876677.251979:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:45295:x1875771532315264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788876677.252012:0:43952:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 610 00000100:00100000:0.0:1788876677.253674:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315136 00000100:00100000:0.0:1788876677.253682:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315136 00000100:00100000:0.0:1788876677.253723:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1788876677.253731:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532315136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876677.253749:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876677.253798:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875771532315136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876677.253804:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1788876677.253932:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:45295:x1875771532315264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1952us (2207us total) trans 8589934857 rc 0/0 00000100:00100000:3.0:1788876677.253940:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1788876677.254025:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532315136:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788876677.255133:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x261:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255146:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255162:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x261:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255167:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x261:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255174:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255191:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255202:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255210:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255223:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1788876677.255322:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x260:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255327:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255335:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x260:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255338:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x260:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255341:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255350:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255358:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255366:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255375:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1788876677.255413:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255418:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255426:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25f:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255429:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255433:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255441:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255447:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255455:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255462:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1788876677.255497:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255502:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255511:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25e:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255514:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255518:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255527:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255535:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255542:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255550:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1788876677.255585:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255590:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255599:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25d:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255628:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255632:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255641:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255655:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255662:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255671:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1788876677.255710:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255715:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255723:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25c:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255726:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255729:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255738:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255746:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255754:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255767:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1788876677.255803:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255808:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255815:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25b:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255818:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255821:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255829:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255837:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255855:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255864:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1788876677.255902:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255907:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255914:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25a:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.255917:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.255922:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255930:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255938:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255945:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255953:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1788876677.255988:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x259:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.255992:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.255999:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x259:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256002:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x259:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256006:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256014:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256021:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256027:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256035:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1788876677.256068:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x258:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256073:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256081:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x258:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256084:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x258:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256087:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256096:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256104:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256111:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256120:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:2.0:1788876677.256151:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x257:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256156:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256164:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x257:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256167:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x257:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256172:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256181:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256188:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256196:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256203:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:2.0:1788876677.256235:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x256:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256240:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256247:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x256:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256250:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x256:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256254:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256263:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256276:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256283:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256291:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:2.0:1788876677.256323:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x255:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256328:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256335:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x255:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256338:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x255:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256341:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256349:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256357:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256364:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256378:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00010000:2.0:1788876677.256412:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x254:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256417:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256425:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x254:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256441:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x254:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256445:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256454:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256462:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256469:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256478:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00002000:00010000:2.0:1788876677.256509:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x253:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256515:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256523:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x253:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256527:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x253:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256531:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256540:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256548:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256555:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256564:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/33 locks to regular blp list, 33 blwis in pool 00002000:00010000:2.0:1788876677.256596:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256625:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256633:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x252:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256637:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x252:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256641:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256650:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256658:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256667:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256676:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/34 locks to regular blp list, 34 blwis in pool 00002000:00010000:2.0:1788876677.256711:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256716:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256723:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x251:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256726:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x251:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256729:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256737:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256745:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256752:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256761:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/35 locks to regular blp list, 35 blwis in pool 00002000:00010000:2.0:1788876677.256800:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256805:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256812:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x250:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256815:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x250:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256819:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256828:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256836:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256854:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256863:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/36 locks to regular blp list, 36 blwis in pool 00002000:00010000:2.0:1788876677.256899:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256904:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256911:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24f:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.256914:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.256918:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256927:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256940:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256946:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.256954:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/37 locks to regular blp list, 37 blwis in pool 00002000:00010000:2.0:1788876677.256989:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.256994:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257001:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24e:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257004:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257007:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257015:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257022:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257029:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257043:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/38 locks to regular blp list, 38 blwis in pool 00002000:00010000:2.0:1788876677.257076:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257081:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257090:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24d:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257093:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257097:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257105:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257112:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257119:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257126:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/39 locks to regular blp list, 39 blwis in pool 00002000:00010000:2.0:1788876677.257161:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257165:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257172:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24c:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257175:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257178:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257187:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257194:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257201:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257209:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/40 locks to regular blp list, 40 blwis in pool 00002000:00010000:2.0:1788876677.257241:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257246:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257254:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24b:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257257:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257262:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257270:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257279:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257287:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257296:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/41 locks to regular blp list, 41 blwis in pool 00002000:00010000:2.0:1788876677.257329:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257335:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257343:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24a:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257346:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257350:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257360:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257368:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257376:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257385:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/42 locks to regular blp list, 42 blwis in pool 00002000:00010000:2.0:1788876677.257417:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257422:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257430:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x249:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257433:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x249:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257436:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257445:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257452:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257458:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257467:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/43 locks to regular blp list, 43 blwis in pool 00002000:00010000:2.0:1788876677.257501:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257505:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257512:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x248:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257515:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x248:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257519:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257528:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257541:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257548:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257555:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/44 locks to regular blp list, 44 blwis in pool 00002000:00010000:2.0:1788876677.257588:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257593:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257624:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x247:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257627:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x247:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257631:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257640:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257649:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257655:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257668:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/45 locks to regular blp list, 45 blwis in pool 00002000:00010000:2.0:1788876677.257706:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257710:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257718:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x246:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257721:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x246:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257724:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257732:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257740:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257747:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257756:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/46 locks to regular blp list, 46 blwis in pool 00002000:00010000:2.0:1788876677.257792:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.257797:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257805:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x245:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.257808:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x245:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.257812:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257821:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257829:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.257837:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258311:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 45 total in blp. (45 blwis in pool) 00010000:00010000:1.0:1788876677.258322:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258330:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258335:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258344:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258362:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258370:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313aed05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258393:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 44 total in blp. (44 blwis in pool) 00010000:00010000:1.0:1788876677.258398:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258405:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258408:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258416:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258426:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258434:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313aed0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258446:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 43 total in blp. (43 blwis in pool) 00010000:00010000:1.0:1788876677.258450:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258456:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258460:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258467:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258476:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258482:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313aed13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258494:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 42 total in blp. (42 blwis in pool) 00010000:00010000:1.0:1788876677.258498:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258505:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258508:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258522:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258531:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258538:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033c3aad6/0xf5bf0f7e313aed1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258551:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 41 total in blp. (41 blwis in pool) 00010000:00010000:1.0:1788876677.258739:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258747:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258750:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258758:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258768:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258775:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b59a57f/0xf5bf0f7e313aed21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258795:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 40 total in blp. (40 blwis in pool) 00010000:00010000:1.0:1788876677.258798:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258804:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258807:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258814:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258823:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258830:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313aed28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258853:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 39 total in blp. (39 blwis in pool) 00010000:00010000:1.0:1788876677.258857:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258864:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258868:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258879:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258889:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258895:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313aed2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258907:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 38 total in blp. (38 blwis in pool) 00010000:00010000:1.0:1788876677.258911:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258917:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258920:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258928:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258937:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258945:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd98264b/0xf5bf0f7e313aed36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258961:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 37 total in blp. (37 blwis in pool) 00010000:00010000:1.0:1788876677.258965:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258972:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.258975:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258983:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258992:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.258999:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857bf5f3/0xf5bf0f7e313aed3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259012:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 36 total in blp. (36 blwis in pool) 00010000:00010000:1.0:1788876677.259015:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259021:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259024:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259035:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259044:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259051:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025346c8b/0xf5bf0f7e313aed44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259062:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 35 total in blp. (35 blwis in pool) 00010000:00010000:1.0:1788876677.259065:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259072:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259075:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259083:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259093:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259101:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313aed4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259119:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 34 total in blp. (34 blwis in pool) 00010000:00010000:1.0:1788876677.259123:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259129:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259132:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259140:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259149:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259156:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313aed52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259167:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 33 total in blp. (33 blwis in pool) 00010000:00010000:1.0:1788876677.259171:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259177:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259181:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259194:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259202:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259210:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030540fb2/0xf5bf0f7e313aed59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259221:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 32 total in blp. (32 blwis in pool) 00010000:00010000:1.0:1788876677.259225:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259230:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259234:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259241:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259251:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259258:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008628c897/0xf5bf0f7e313aed60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259274:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:1.0:1788876677.259279:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259285:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259288:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259295:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259306:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259313:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b00b61be/0xf5bf0f7e313aed67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259327:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:1.0:1788876677.259331:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259339:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259342:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259356:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259365:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259374:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c409b4e9/0xf5bf0f7e313aed6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259385:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:1.0:1788876677.259389:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259396:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259399:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259407:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259416:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259424:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1c7a749/0xf5bf0f7e313aed75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259442:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:1.0:1788876677.259446:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259452:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259455:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259463:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259473:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259481:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313aed7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259492:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:1.0:1788876677.259497:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259503:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.259506:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259520:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259531:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259538:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313aed83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x261:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.259552:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:3.0:1788876677.259698:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:3.0:1788876677.259705:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259714:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259716:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259724:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259736:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259743:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313aed91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259759:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:3.0:1788876677.259762:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259767:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259771:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259777:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259786:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259794:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313aed98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259805:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:3.0:1788876677.259808:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259813:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259816:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259824:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259833:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259840:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313aed9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259859:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:3.0:1788876677.259862:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259868:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259871:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259878:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259887:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259894:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313aeda6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259909:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:3.0:1788876677.259912:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259918:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259921:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259928:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259937:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259943:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313aedad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259956:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:3.0:1788876677.259960:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259967:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cba00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.259970:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259978:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259987:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.259993:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313aedb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260005:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:3.0:1788876677.260009:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260015:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260018:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260030:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260039:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260048:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313aedbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x259:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260059:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1788876677.260062:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260067:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260070:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260077:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260086:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260093:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313aedc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x258:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260110:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:3.0:1788876677.260113:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260120:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260124:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260132:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260140:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260148:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b74f532a/0xf5bf0f7e313aedc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x257:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260160:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1788876677.260163:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260170:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cac00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260173:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260185:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260194:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260201:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cf514d/0xf5bf0f7e313aedd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x256:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260213:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1788876677.260216:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260222:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260225:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260234:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260244:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260251:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf5a8bdc/0xf5bf0f7e313aedd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x255:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260268:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1788876677.260272:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260279:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbe00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260282:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260290:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260301:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260308:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee34907/0xf5bf0f7e313aedde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x254:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260320:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1788876677.260323:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260330:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cae00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260334:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260347:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260356:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260364:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6b792b7/0xf5bf0f7e313aede5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x253:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260376:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1788876677.260380:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260387:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260390:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260398:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260407:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260414:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000024a6cd3/0xf5bf0f7e313aedec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260431:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1788876677.260434:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260441:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1caa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260444:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260451:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260461:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260468:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aabb0712/0xf5bf0f7e313aedf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260480:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1788876677.260483:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260490:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260493:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260505:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260515:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260523:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313aedfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260534:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788876677.260538:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260544:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260547:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260571:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260581:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260589:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313aee01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260632:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788876677.260637:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260644:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260648:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260656:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260666:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260674:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004587c1d8/0xf5bf0f7e313aee08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260687:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788876677.260690:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260697:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260700:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260711:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260719:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260726:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313aee0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260738:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788876677.260741:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260747:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260750:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260757:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260767:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260773:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313aee16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260788:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788876677.260791:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260797:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260800:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260806:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260814:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260821:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313aee1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260832:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788876677.260836:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260851:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260855:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260867:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260877:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260884:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313aee24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260896:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876677.260900:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260906:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260909:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260918:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260927:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260935:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbaea817/0xf5bf0f7e313aee2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260952:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876677.260955:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260961:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.260964:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260971:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260980:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260988:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eccb19c/0xf5bf0f7e313aee32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.260999:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876677.261003:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261009:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.261013:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261025:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261035:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261042:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed62efc9/0xf5bf0f7e313aee39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261056:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876677.261060:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261067:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876677.261070:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261079:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261089:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261097:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c724278e/0xf5bf0f7e313aee40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876677.261112:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.261114:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.261116:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876677.261129:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.261297:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.261305:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876677.261309:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.261317:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.261329:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.261336:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313aed8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x260:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876677.261354:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.261356:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876677.261358:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876677.261502:0:45295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:45295:1875771532315264:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876677.261521:0:45295:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x261:0x0]-[0x280000401:0x281:0x0] 00010000:00010000:2.0:1788876677.264020:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876677.264143:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.264151:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264166:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x244:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.264170:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x244:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.264177:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264190:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264200:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264209:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264224:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876677.264232:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876677.264237:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264245:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876677.264249:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264259:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264275:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264282:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000375d75ce/0xf5bf0f7e313aee47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264298:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876677.264301:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264313:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876677.264316:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264324:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264333:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264340:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000308b3909/0xf5bf0f7e313aee4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264351:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.264352:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.264354:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876677.264392:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.264398:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264406:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x243:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.264409:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.264414:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264423:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264431:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264439:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264453:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876677.264460:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876677.264464:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264471:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876677.264474:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264481:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264491:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264498:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e36ff7/0xf5bf0f7e313aee55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.264511:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.264513:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.264515:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876677.264649:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876677.265665:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876677.265676:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265688:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x242:0x0].0x0 since=1665s v=(0 0) 00010000:00010000:2.0:1788876677.265692:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876677.265698:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265711:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265721:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265728:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265746:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876677.265756:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876677.265761:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265767:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876677.265771:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265784:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265798:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265806:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313aee5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876677.265822:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.265823:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876677.265825:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788876677.266021:0:43964:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00000100:00100000:2.0:1788876677.266107:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:45297:x1875771532315008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42279us (44748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876677.266117:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1788876677.267818:0:45297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45297:1875771532315008:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788876677.267837:0:45297:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x261:0x0] from OST, last_created [0x2c0000401:0x261:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:2.0:1788876677.267932:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532315392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876677.267981:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876677.268051:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315392 00000100:00100000:3.0:1788876677.268057:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315392 00000100:00100000:3.0:1788876677.268101:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1788876677.268110:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532315392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876677.268132:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904960 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876677.268204:0:45297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45297:1875771532315520:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788876677.268231:0:45297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876677.268249:0:45297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876677.268265:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315520 00000100:00100000:0.0:1788876677.268269:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315520 00000100:00100000:0.0:1788876677.268296:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1788876677.268302:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:45297:x1875771532315520:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788876677.268332:0:8456:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 610 00000100:00100000:0.0:1788876677.270000:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:45297:x1875771532315520:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1689us (1759us total) trans 4294967565 rc 0/0 00000100:00100000:0.0:1788876677.270012:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1788876677.270084:0:45297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:45297:1875771532315520:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788876677.270101:0:45297:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x261:0x0]-[0x2c0000401:0x281:0x0] 00000100:00100000:3.0:1788876677.273705:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532315392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5587us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876677.273720:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1788876677.273950:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532315392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876677.608933:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532315648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876677.609004:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876677.609806:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315648 00000100:00100000:3.0:1788876677.609818:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315648 00000100:00100000:3.0:1788876677.609888:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1788876677.609898:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532315648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876677.609921:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876677.615325:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532315648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5417us (6310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876677.615340:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1788876677.618085:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532315648:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788876677.708479:0:45615:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876677.708980:0:45615:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788876677.806235:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.806309:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.806378:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.806437:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.806491:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876677.806574:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243008 00000100:00100000:1.0:1788876677.806594:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243008 00000100:00100000:1.0:1788876677.806669:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243136 00000100:00100000:1.0:1788876677.806673:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243136 00000100:00100000:1.0:1788876677.806708:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1177 00000100:00100000:1.0:1788876677.806717:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511243008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876677.806789:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511243008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.806796:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1177 00000100:00100000:1.0:1788876677.806812:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1178 00000100:00100000:1.0:1788876677.806819:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511243136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876677.806853:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511243136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.806863:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1178 00000100:00100000:1.0:1788876677.806883:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242752 00000100:00100000:1.0:1788876677.806886:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242752 00000100:00100000:1.0:1788876677.806909:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242880 00000100:00100000:1.0:1788876677.806918:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242880 00000100:00100000:1.0:1788876677.806941:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1594 00000100:00100000:1.0:1788876677.806948:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876677.806976:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.806981:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1594 00000100:00100000:1.0:1788876677.806994:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1595 00000100:00100000:1.0:1788876677.807000:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876677.807023:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511242880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876677.807029:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1595 00000100:00100000:0.0:1788876677.809905:0:45283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511242624 00000100:00100000:0.0:1788876677.809917:0:45283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511242624 00000100:00100000:0.0:1788876677.810451:0:45283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1788876677.810462:0:45283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511242624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876677.810539:0:45283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511242624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 79us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876677.811037:0:45283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00010000:00010000:2.0:1788876677.992901:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788876678.623337:0:45665:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788876678.625851:0:45665:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788876679.020881:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876680.041666:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876680.638331:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876680.638408:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243264 00000100:00100000:3.0:1788876680.638418:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243264 00000100:00100000:3.0:1788876680.638546:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2449 00000100:00100000:3.0:1788876680.638557:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34362:x1875771511243264:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1788876680.638576:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876680.638598:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aee63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704887f expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638698:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638713:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638726:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876680.638777:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876680.638781:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876680.638831:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638855:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aee63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704887f expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638884:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704887f expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876680.638893:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:3.0:1788876680.638896:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876680.638899:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221c00, rc 0) 00000100:00100000:3.0:1788876680.638961:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34362:x1875771511243264:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 406us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876680.638968:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2449 00000100:00080000:0.0:1788876680.639028:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876680.647802:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876680.651041:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243392 00000100:00100000:2.0:1788876680.651058:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243392 00000100:00100000:2.0:1788876680.651138:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2450 00000100:00100000:2.0:1788876680.651149:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34362:x1875771511243392:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876680.651189:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876680.651277:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34362:x1875771511243392:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 129us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876680.651285:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2450 00000100:00100000:2.0:1788876680.656525:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876680.664121:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243520 00000100:00100000:3.0:1788876680.664135:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243520 00000100:00100000:2.0:1788876680.669891:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2451 00000100:00100000:2.0:1788876680.669908:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34362:x1875771511243520:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876680.669958:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876680.670063:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34362:x1875771511243520:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 158us (14037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876680.670072:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2451 00000100:00100000:1.0:1788876680.676908:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876680.677556:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243648 00000100:00100000:2.0:1788876680.677566:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243648 00000100:00080000:0.0:1788876680.678168:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876680.678174:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876680.681275:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 946 00000100:00100000:2.0:1788876680.681295:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34362:x1875771511243648:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876680.681337:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876680.681430:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34362:x1875771511243648:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 142us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876680.681437:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 946 00000100:00100000:3.0:1788876680.684018:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876680.684197:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243776 00000100:00100000:0.0:1788876680.684206:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243776 00000100:00100000:0.0:1788876680.684304:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 947 00000100:00100000:0.0:1788876680.684314:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34362:x1875771511243776:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876680.684341:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876680.684406:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34362:x1875771511243776:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 93us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876680.684413:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 947 00000100:00080000:2.0:1788876680.687251:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876681.067085:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876681.706477:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532315776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876681.706559:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876681.706775:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315776 00000100:00100000:2.0:1788876681.706784:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315776 00000100:00100000:2.0:1788876681.706857:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1788876681.706867:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532315776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876681.706889:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876681.706935:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532315776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876681.706941:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00080000:0.0:1788876681.707064:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876681.707097:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532315776:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876682.096873:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876682.219083:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876682.219108:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532315904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876682.219180:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876682.219514:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532315904 00000100:00100000:1.0:1788876682.219535:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532315904 00000100:00100000:1.0:1788876682.219580:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1788876682.219589:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532315904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876682.219642:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876682.219703:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532315904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876682.219713:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1788876682.219761:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532315904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876682.224467:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876682.224491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532316032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876682.224572:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876682.224776:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316032 00000100:00100000:0.0:1788876682.224783:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316032 00000100:00100000:0.0:1788876682.224836:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1788876682.224845:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532316032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876682.224877:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788876682.224931:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532316032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876682.224939:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1788876682.224982:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532316032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876682.225217:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532316288:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225249:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225270:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532316800:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225292:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225312:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317312:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225333:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225349:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788876682.225354:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532316160:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225380:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225402:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532316672:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225427:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225445:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317184:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225465:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.225492:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316288 00000100:00100000:3.0:1788876682.225495:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316288 00000100:00100000:3.0:1788876682.225536:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316672 00000100:00100000:3.0:1788876682.225539:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316672 00000100:00100000:3.0:1788876682.225566:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1788876682.225573:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532316288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225632:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532316288:12345-0@lo:400:kworker.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.225639:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1788876682.225781:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1788876682.225789:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532316672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.225835:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532316672:12345-0@lo:400:kworker.0 Request processed in 48us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.225841:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1788876682.225862:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316800 00000100:00100000:3.0:1788876682.225866:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316800 00000100:00100000:3.0:1788876682.225889:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317312 00000100:00100000:3.0:1788876682.225892:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317312 00000100:00100000:3.0:1788876682.225912:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317184 00000100:00100000:3.0:1788876682.225915:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317184 00000100:00100000:3.0:1788876682.226151:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788876682.226158:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532316800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226191:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532316800:12345-0@lo:400:kworker.0 Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.226197:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788876682.226209:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788876682.226215:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226243:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317312:12345-0@lo:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.226248:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788876682.226259:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788876682.226265:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226292:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317184:12345-0@lo:400:kworker.0 Request processed in 27us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.226297:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788876682.226318:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316160 00000100:00100000:3.0:1788876682.226321:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316160 00000100:00100000:3.0:1788876682.226344:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788876682.226350:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532316160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226377:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532316160:12345-0@lo:400:kworker.0 Request processed in 27us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.226383:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788876682.226414:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876682.226418:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876682.226420:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876682.226443:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532316544:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226468:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.226487:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532317056:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.226506:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.227752:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788876682.227764:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.227802:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.227838:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532316928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.227860:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876682.227881:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532317440:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.227905:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876682.228012:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316416 00000100:00100000:1.0:1788876682.228019:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316416 00000100:00100000:1.0:1788876682.232376:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1788876682.232399:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532316416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.232511:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532316416:12345-0@lo:400:kworker.0 Request processed in 123us (4708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876682.232532:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1788876682.233642:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316544 00000100:00100000:3.0:1788876682.233664:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316544 00000100:00100000:3.0:1788876682.233715:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532316416:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.233754:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317056 00000100:00100000:3.0:1788876682.233758:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317056 00000100:00100000:3.0:1788876682.233805:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532316928 00000100:00100000:3.0:1788876682.233818:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532316928 00000100:00100000:3.0:1788876682.233835:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317440 00000100:00100000:3.0:1788876682.233837:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317440 00000100:00100000:3.0:1788876682.233851:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788876682.233857:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532317056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.233928:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532317056:12345-0@lo:400:kworker.0 Request processed in 62us (7411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.233935:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788876682.233950:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788876682.233956:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532316928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.233985:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532316928:12345-0@lo:400:kworker.0 Request processed in 29us (6124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.233991:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788876682.234003:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788876682.234008:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532317440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.234035:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532317440:12345-0@lo:400:kworker.0 Request processed in 27us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.234041:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00080000:3.0:1788876682.234062:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788876682.234066:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876682.234068:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876682.234089:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532316928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.234100:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532317440:0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.234111:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532317056:0@lo:400:kworker.0 00000100:00080000:3.0:1788876682.234139:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876682.234162:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1788876682.234168:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532316544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876682.234202:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532316544:12345-0@lo:400:kworker.0 Request processed in 34us (7733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.234208:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:3.0:1788876682.234233:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532316544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.236987:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532316160:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.237011:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532316672:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.237024:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317184:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.237036:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.237047:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532316800:0@lo:400:kworker.0 00000100:00100000:1.0:1788876682.237059:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317312:0@lo:400:kworker.0 00000100:00100000:0.0:1788876682.728958:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532317568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876682.729031:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876682.729085:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317568 00000100:00100000:0.0:1788876682.729092:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317568 00000100:00100000:0.0:1788876682.729141:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1788876682.729150:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532317568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876682.729183:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876682.729247:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532317568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876682.729253:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1788876682.729303:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532317568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876682.732513:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532317696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876682.732591:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876682.735639:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876682.736504:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876682.736636:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317696 00000100:00100000:1.0:1788876682.736646:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317696 00000100:00100000:1.0:1788876682.736687:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317824 00000100:00100000:1.0:1788876682.736691:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317824 00000100:00100000:1.0:1788876682.736709:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1788876682.736718:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532317696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876682.736742:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876682.736794:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532317696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876682.736801:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1788876682.736829:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1788876682.736836:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876682.736854:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876682.736886:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532317824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876682.736892:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1788876682.737376:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532317824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876682.738028:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532317696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876682.928374:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876682.928416:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876682.928448:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876682.928467:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876682.928488:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876682.928517:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244416 00000100:00100000:2.0:1788876682.928525:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244416 00000100:00100000:2.0:1788876682.928572:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244288 00000100:00100000:2.0:1788876682.928575:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244288 00000100:00100000:2.0:1788876682.928596:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1183 00000100:00100000:2.0:1788876682.928634:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511244416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876682.928710:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511244416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876682.928717:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1183 00000100:00100000:2.0:1788876682.928735:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1184 00000100:00100000:2.0:1788876682.928741:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511244288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876682.928763:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511244288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876682.928769:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1184 00000100:00100000:2.0:1788876682.928785:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244160 00000100:00100000:2.0:1788876682.928788:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244160 00000100:00100000:2.0:1788876682.928826:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244032 00000100:00100000:2.0:1788876682.928829:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244032 00000100:00100000:2.0:1788876682.928851:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1602 00000100:00100000:2.0:1788876682.928858:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511244160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876682.928885:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511244160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876682.928891:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1602 00000100:00100000:2.0:1788876682.928914:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1603 00000100:00100000:2.0:1788876682.928920:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511244032:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876682.928945:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511244032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876682.928950:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1603 00000100:00080000:2.0:1788876682.928971:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876682.928975:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876682.928978:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876682.928979:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876682.929474:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511243904 00000100:00100000:3.0:1788876682.929480:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511243904 00000100:00100000:3.0:1788876682.929516:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1788876682.929524:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511243904:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876682.929568:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511243904:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876682.929574:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:1.0:1788876683.113730:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788876683.254309:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934857 is committed 00000001:00080000:0.0:1788876683.254885:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967565 is committed 00010000:00010000:1.0:1788876684.140560:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876685.163468:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876686.184920:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876686.831726:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532317952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876686.831814:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876686.831894:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532317952 00000100:00100000:2.0:1788876686.831903:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532317952 00000100:00100000:2.0:1788876686.831958:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1788876686.831966:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532317952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876686.831997:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876686.832044:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532317952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876686.832051:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00080000:2.0:1788876686.832073:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876686.832123:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532317952:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788876686.890859:0:45859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1788876687.208832:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876687.337361:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876687.337384:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532318080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876687.337460:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876687.337621:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318080 00000100:00100000:2.0:1788876687.337629:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318080 00000100:00100000:2.0:1788876687.337685:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1788876687.337694:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532318080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876687.337730:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876687.337788:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532318080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876687.337804:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1788876687.338061:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532318080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876687.338789:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532318592:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.338840:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.338974:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532319104:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339002:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.339018:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532319616:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339040:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.339059:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788876687.339064:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532318464:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339155:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.339173:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532318976:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339193:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.339212:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532319488:0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339231:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.339258:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318592 00000100:00100000:0.0:1788876687.339262:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318592 00000100:00100000:0.0:1788876687.339300:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1788876687.339308:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339346:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532318592:12345-0@lo:400:kworker.0 Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876687.339353:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1788876687.339383:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319616 00000100:00100000:0.0:1788876687.339386:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319616 00000100:00100000:0.0:1788876687.339406:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318976 00000100:00100000:0.0:1788876687.339409:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318976 00000100:00100000:0.0:1788876687.339424:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319488 00000100:00100000:0.0:1788876687.339426:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319488 00000100:00100000:0.0:1788876687.339441:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1788876687.339446:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532319616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876687.339476:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532319616:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876687.339592:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788876687.339666:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532318208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876687.339698:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339719:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532318720:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339739:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339754:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532319232:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339784:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339811:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532319744:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339838:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339866:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876687.339872:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532318336:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339901:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339924:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532318848:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339946:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.339957:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532319360:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.339974:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876687.340002:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318208 00000100:00100000:1.0:1788876687.340005:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318208 00000100:00100000:1.0:1788876687.340029:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319360 00000100:00100000:1.0:1788876687.340032:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319360 00000100:00100000:1.0:1788876687.340044:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1788876687.340050:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532318208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876687.340081:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876687.340120:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532318208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340126:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1788876687.340138:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1788876687.340144:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532319360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340170:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532319360:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340175:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1788876687.340193:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319104 00000100:00100000:1.0:1788876687.340197:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319104 00000100:00100000:1.0:1788876687.340217:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318464 00000100:00100000:1.0:1788876687.340219:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318464 00000100:00100000:1.0:1788876687.340229:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318720 00000100:00100000:1.0:1788876687.340232:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318720 00000100:00100000:1.0:1788876687.340243:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319232 00000100:00100000:1.0:1788876687.340245:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319232 00000100:00100000:1.0:1788876687.340258:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319744 00000100:00100000:1.0:1788876687.340261:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319744 00000100:00100000:1.0:1788876687.340271:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318848 00000100:00100000:1.0:1788876687.340273:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318848 00000100:00100000:1.0:1788876687.340285:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1788876687.340291:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532319104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340322:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532319104:12345-0@lo:400:kworker.0 Request processed in 31us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340327:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1788876687.340339:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788876687.340344:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532318464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340368:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532318464:12345-0@lo:400:kworker.0 Request processed in 25us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340372:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788876687.340384:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1788876687.340388:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532318720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340411:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532318720:12345-0@lo:400:kworker.0 Request processed in 23us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340416:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:1.0:1788876687.340428:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:1.0:1788876687.340433:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532319232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340457:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532319232:12345-0@lo:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340465:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:1.0:1788876687.340476:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1788876687.340481:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532319744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340521:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532319744:12345-0@lo:400:kworker.0 Request processed in 40us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340527:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1788876687.340539:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1788876687.340544:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532318848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340570:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532318848:12345-0@lo:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876687.340575:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:1.0:1788876687.340636:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532318848:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340646:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532319360:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340657:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532318208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876687.340666:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532318720:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340674:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532319232:0@lo:400:kworker.0 00000100:00100000:1.0:1788876687.340682:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532319744:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.347092:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1788876687.347122:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532318976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.347217:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532318976:12345-0@lo:400:kworker.0 Request processed in 112us (8022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876687.347225:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1788876687.347257:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1788876687.347265:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532319488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.347293:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532319488:12345-0@lo:400:kworker.0 Request processed in 31us (8062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876687.347299:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1788876687.347363:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532318336 00000100:00100000:2.0:1788876687.347371:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532318336 00000100:00100000:2.0:1788876687.347413:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788876687.347420:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532318336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.347459:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532318336:12345-0@lo:400:kworker.0 Request processed in 39us (7556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876687.347469:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788876687.348254:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532318336:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348332:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348345:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532318976:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348355:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934857 gen 2 00000100:00100000:2.0:1788876687.348365:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532319488:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348378:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532318592:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348389:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532319104:0@lo:400:kworker.0 00000100:00100000:2.0:1788876687.348398:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967565 gen 2 00000100:00100000:2.0:1788876687.348406:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532319616:0@lo:400:kworker.0 00000100:00080000:2.0:1788876687.348444:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876687.348449:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876687.348453:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876687.348455:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876687.848854:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532319872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876687.848932:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876687.848999:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876687.849013:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532320128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876687.849041:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.849062:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532319872 00000100:00100000:0.0:1788876687.849070:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532319872 00000100:00100000:2.0:1788876687.849083:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532320000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876687.849104:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876687.853798:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320128 00000100:00100000:0.0:1788876687.853815:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320128 00000100:00100000:0.0:1788876687.853875:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320000 00000100:00100000:0.0:1788876687.853879:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320000 00000100:00100000:0.0:1788876687.853901:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1788876687.853911:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532319872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876687.853942:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876687.854033:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532319872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (5100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876687.854040:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1788876687.854056:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788876687.854062:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532320128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876687.854072:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876687.854105:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532320128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876687.854110:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788876687.854122:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1788876687.854128:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532320000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876687.854137:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876687.854161:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532320000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (5056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876687.854171:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1788876687.854257:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532320128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876687.854298:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532319872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876687.854313:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532320000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876688.045899:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876688.045957:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876688.045984:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876688.046009:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876688.046019:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244544 00000100:00100000:3.0:1788876688.046033:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244544 00000100:00100000:2.0:1788876688.046047:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876688.046073:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244800 00000100:00100000:2.0:1788876688.046077:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244800 00000100:00100000:3.0:1788876688.046102:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1788876688.046116:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511244544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876688.046128:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244672 00000100:00100000:2.0:1788876688.046132:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244672 00000100:00100000:2.0:1788876688.046156:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1610 00000100:00100000:2.0:1788876688.046172:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511244800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876688.046193:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511244544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876688.046201:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1788876688.046215:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511244800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876688.046223:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1610 00000100:00100000:3.0:1788876688.046242:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245056 00000100:00100000:2.0:1788876688.046245:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1611 00000100:00100000:3.0:1788876688.046248:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245056 00000100:00100000:2.0:1788876688.046255:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511244672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876688.046285:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511244928 00000100:00100000:2.0:1788876688.046286:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511244672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876688.046289:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511244928 00000100:00100000:2.0:1788876688.046296:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1611 00000100:00080000:2.0:1788876688.046322:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876688.046322:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1189 00000100:00080000:2.0:1788876688.046329:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876688.046334:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876688.046334:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511245056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:2.0:1788876688.046338:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876688.046368:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511245056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876688.046375:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1189 00000100:00100000:3.0:1788876688.046389:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1190 00000100:00100000:3.0:1788876688.046396:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511244928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876688.046423:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511244928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876688.046430:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1190 00010000:00010000:0.0:1788876688.232998:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788876688.439025:0:45907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788876689.256883:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876690.280848:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876690.349053:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876690.352049:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245184 00000100:00100000:0.0:1788876690.352131:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245184 00000100:00100000:0.0:1788876690.352300:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2452 00000100:00100000:0.0:1788876690.352311:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34830:x1875771511245184:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876690.352583:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788876690.352684:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34830:x1875771511245184:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 374us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876690.352692:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2452 00000100:00080000:2.0:1788876690.356658:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876690.366654:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876690.366806:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245312 00000100:00100000:1.0:1788876690.366816:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245312 00000100:00100000:1.0:1788876690.366906:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2453 00000100:00100000:1.0:1788876690.366918:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34830:x1875771511245312:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876690.366961:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876690.367046:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:34830:x1875771511245312:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 128us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876690.367053:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2453 00000100:00080000:2.0:1788876690.367169:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876690.370036:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876690.370183:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245440 00000100:00100000:0.0:1788876690.370193:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245440 00000100:00080000:2.0:1788876690.370333:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876690.371196:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 956 00000100:00100000:0.0:1788876690.371212:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34830:x1875771511245440:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876690.371244:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876690.371314:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34830:x1875771511245440:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 109us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876690.371321:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 956 00000100:00100000:0.0:1788876690.384967:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876690.389298:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245568 00000100:00100000:2.0:1788876690.389314:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245568 00000100:00100000:2.0:1788876690.389395:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 957 00000100:00100000:2.0:1788876690.389406:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34830:x1875771511245568:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876690.389439:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876690.389527:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34830:x1875771511245568:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 122us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876690.389536:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 957 00000100:00080000:0.0:1788876690.390164:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876690.439703:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876690.439792:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245696 00000100:00100000:0.0:1788876690.439802:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245696 00000100:00100000:0.0:1788876690.439866:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2454 00000100:00100000:0.0:1788876690.439876:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:34846:x1875771511245696:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:0.0:1788876690.439896:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876690.439916:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aee71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048886 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.439978:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.439992:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440003:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440016:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440023:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440029:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440634:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440646:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440657:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876690.440704:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x107:0x0]: returning size 4096 00000004:00200000:0.0:1788876690.440708:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876690.440759:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440772:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440779:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440784:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440789:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876690.440793:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440800:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440811:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:0.0:1788876690.440813:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876690.440817:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440822:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440839:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440844:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440848:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440853:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876690.440855:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440859:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440865:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee91ab1b (ffff8a13ff5bba00) 00010000:00010000:0.0:1788876690.440867:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876690.440870:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440874:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee91ab1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440902:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aee71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048886 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440915:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048886 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.440927:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13ff5bb600) 00010000:00010000:0.0:1788876690.440929:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876690.440932:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe53600, rc 0) 00000100:00100000:0.0:1788876690.440996:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34846:x1875771511245696:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 1121us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876690.441004:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2454 00000100:00100000:3.0:1788876690.460680:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876690.460755:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245824 00000100:00100000:0.0:1788876690.460765:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245824 00000100:00100000:0.0:1788876690.460826:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2455 00000100:00100000:0.0:1788876690.460836:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:34848:x1875771511245824:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:0.0:1788876690.460857:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876690.460878:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aee8d lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704888d expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460940:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460955:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460966:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460979:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460986:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.460992:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461064:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461086:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461093:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876690.461134:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x109:0x0]: returning size 0 00000004:00200000:0.0:1788876690.461137:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876690.461157:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461167:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461175:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461181:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461188:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461194:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876690.461198:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461206:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461217:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x0 (ffff8a13ff5bb600) 00010000:00010000:0.0:1788876690.461220:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876690.461225:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461230:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aee94 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461242:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461248:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461253:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461257:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876690.461260:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461265:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461271:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x107:0x0].0x1a603d0b (ffff8a13ff5bba00) 00010000:00010000:0.0:1788876690.461273:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876690.461276:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461283:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aee9b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x1a603d0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461314:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aee8d lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x107:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704888d expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461328:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704888d expref: 9 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876690.461335:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x109:0x0].0x0 (ffff8a13ff5bbc00) 00010000:00010000:0.0:1788876690.461337:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788876690.461339:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13cfe52c00, rc 0) 00000100:00100000:0.0:1788876690.461399:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:34848:x1875771511245824:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 564us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876690.461405:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2455 00010000:00010000:0.0:1788876691.305267:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876691.945030:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532320256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876691.945105:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876691.945353:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320256 00000100:00100000:2.0:1788876691.945362:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320256 00000100:00100000:2.0:1788876691.945429:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1788876691.945438:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532320256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876691.945461:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876691.945515:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532320256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876691.945522:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:1.0:1788876691.945640:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532320256:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876691.945766:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788876692.328939:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876692.456816:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876692.456839:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532320384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876692.456916:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876692.457024:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320384 00000100:00100000:3.0:1788876692.457033:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320384 00000100:00100000:1.0:1788876692.457243:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532320640:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.457275:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876692.457322:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1788876692.457327:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532320768:0@lo:400:kworker.0 00000100:00100000:3.0:1788876692.457335:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532320384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876692.457357:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788876692.457371:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876692.457424:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532321152:0@lo:400:kworker.0 00000100:00100000:3.0:1788876692.457425:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532320384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876692.457437:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1788876692.457454:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.457514:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457543:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.457565:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457586:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.457637:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532320384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876692.457654:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876692.457659:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457679:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.457704:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320640 00000100:00100000:0.0:1788876692.457708:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320640 00000100:00100000:0.0:1788876692.457745:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321024 00000100:00100000:0.0:1788876692.457748:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321024 00000100:00100000:0.0:1788876692.457772:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320896 00000100:00100000:0.0:1788876692.457775:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320896 00000100:00100000:0.0:1788876692.457788:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1788876692.457794:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457824:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532320640:12345-0@lo:400:kworker.0 Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.457830:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1788876692.457842:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:0.0:1788876692.457848:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532321024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457875:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532321024:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.457882:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:0.0:1788876692.457893:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:0.0:1788876692.457899:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457923:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532320896:12345-0@lo:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.457929:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00080000:0.0:1788876692.457943:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876692.457948:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876692.457965:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.457974:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.458011:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320768 00000100:00100000:0.0:1788876692.458015:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320768 00000100:00100000:0.0:1788876692.458041:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321152 00000100:00100000:0.0:1788876692.458044:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321152 00000100:00100000:0.0:1788876692.458059:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1788876692.458064:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.458093:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532320768:12345-0@lo:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.458099:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1788876692.458110:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1788876692.458116:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532321152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.458142:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532321152:12345-0@lo:400:kworker.0 Request processed in 26us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.458147:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:0.0:1788876692.458159:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876692.458168:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532321280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876692.458192:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876692.458253:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532321152:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458263:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532320640:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458309:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876692.458315:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532321408:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458338:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876692.458358:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321408 00000100:00100000:1.0:1788876692.458362:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321408 00000100:00100000:1.0:1788876692.458387:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1788876692.458393:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532321408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458422:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532321408:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876692.458432:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00080000:1.0:1788876692.458443:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876692.458457:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532321408:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458485:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532321536:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458506:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876692.458528:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321536 00000100:00100000:1.0:1788876692.458531:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321536 00000100:00100000:1.0:1788876692.458556:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:1.0:1788876692.458562:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532321536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458593:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532321536:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876692.458599:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00080000:1.0:1788876692.458629:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876692.458645:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532321536:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458672:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532321664:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458715:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876692.458722:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532321920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458759:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876692.458796:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532322048:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458817:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876692.458839:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322048 00000100:00100000:1.0:1788876692.458843:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322048 00000100:00100000:1.0:1788876692.458863:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1788876692.458869:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532322048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458902:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532322048:12345-0@lo:400:kworker.0 Request processed in 33us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876692.458908:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1788876692.458929:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532322048:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.458970:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321920 00000100:00100000:1.0:1788876692.458974:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321920 00000100:00100000:1.0:1788876692.459003:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788876692.459009:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532321920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.459040:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532321920:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876692.459046:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788876692.459065:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532320512 00000100:00100000:1.0:1788876692.459068:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532320512 00000100:00100000:1.0:1788876692.459092:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788876692.459099:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.459129:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532320512:12345-0@lo:400:kworker.0 Request processed in 31us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876692.459135:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788876692.459155:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876692.459170:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532321920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876692.459179:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532320512:0@lo:400:kworker.0 00000100:00100000:2.0:1788876692.461658:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321280 00000100:00100000:2.0:1788876692.461672:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321280 00000100:00100000:0.0:1788876692.461733:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532320768:0@lo:400:kworker.0 00000100:00100000:2.0:1788876692.461753:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1788876692.461765:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532321280:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876692.461776:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532321792:0@lo:400:kworker.0 00000004:00000024:2.0:1788876692.461801:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876692.461832:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876692.461860:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532321280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876692.461868:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1788876692.461874:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532321280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876692.461901:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321792 00000100:00100000:2.0:1788876692.461906:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321792 00000100:00100000:0.0:1788876692.461912:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876692.461954:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1788876692.461964:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532321792:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788876692.461971:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876692.462005:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532321792:12345-0@lo:400:kworker.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876692.462012:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1788876692.462023:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532321792:0@lo:400:kworker.0 00000100:00100000:2.0:1788876692.462034:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532321664 00000100:00100000:2.0:1788876692.462039:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532321664 00000100:00100000:2.0:1788876692.462261:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1788876692.462272:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532321664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876692.462318:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532321664:12345-0@lo:400:kworker.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876692.462325:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1788876692.462918:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532321664:0@lo:400:kworker.0 00000100:00100000:0.0:1788876692.968792:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876692.968823:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532322176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876692.968897:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.968946:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322176 00000100:00100000:0.0:1788876692.968953:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322176 00000100:00100000:0.0:1788876692.968995:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1788876692.969013:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532322176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876692.969043:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876692.969086:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532322176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876692.969094:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1788876692.969119:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532322304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876692.969143:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876692.969195:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532322176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876692.969235:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322304 00000100:00100000:3.0:1788876692.969242:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322304 00000100:00100000:3.0:1788876692.969282:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1788876692.969293:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532322304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876692.969314:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876692.969384:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532322304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876692.969395:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1788876692.969444:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532322432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876692.969482:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876692.969563:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322432 00000100:00100000:3.0:1788876692.969568:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322432 00000100:00100000:3.0:1788876692.969631:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1788876692.969639:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532322432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876692.969650:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876692.969680:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532322432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876692.969686:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1788876692.969797:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532322432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876692.970017:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532322304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876693.172760:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876693.173189:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246080 00000100:00100000:3.0:1788876693.173199:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246080 00000100:00100000:3.0:1788876693.173273:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1618 00000100:00100000:3.0:1788876693.173284:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511246080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876693.173367:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511246080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 85us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876693.173375:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1618 00000100:00100000:2.0:1788876693.173922:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876693.173958:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876693.173977:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876693.174004:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876693.174028:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246336 00000100:00100000:2.0:1788876693.174034:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246336 00000100:00100000:2.0:1788876693.174067:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246464 00000100:00100000:2.0:1788876693.174071:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246464 00000100:00100000:2.0:1788876693.174096:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1195 00000100:00100000:2.0:1788876693.174104:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876693.174146:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876693.174153:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1195 00000100:00100000:2.0:1788876693.174167:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1196 00000100:00100000:2.0:1788876693.174173:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876693.174200:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876693.174206:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1196 00000100:00100000:1.0:1788876693.174534:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246208 00000100:00100000:1.0:1788876693.174539:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246208 00000100:00100000:1.0:1788876693.174579:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1619 00000100:00100000:1.0:1788876693.174586:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511246208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876693.174639:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511246208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 53us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876693.174646:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1619 00000100:00100000:3.0:1788876693.175459:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511245952 00000100:00100000:3.0:1788876693.175467:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511245952 00000100:00100000:3.0:1788876693.175509:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1788876693.175518:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511245952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876693.175552:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511245952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876693.175558:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00080000:0.0:1788876693.176197:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876693.176203:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876693.176206:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876693.176208:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788876693.353647:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876694.378741:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876695.405824:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876696.424903:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876697.065425:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876697.065446:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532322560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876697.065511:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876697.065868:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322560 00000100:00100000:3.0:1788876697.065877:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322560 00000100:00100000:3.0:1788876697.065934:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1788876697.065943:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532322560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876697.065969:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876697.066013:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532322560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.066020:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:3.0:1788876697.066061:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532322560:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876697.066332:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876697.450241:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876697.576842:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532322816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.576910:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876697.576956:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532323328:0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.576979:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876697.576997:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532323840:0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.577016:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876697.577128:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532322688:0@lo:400:kworker.0 00000100:00100000:2.0:1788876697.577169:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876697.577199:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788876697.577222:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876697.577244:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532323712:0@lo:400:kworker.0 00000100:00100000:2.0:1788876697.577268:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876697.577287:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532324224:0@lo:400:kworker.0 00000100:00100000:2.0:1788876697.577309:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876697.577415:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532323072:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.577424:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532322944:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.577457:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876697.577477:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532323456:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.577498:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876697.577517:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532323968:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.577524:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876697.577562:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532323584:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.577591:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876697.577598:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323328 00000100:00100000:1.0:1788876697.577638:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323328 00000100:00100000:0.0:1788876697.577648:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532324096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.577676:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876697.577694:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323200 00000100:00100000:1.0:1788876697.577708:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323200 00000100:00100000:1.0:1788876697.577726:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323712 00000100:00100000:1.0:1788876697.577729:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323712 00000100:00100000:1.0:1788876697.577743:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324224 00000100:00100000:1.0:1788876697.577746:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324224 00000100:00100000:1.0:1788876697.577759:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322944 00000100:00100000:1.0:1788876697.577761:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322944 00000100:00080000:0.0:1788876697.577775:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876697.577778:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323584 00000100:00080000:0.0:1788876697.577782:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876697.577782:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323584 00000100:00100000:0.0:1788876697.577798:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876697.577809:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532324480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876697.577811:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1788876697.577823:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532323328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.577841:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876697.577898:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876697.577931:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323456 00000100:00100000:3.0:1788876697.577934:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323456 00000100:00100000:3.0:1788876697.577959:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323072 00000100:00100000:3.0:1788876697.577961:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323072 00000100:00100000:3.0:1788876697.577977:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324096 00000100:00100000:3.0:1788876697.578000:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324096 00000100:00100000:3.0:1788876697.578029:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323968 00000100:00100000:3.0:1788876697.578032:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323968 00000100:00100000:3.0:1788876697.578054:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1788876697.578060:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532323456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.578100:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532323456:12345-0@lo:400:kworker.0 Request processed in 39us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.578107:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1788876697.578124:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1788876697.578131:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532323072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.578158:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532323072:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.578164:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1788876697.578173:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1788876697.578178:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.578204:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532324096:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.578210:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1788876697.578220:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1788876697.578227:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532323968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.578256:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532323968:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.578261:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788876697.578517:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532323328:12345-0@lo:400:kworker.0 Request processed in 694us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578524:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:1.0:1788876697.578548:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1788876697.578557:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532323200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.578588:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532323200:12345-0@lo:400:kworker.0 Request processed in 32us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578593:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1788876697.578628:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788876697.578635:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.578661:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532323712:12345-0@lo:400:kworker.0 Request processed in 28us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578668:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788876697.578678:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1788876697.578684:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.578720:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532324224:12345-0@lo:400:kworker.0 Request processed in 37us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578725:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1788876697.578735:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1788876697.578741:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532322944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.578768:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532322944:12345-0@lo:400:kworker.0 Request processed in 27us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578773:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1788876697.578784:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:1.0:1788876697.578791:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532323584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876697.578815:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532323584:12345-0@lo:400:kworker.0 Request processed in 25us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876697.578821:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00080000:1.0:1788876697.582403:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876697.582422:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876697.582426:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876697.582465:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532324352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876697.583815:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532323072:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.583832:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532323584:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.583843:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532324096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.583888:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876697.583928:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532323328:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.584262:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322816 00000100:00100000:3.0:1788876697.584271:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322816 00000100:00100000:3.0:1788876697.584310:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532323840 00000100:00100000:3.0:1788876697.584313:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532323840 00000100:00100000:3.0:1788876697.584325:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324480 00000100:00100000:3.0:1788876697.584328:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324480 00000100:00100000:3.0:1788876697.584337:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324352 00000100:00100000:3.0:1788876697.584339:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324352 00000100:00100000:3.0:1788876697.584350:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1788876697.584357:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1875771532322816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.584446:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1875771532322816:12345-0@lo:400:kworker.0 Request processed in 89us (7537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.584454:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1788876697.584472:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1788876697.584477:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532323840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.584507:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532323840:12345-0@lo:400:kworker.0 Request processed in 30us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.584514:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1788876697.584524:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1788876697.584529:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532324480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876697.584568:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876697.584622:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532324480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (6781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.584628:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:3.0:1788876697.584640:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1788876697.584646:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532324352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876697.584661:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876697.584693:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532324352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.584710:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1788876697.584732:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532324480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876697.584774:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f43c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532322944:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.584777:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532324352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876697.584796:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532323456:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.584797:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532322816:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.584819:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532323968:0@lo:400:kworker.0 00000100:00100000:0.0:1788876697.584820:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532323840:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.585203:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532322688 00000100:00100000:3.0:1788876697.585209:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532322688 00000100:00100000:3.0:1788876697.585240:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788876697.585247:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532322688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.585285:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532322688:12345-0@lo:400:kworker.0 Request processed in 39us (8117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876697.585291:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788876697.585345:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532322688:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.585358:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532323200:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.585370:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532323712:0@lo:400:kworker.0 00000100:00100000:3.0:1788876697.585380:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788876698.089402:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876698.089471:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876698.089912:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532324736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876698.089946:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876698.090353:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532324864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876698.090385:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876698.090520:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324608 00000100:00100000:2.0:1788876698.090528:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324608 00000100:00100000:2.0:1788876698.090575:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324736 00000100:00100000:2.0:1788876698.090579:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324736 00000100:00100000:2.0:1788876698.090591:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324864 00000100:00100000:2.0:1788876698.090593:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324864 00000100:00100000:2.0:1788876698.090627:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1788876698.090636:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876698.090665:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876698.090725:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.090732:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1788876698.090751:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:2.0:1788876698.090759:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532324736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876698.090771:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876698.090799:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532324736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.090804:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:2.0:1788876698.090815:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1788876698.090821:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532324864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876698.090829:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876698.090850:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532324864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.090856:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1788876698.091643:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532324736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876698.091684:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532324864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876698.091727:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876698.302998:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876698.303038:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876698.303071:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876698.303092:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876698.303138:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876698.303170:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247104 00000100:00100000:2.0:1788876698.303179:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247104 00000100:00100000:2.0:1788876698.303229:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246976 00000100:00100000:2.0:1788876698.303232:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246976 00000100:00100000:2.0:1788876698.303252:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1201 00000100:00100000:2.0:1788876698.303261:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511247104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876698.303327:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511247104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.303334:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1201 00000100:00100000:2.0:1788876698.303350:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1202 00000100:00100000:2.0:1788876698.303356:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246976:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876698.303380:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511246976:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.303386:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1202 00000100:00100000:2.0:1788876698.303403:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246848 00000100:00100000:2.0:1788876698.303406:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246848 00000100:00100000:2.0:1788876698.303433:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246720 00000100:00100000:2.0:1788876698.303436:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246720 00000100:00100000:2.0:1788876698.303455:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1626 00000100:00100000:2.0:1788876698.303462:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511246848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876698.303487:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511246848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.303494:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1626 00000100:00100000:2.0:1788876698.303505:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1627 00000100:00100000:2.0:1788876698.303511:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511246720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876698.303532:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511246720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876698.303539:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1627 00000100:00080000:2.0:1788876698.303556:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876698.303560:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876698.303562:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876698.303564:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876698.303828:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511246592 00000100:00100000:3.0:1788876698.303833:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511246592 00000100:00100000:3.0:1788876698.303869:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1788876698.303877:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511246592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876698.303918:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511246592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876698.303925:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00010000:00010000:1.0:1788876698.475372:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876699.509859:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876700.166855:0:46102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 6b: |X| rmdir ====================== 10:11:38 (1788876698) 00000100:00100000:0.0:1788876700.232925:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876700.233038:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247232 00000100:00100000:3.0:1788876700.233048:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247232 00000100:00100000:3.0:1788876700.233123:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2456 00000100:00100000:3.0:1788876700.233133:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35431:x1875771511247232:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1788876700.233155:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876700.233174:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aeea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048894 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233237:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233257:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233271:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233286:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233293:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233299:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233358:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233366:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233372:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233378:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876700.233381:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233388:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233399:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:3.0:1788876700.233402:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876700.233406:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233412:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220400/0xf5bf0f7e313aeeb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233425:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233430:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233435:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233440:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876700.233442:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233447:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233452:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13f07a2500) 00010000:00010000:3.0:1788876700.233455:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876700.233457:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233463:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220e00/0xf5bf0f7e313aeeb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233494:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aeea9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048894 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233507:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:3.0:1788876700.233509:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876700.233513:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aeea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048894 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876700.233535:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221600, rc 0) 00000100:00100000:3.0:1788876700.233988:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35431:x1875771511247232:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 470us (687us total) trans 0 rc 301/301 00000100:00100000:3.0:1788876700.233996:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2456 00000100:00080000:1.0:1788876700.234304:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876700.248659:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876700.248863:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247488 00000100:00100000:2.0:1788876700.248874:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247488 00000100:00100000:2.0:1788876700.248930:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2457 00000100:00100000:2.0:1788876700.248940:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35431:x1875771511247488:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:2.0:1788876700.249005:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876700.249036:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aee6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704887f expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249057:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c133eb00) 00010000:00010000:2.0:1788876700.249069:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876700.249157:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249170:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249180:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249191:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249198:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.249204:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250021:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250035:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250044:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876700.250059:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aafa0839 reply state 00000000541c04b6 transno 73014444033 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250070:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250077:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13fa4b8200) 00010000:00010000:2.0:1788876700.250080:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876700.250083:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788876700.250087:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10a:0x0]: returning size 4096 00010000:00010000:2.0:1788876700.250094:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250101:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250107:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250114:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876700.250119:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250126:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250135:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8c00) 00010000:00010000:2.0:1788876700.250138:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876700.250141:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250152:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aeebe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876700.250165:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aafa0839 reply state 00000000541c04b6 transno 73014444033 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250174:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876700.250180:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13fa4b8400) 00010000:00010000:2.0:1788876700.250183:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876700.250185:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788876700.250278:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:35431:x1875771511247488:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1337us (1628us total) trans 73014444033 rc 0/0 00000100:00100000:2.0:1788876700.250286:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2457 00010000:00010000:0.0:1788876700.528674:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788876701.230203:0:45277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 73014444033 is committed 00010000:00010000:2.0:1788876701.234786:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234803:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234811:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234817:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876701.234822:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234830:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234852:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13fa4b8400) 00010000:00010000:2.0:1788876701.234855:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876701.234860:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234867:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeec5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234883:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234890:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234896:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234901:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876701.234904:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234909:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234917:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13fa4b8200) 00010000:00010000:2.0:1788876701.234919:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876701.234922:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.234928:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeecc lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x10a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876701.307050:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876701.307121:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247616 00000100:00100000:2.0:1788876701.307130:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247616 00000100:00100000:2.0:1788876701.307187:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2458 00000100:00100000:2.0:1788876701.307197:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35444:x1875771511247616:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876701.307219:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876701.307240:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704889b expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307302:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307317:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307328:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876701.307369:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876701.307372:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876701.307401:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307425:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704889b expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307441:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704889b expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.307450:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8200) 00010000:00010000:2.0:1788876701.307453:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876701.307456:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72a00, rc 0) 00000100:00100000:2.0:1788876701.307520:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35444:x1875771511247616:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 315us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876701.307527:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2458 00000100:00100000:3.0:1788876701.314234:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876701.314315:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247744 00000100:00100000:0.0:1788876701.314324:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247744 00000100:00100000:0.0:1788876701.314383:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2459 00000100:00100000:0.0:1788876701.314393:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35444:x1875771511247744:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876701.314429:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:0.0:1788876701.314500:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35444:x1875771511247744:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876701.314508:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2459 00000100:00100000:3.0:1788876701.329076:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876701.329165:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511247872 00000100:00100000:0.0:1788876701.329174:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511247872 00000100:00100000:0.0:1788876701.329245:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2460 00000100:00100000:0.0:1788876701.329255:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:35444:x1875771511247872:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876701.329290:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876701.329348:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:35444:x1875771511247872:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876701.329359:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2460 00000100:00080000:3.0:1788876701.329474:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876701.332711:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876701.332795:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248000 00000100:00100000:0.0:1788876701.332804:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248000 00000100:00100000:0.0:1788876701.332877:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 966 00000100:00100000:0.0:1788876701.332887:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35444:x1875771511248000:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876701.332916:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876701.332973:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35444:x1875771511248000:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876701.332980:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 966 00000100:00080000:3.0:1788876701.333047:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876701.335900:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876701.335980:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248128 00000100:00100000:1.0:1788876701.335989:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248128 00000100:00100000:1.0:1788876701.336055:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 967 00000100:00100000:1.0:1788876701.336064:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35444:x1875771511248128:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876701.336095:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876701.336157:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35444:x1875771511248128:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876701.336163:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 967 00000100:00080000:3.0:1788876701.336249:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876701.432912:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876701.433071:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248384 00000100:00100000:2.0:1788876701.433081:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248384 00000100:00100000:2.0:1788876701.433130:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2461 00000100:00100000:2.0:1788876701.433151:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35451:x1875771511248384:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:2.0:1788876701.433202:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876701.433227:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeeda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704889b expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433242:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8200) 00010000:00010000:2.0:1788876701.433252:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876701.433319:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433332:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433342:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433353:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433360:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.433370:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434036:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434047:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434055:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434061:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876701.434066:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434074:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434086:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8400) 00010000:00010000:2.0:1788876701.434089:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876701.434092:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434099:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeee1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876701.434112:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aed7ad5 reply state 00000000cb587039 transno 73014444034 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434123:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.434131:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fa4b8c00) 00010000:00010000:2.0:1788876701.434144:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876701.434148:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876701.434232:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:35451:x1875771511248384:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1093us (1328us total) trans 73014444034 rc 0/0 00000100:00100000:2.0:1788876701.434241:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2461 00000100:00100000:3.0:1788876701.455040:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876701.455126:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248512 00000100:00100000:2.0:1788876701.455146:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248512 00000100:00100000:2.0:1788876701.455215:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2462 00000100:00100000:2.0:1788876701.455230:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:35454:x1875771511248512:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876701.455259:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876701.455285:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeeef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488a2 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455356:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455376:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455391:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876701.455446:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876701.455450:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876701.455474:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455504:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313aeeef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a2 expref: 12 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455526:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a2 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.455534:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8400) 00010000:00010000:2.0:1788876701.455537:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876701.455540:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72a00, rc 0) 00000100:00100000:2.0:1788876701.455596:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35454:x1875771511248512:12345-192.168.203.11@tcp:101:rm.0 Request processed in 372us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876701.455625:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2462 00000100:00100000:1.0:1788876701.462467:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876701.462537:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248640 00000100:00100000:0.0:1788876701.462546:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248640 00000100:00100000:0.0:1788876701.462598:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2463 00000100:00100000:0.0:1788876701.462641:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35454:x1875771511248640:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876701.462658:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876701.462686:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aeefd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488a9 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462746:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462760:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462770:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462781:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462788:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462793:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462876:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462885:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462892:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876701.462936:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10b:0x0]: returning size 0 00000004:00200000:0.0:1788876701.462940:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876701.462960:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462971:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462979:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462985:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.462992:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463002:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876701.463006:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463013:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463025:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8400) 00010000:00010000:0.0:1788876701.463028:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876701.463032:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463039:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52400/0xf5bf0f7e313aef04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463049:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463055:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463060:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463065:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876701.463067:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463073:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463083:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fa4b8c00) 00010000:00010000:0.0:1788876701.463085:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876701.463088:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463094:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53e00/0xf5bf0f7e313aef0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463118:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52000/0xf5bf0f7e313aeefd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a9 expref: 13 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463132:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a9 expref: 12 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876701.463139:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10b:0x0].0x0 (ffff8a13ff5bb400) 00010000:00010000:0.0:1788876701.463142:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788876701.463144:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fad52c00, rc 0) 00000100:00100000:0.0:1788876701.463196:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35454:x1875771511248640:12345-192.168.203.11@tcp:101:rm.0 Request processed in 558us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876701.463203:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2463 00000100:00100000:1.0:1788876701.469826:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876701.471292:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248896 00000100:00100000:2.0:1788876701.471305:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248896 00000100:00100000:2.0:1788876701.471392:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2464 00000100:00100000:2.0:1788876701.471403:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35454:x1875771511248896:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876701.471460:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876701.471486:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52c00/0xf5bf0f7e313aef12 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a9 expref: 12 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471505:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10b:0x0].0x0 (ffff8a13ff5bb400) 00010000:00010000:2.0:1788876701.471523:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313aeef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488a2 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471533:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8400) 00010000:00010000:2.0:1788876701.471539:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876701.471562:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471583:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471592:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471623:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471632:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471639:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471739:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471747:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471755:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471942:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471952:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471960:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471971:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471977:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.471984:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472003:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876701.472018:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472024:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472030:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472036:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876701.472041:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472048:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472056:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10b:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:2.0:1788876701.472059:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876701.472063:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472073:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313aef27 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472087:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472093:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472098:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472103:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876701.472106:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472112:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472119:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8200) 00010000:00010000:2.0:1788876701.472121:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876701.472124:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472129:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313aef19 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876701.472140:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009012657e reply state 00000000358f33a9 transno 73014444035 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472150:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472157:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fa4b8c00) 00010000:00010000:2.0:1788876701.472159:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876701.472161:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876701.472230:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35454:x1875771511248896:12345-192.168.203.11@tcp:36:rm.0 Request processed in 828us (2415us total) trans 73014444035 rc 0/0 00000100:00100000:2.0:1788876701.472237:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2464 00010000:00010000:2.0:1788876701.472265:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876701.472270:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472277:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876701.472280:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472287:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472296:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10b:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:2.0:1788876701.472298:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876701.472301:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472308:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313aef2e lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x10b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876701.472320:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876701.472322:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876701.472324:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876701.549754:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876702.194900:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876702.194922:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532324992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876702.194992:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.195054:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532324992 00000100:00100000:2.0:1788876702.195061:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532324992 00000100:00100000:2.0:1788876702.195107:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1788876702.195115:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532324992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876702.195136:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876702.195176:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532324992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.195183:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00080000:2.0:1788876702.195202:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876702.195237:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532324992:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876702.571392:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876702.696982:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876702.697005:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532325120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876702.697083:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.697163:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325120 00000100:00100000:0.0:1788876702.697171:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325120 00000100:00100000:0.0:1788876702.697218:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1788876702.697226:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532325120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876702.697262:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876702.697306:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532325120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.697314:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1788876702.697360:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532325120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876702.697921:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876702.697932:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532325248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876702.697972:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.698010:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325248 00000100:00100000:2.0:1788876702.698014:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325248 00000100:00100000:2.0:1788876702.698045:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788876702.698053:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532325248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876702.698073:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00010000:00000080:2.0:1788876702.698086:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7874000 x1875771532325248/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:98/0 lens 224/368 e 0 to 0 dl 1788876713 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876702.698119:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532325248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.698126:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788876702.698169:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532325248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876702.711362:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532325632:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711520:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532325376:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711564:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.711598:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532325888:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711647:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.711679:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326400:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711703:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.711728:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788876702.711733:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532325760:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711761:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.711779:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326272:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711799:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876702.711829:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325376 00000100:00100000:2.0:1788876702.711836:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325376 00000100:00100000:2.0:1788876702.711888:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788876702.711896:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532325376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.711954:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532325376:12345-0@lo:400:kworker.0 Request processed in 57us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.711962:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788876702.711999:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325888 00000100:00100000:2.0:1788876702.712003:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325888 00000100:00100000:2.0:1788876702.712034:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325760 00000100:00100000:2.0:1788876702.712037:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325760 00000100:00100000:2.0:1788876702.712054:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:2.0:1788876702.712060:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532325888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712091:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532325888:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.712098:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:2.0:1788876702.712110:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788876702.712116:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532325760:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876702.712128:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13d3024e00 x1875771532325760/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:98/0 lens 224/224 e 0 to 0 dl 1788876713 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876702.712153:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532325760:12345-0@lo:400:kworker.0 Request processed in 38us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.712158:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788876702.712176:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326400 00000100:00100000:2.0:1788876702.712180:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326400 00000100:00100000:2.0:1788876702.712204:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326272 00000100:00100000:2.0:1788876702.712208:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326272 00000100:00100000:2.0:1788876702.712225:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788876702.712231:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712260:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326400:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.712265:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788876702.712276:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788876702.712281:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712305:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326272:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876702.712311:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00080000:2.0:1788876702.712335:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876702.712339:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876702.712341:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876702.712343:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876702.712765:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532325760:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712780:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326272:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712790:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532325376:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712798:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532325888:0@lo:400:kworker.0 00000100:00100000:2.0:1788876702.712807:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326400:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.712997:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.713027:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532326144:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713054:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.713076:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788876702.713082:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713103:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.713119:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532326016:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713139:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.713156:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532326528:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713175:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876702.713200:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325632 00000100:00100000:0.0:1788876702.713204:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325632 00000100:00100000:0.0:1788876702.713242:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1788876702.713249:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532325632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713287:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532325632:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.713294:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1788876702.713311:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326144 00000100:00100000:0.0:1788876702.713314:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326144 00000100:00100000:0.0:1788876702.713338:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532325504 00000100:00100000:0.0:1788876702.713341:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532325504 00000100:00100000:0.0:1788876702.713351:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326016 00000100:00100000:0.0:1788876702.713353:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326016 00000100:00100000:0.0:1788876702.713363:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326528 00000100:00100000:0.0:1788876702.713366:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326528 00000100:00100000:0.0:1788876702.713494:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1788876702.713567:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532326144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.713752:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532326144:12345-0@lo:400:kworker.0 Request processed in 249us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.713759:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1788876702.713773:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1788876702.713780:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532325504:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876702.713793:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb25b480 x1875771532325504/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:98/0 lens 224/224 e 0 to 0 dl 1788876713 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876702.713821:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532325504:12345-0@lo:400:kworker.0 Request processed in 42us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.713827:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1788876702.713840:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:0.0:1788876702.713846:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532326016:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876702.713856:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb259500 x1875771532326016/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:98/0 lens 224/224 e 0 to 0 dl 1788876713 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876702.713880:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532326016:12345-0@lo:400:kworker.0 Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.713886:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:0.0:1788876702.713897:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:0.0:1788876702.713903:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532326528:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876702.713914:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb25a680 x1875771532326528/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:98/0 lens 224/224 e 0 to 0 dl 1788876713 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876702.713938:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532326528:12345-0@lo:400:kworker.0 Request processed in 35us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876702.713944:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00080000:0.0:1788876702.713972:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876702.713976:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876702.713979:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876702.714012:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.714022:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532326016:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.714032:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532326528:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.714043:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532325632:0@lo:400:kworker.0 00000100:00100000:0.0:1788876702.714053:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532326144:0@lo:400:kworker.0 00000100:00100000:3.0:1788876703.209892:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876703.209912:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876703.209943:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876703.210102:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876703.210111:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532326912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876703.215562:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876703.216323:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326656 00000100:00100000:0.0:1788876703.216334:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326656 00000100:00100000:0.0:1788876703.216459:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1788876703.216470:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532326656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876703.216575:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876703.216722:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532326656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.216730:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1788876703.216778:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876703.220149:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876703.220216:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326784 00000100:00100000:0.0:1788876703.220225:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326784 00000100:00100000:0.0:1788876703.220279:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1788876703.220289:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876703.220321:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876703.220395:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532326784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.220403:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:0.0:1788876703.221748:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876703.221789:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532326912 00000100:00100000:0.0:1788876703.221796:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532326912 00000100:00100000:0.0:1788876703.221836:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1788876703.221844:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532326912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876703.221865:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876703.221903:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532326912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.221909:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1788876703.221956:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532326912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876703.222253:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876703.409403:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876703.409463:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876703.409523:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876703.409561:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876703.409654:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876703.409695:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249536 00000100:00100000:0.0:1788876703.409703:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249536 00000100:00100000:0.0:1788876703.409754:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249408 00000100:00100000:0.0:1788876703.409757:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249408 00000100:00100000:0.0:1788876703.409779:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1206 00000100:00100000:0.0:1788876703.409788:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511249536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876703.409855:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511249536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.409862:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1206 00000100:00100000:0.0:1788876703.409878:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1207 00000100:00100000:0.0:1788876703.409884:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511249408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876703.409904:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511249408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.409909:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1207 00000100:00100000:0.0:1788876703.409926:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249280 00000100:00100000:0.0:1788876703.409928:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249280 00000100:00100000:0.0:1788876703.409952:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1634 00000100:00100000:0.0:1788876703.409958:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511249280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876703.409980:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511249280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.409985:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1634 00000100:00100000:0.0:1788876703.409993:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249152 00000100:00100000:0.0:1788876703.409995:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249152 00000100:00100000:0.0:1788876703.410012:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1635 00000100:00100000:0.0:1788876703.410017:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+12:2398:x1875771511249152:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:0.0:1788876703.410032:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb25ad80 x1875771511249152/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:99/0 lens 224/224 e 0 to 0 dl 1788876714 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876703.410051:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+12:2398:x1875771511249152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876703.410057:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1635 00000100:00080000:0.0:1788876703.410072:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876703.410076:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876703.410078:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876703.410079:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876703.410521:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249024 00000100:00100000:3.0:1788876703.410526:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249024 00000100:00100000:3.0:1788876703.410563:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1788876703.410570:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511249024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876703.410625:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511249024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 56us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876703.410632:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00010000:00010000:1.0:1788876703.592929:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876704.625384:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876705.640962:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876706.673899:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876707.310387:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532327040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876707.310451:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.310519:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327040 00000100:00100000:2.0:1788876707.310528:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327040 00000100:00100000:2.0:1788876707.310580:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1788876707.310589:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532327040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876707.310642:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876707.311744:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532327040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1151us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.311755:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:2.0:1788876707.311789:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876707.312162:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532327040:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788876707.313141:0:45277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 73014444035 is committed 00010000:00010000:1.0:1788876707.313192:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313204:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313212:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313218:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876707.313223:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313230:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313247:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fa4b8c00) 00010000:00010000:1.0:1788876707.313250:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876707.313254:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313260:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313aeee8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313275:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313282:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313288:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313293:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876707.313295:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313300:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313307:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fa4b8c00) 00010000:00010000:1.0:1788876707.313309:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876707.313312:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.313317:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313aef20 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876707.690580:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876707.817227:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532327168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876707.817294:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.817363:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327168 00000100:00100000:2.0:1788876707.817370:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327168 00000100:00100000:2.0:1788876707.817411:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1788876707.817419:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532327168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876707.817450:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00010000:00000080:2.0:1788876707.817466:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c5591f80 x1875771532327168/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:103/0 lens 224/368 e 0 to 0 dl 1788876718 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876707.817503:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532327168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.817510:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1788876707.817552:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532327168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876707.818921:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876707.818941:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532327296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876707.818994:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876707.819085:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327296 00000100:00100000:1.0:1788876707.819091:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327296 00000100:00100000:1.0:1788876707.819131:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1788876707.819140:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532327296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876707.819166:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876707.819217:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532327296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876707.819227:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1788876707.819446:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532327552:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.819483:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.819505:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532328064:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.819530:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.819545:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532328576:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.819566:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.819585:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788876707.819620:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532327680:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.819651:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.819668:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532328192:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.819686:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876707.819713:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327552 00000100:00100000:2.0:1788876707.819718:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327552 00000100:00100000:2.0:1788876707.819744:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328064 00000100:00100000:2.0:1788876707.819747:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328064 00000100:00100000:2.0:1788876707.819771:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328576 00000100:00100000:2.0:1788876707.819777:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328576 00000100:00100000:2.0:1788876707.819787:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328192 00000100:00100000:2.0:1788876707.819789:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328192 00000100:00100000:2.0:1788876707.819802:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1788876707.819811:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532327552:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876707.819832:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c47e9880 x1875771532327552/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788876718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876707.819868:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532327552:12345-0@lo:400:kworker.0 Request processed in 56us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.819874:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1788876707.819890:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:2.0:1788876707.819896:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532328064:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876707.819907:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c47e9500 x1875771532328064/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788876718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876707.819932:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532328064:12345-0@lo:400:kworker.0 Request processed in 36us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.819942:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:2.0:1788876707.819954:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1788876707.819959:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532328576:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876707.819971:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c47eb480 x1875771532328576/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788876718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876707.819997:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532328576:12345-0@lo:400:kworker.0 Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.820003:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1788876707.820012:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:2.0:1788876707.820021:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532328192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.820050:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532328192:12345-0@lo:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.820055:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00080000:2.0:1788876707.820085:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876707.820090:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876707.820113:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532328192:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.820123:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532327552:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.820131:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532328064:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.820139:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532328576:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820501:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327680 00000100:00100000:3.0:1788876707.820506:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327680 00000100:00100000:3.0:1788876707.820558:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788876707.820568:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532327680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820643:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532327680:12345-0@lo:400:kworker.0 Request processed in 78us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876707.820648:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788876707.820672:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532327424:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820702:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876707.820726:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532327936:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820750:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876707.820766:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532328448:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820785:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876707.820817:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532327296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876707.820831:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788876707.820837:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532327808:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820856:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876707.820869:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532328320:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.820891:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876707.820915:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328448 00000100:00100000:3.0:1788876707.820919:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328448 00000100:00100000:3.0:1788876707.820941:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328320 00000100:00100000:3.0:1788876707.820944:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328320 00000100:00100000:3.0:1788876707.820960:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788876707.820966:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532328448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.821003:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532328448:12345-0@lo:400:kworker.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876707.821009:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1788876707.821022:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788876707.821028:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532328320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.821055:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532328320:12345-0@lo:400:kworker.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876707.821063:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788876707.821094:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532328320:0@lo:400:kworker.0 00000100:00100000:3.0:1788876707.821103:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532328448:0@lo:400:kworker.0 00000100:00080000:2.0:1788876707.822865:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876707.822873:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876707.822909:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532327680:0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.822944:0:45284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327424 00000100:00100000:2.0:1788876707.822949:0:45284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327424 00000100:00100000:2.0:1788876707.822982:0:45284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876707.822990:0:45284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532327424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.823064:0:45284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532327424:12345-0@lo:400:kworker.0 Request processed in 74us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.823071:0:45284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876707.823101:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327936 00000100:00100000:2.0:1788876707.823104:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327936 00000100:00100000:2.0:1788876707.823134:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532327808 00000100:00100000:2.0:1788876707.823137:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532327808 00000100:00100000:2.0:1788876707.823156:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1788876707.823162:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876707.823196:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532327936:12345-0@lo:400:kworker.0 Request processed in 34us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.823201:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1788876707.823213:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:2.0:1788876707.823218:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532327808:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876707.823230:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eeed6a00 x1875771532327808/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:103/0 lens 224/224 e 0 to 0 dl 1788876718 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876707.823256:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532327808:12345-0@lo:400:kworker.0 Request processed in 38us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876707.823262:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00080000:2.0:1788876707.823284:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876707.823287:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876707.823342:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532327808:0@lo:400:kworker.0 00000100:00100000:1.0:1788876707.823352:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532327424:0@lo:400:kworker.0 00000100:00100000:1.0:1788876707.823361:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532327936:0@lo:400:kworker.0 00000001:02000400:1.0:1788876708.182522:0:46498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788876708.302027:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876708.302121:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249664 00000100:00100000:2.0:1788876708.302132:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249664 00000100:00100000:2.0:1788876708.302206:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2465 00000100:00100000:2.0:1788876708.302216:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35522:x1875771511249664:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876708.302236:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876708.302259:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313aef35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488b0 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.302324:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788876708.302421:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788876708.302448:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.302473:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876708.302517:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876708.302521:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876708.302537:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.302566:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313aef35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b0 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.302583:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b0 expref: 9 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.302592:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:2.0:1788876708.302637:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876708.302641:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72400, rc 0) 00010000:00000080:2.0:1788876708.302649:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb25e300 x1875771511249664/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 576/688 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876708.302713:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35522:x1875771511249664:12345-192.168.203.11@tcp:101:rm.0 Request processed in 498us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876708.302721:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2465 00000100:00100000:3.0:1788876708.306088:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876708.306161:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511249792 00000100:00100000:0.0:1788876708.306171:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511249792 00000100:00100000:0.0:1788876708.306226:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2466 00000100:00100000:0.0:1788876708.306236:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:35522:x1875771511249792:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876708.306254:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876708.306273:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313aef43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488b7 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306333:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306358:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306370:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306384:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306391:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306402:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306485:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306494:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306501:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876708.306540:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10a:0x0]: returning size 4096 00000004:00200000:0.0:1788876708.306544:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876708.306562:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306574:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306581:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306588:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306630:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876708.306635:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306644:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306656:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:0.0:1788876708.306659:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876708.306663:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306670:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306682:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306687:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306693:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306698:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876708.306701:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306707:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306715:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13ff5bb000) 00010000:00010000:0.0:1788876708.306717:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876708.306720:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306726:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306756:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313aef43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b7 expref: 11 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306769:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b7 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.306776:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13ff5bb800) 00010000:00010000:0.0:1788876708.306778:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876708.306780:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fad52600, rc 0) 00010000:00000080:0.0:1788876708.306788:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb29d880 x1875771511249792/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 592/688 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876708.306843:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:35522:x1875771511249792:12345-192.168.203.11@tcp:101:rm.0 Request processed in 609us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876708.306851:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2466 00000100:00100000:3.0:1788876708.315919:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876708.317260:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250048 00000100:00100000:2.0:1788876708.317274:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250048 00000100:00100000:2.0:1788876708.317340:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2467 00000100:00100000:2.0:1788876708.317349:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:35522:x1875771511250048:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876708.317370:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876708.317391:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313aef5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488be expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876708.317484:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10a:0x0]: returning size 4096 00010000:00010000:2.0:1788876708.317580:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313aef5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488be expref: 12 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.317618:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:2.0:1788876708.317630:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788876708.317636:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313aef5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488be expref: 12 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876708.317649:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73800, rc 0) 00010000:00000080:2.0:1788876708.317656:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4036300 x1875771511250048/t73014444036(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 648/664 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/600/0 rc 301/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876708.318136:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35522:x1875771511250048:12345-192.168.203.11@tcp:101:rm.0 Request processed in 787us (2226us total) trans 73014444036 rc 301/301 00000100:00100000:2.0:1788876708.318145:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2467 00000100:00100000:1.0:1788876708.329004:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876708.329029:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532328704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876708.329102:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876708.329188:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328704 00000100:00100000:3.0:1788876708.329196:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328704 00000100:00100000:3.0:1788876708.329247:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1788876708.329256:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532328704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876708.329276:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876708.329318:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532328704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876708.329328:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1788876708.329383:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532328704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876708.329586:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532328960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876708.329809:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876708.329835:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532328832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876708.329856:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876708.329885:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328960 00000100:00100000:1.0:1788876708.329889:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328960 00000100:00100000:1.0:1788876708.329910:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532328832 00000100:00100000:1.0:1788876708.329912:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532328832 00000100:00100000:1.0:1788876708.329928:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1788876708.329934:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532328960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876708.329953:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876708.329983:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532328960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876708.329989:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1788876708.330000:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1788876708.330005:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532328832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876708.330016:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876708.330036:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532328832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876708.330041:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1788876708.330067:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532328960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876708.330078:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532328832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876708.331693:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876708.331844:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250176 00000100:00100000:1.0:1788876708.331853:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250176 00000100:00100000:1.0:1788876708.331895:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 737 00000100:00100000:1.0:1788876708.331904:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35522:x1875771511250176:12345-192.168.203.11@tcp:37:rm.0 00010000:00000080:1.0:1788876708.341267:0:6542:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c47e8e00 x1875771511250176/t0(0) o37->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 448/440 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788876708.341474:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35522:x1875771511250176:12345-192.168.203.11@tcp:37:rm.0 Request processed in 9569us (9785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876708.341484:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 737 00000100:00100000:1.0:1788876708.357972:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876708.358262:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250432 00000100:00100000:2.0:1788876708.358271:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250432 00000100:00100000:2.0:1788876708.358321:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 738 00000100:00100000:2.0:1788876708.358330:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:35522:x1875771511250432:12345-192.168.203.11@tcp:35:rm.0 00010000:00000080:2.0:1788876708.358486:0:43649:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7978000 x1875771511250432/t73014444037(0) o35->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 392/456 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876708.358552:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35522:x1875771511250432:12345-192.168.203.11@tcp:35:rm.0 Request processed in 223us (590us total) trans 73014444037 rc 0/0 00000100:00100000:2.0:1788876708.358560:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 738 00000100:00100000:2.0:1788876708.370176:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876708.370285:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250688 00000100:00100000:0.0:1788876708.370295:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250688 00000100:00100000:0.0:1788876708.370350:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2468 00000100:00100000:0.0:1788876708.370360:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35522:x1875771511250688:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876708.370412:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876708.370437:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313aef58 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b7 expref: 12 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370452:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13ff5bb800) 00010000:00010000:0.0:1788876708.370467:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313aef3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488b0 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370481:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4b8600) 00010000:00010000:0.0:1788876708.370487:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876708.370507:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370519:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370527:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370537:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370544:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370551:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370688:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370697:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370704:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876708.370920:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10a:0x0]: returning size 4096 00010000:00010000:0.0:1788876708.370934:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370942:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370949:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370955:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876708.370959:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370967:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370976:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13ff5bbe00) 00010000:00010000:0.0:1788876708.370979:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876708.370982:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.370988:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313aef7b lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371004:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371010:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371016:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371021:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876708.371024:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371030:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371038:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ff5bb000) 00010000:00010000:0.0:1788876708.371040:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876708.371043:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371049:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53400/0xf5bf0f7e313aef6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876708.371060:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000196e8e0e reply state 000000001721aa31 transno 73014444038 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371070:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876708.371076:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13ff5bbf00) 00010000:00010000:0.0:1788876708.371078:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876708.371081:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788876708.371229:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c47ebb80 x1875771511250688/t73014444038(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:104/0 lens 504/456 e 0 to 0 dl 1788876719 ref 1 fl Interpret:/200/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876708.371425:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+12:35522:x1875771511250688:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1066us (1256us total) trans 73014444038 rc 0/0 00000100:00100000:0.0:1788876708.371434:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2468 00000100:00100000:3.0:1788876708.524929:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876708.524991:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876708.525076:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876708.525113:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876708.525170:0:45282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250816 00000100:00100000:0.0:1788876708.525180:0:45282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250816 00000100:00100000:0.0:1788876708.525230:0:45282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:0.0:1788876708.525240:0:45282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511250816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876708.525310:0:45282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511250816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876708.525318:0:45282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1788876708.525528:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250944 00000100:00100000:1.0:1788876708.525532:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250944 00000100:00100000:1.0:1788876708.525584:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1642 00000100:00100000:1.0:1788876708.525592:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511250944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876708.525673:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511250944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876708.525680:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1642 00000100:00080000:0.0:1788876708.525992:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876708.531274:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251072 00000100:00100000:2.0:1788876708.531291:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251072 00000100:00100000:0.0:1788876708.534781:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251200 00000100:00100000:0.0:1788876708.534797:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251200 00000100:00100000:0.0:1788876708.534829:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1211 00000100:00100000:0.0:1788876708.534839:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511251072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876708.534931:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511251072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876708.534939:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1211 00000100:00100000:0.0:1788876708.534958:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1212 00000100:00100000:0.0:1788876708.534965:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511251200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876708.534989:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511251200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (9876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876708.534995:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1212 00000100:00080000:2.0:1788876708.535321:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876708.535326:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876708.723431:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876709.744048:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788876710.574900:0:46595:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788876710.574975:0:46595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.574994:0:46595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.575002:0:46595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.575009:0:46595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.575066:0:46595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788876710.575073:0:46595:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788876710.575102:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876710.575107:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788876710.575113:0:46595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788876710.575144:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ab000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788876710.575294:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532329088:0@lo:39:umount.0 00000100:00100000:2.0:1788876710.575385:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876710.575573:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329088 00000100:00100000:3.0:1788876710.575583:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329088 00000100:00100000:3.0:1788876710.575676:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:3.0:1788876710.575688:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532329088:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788876710.575725:0:8722:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aec64 00000100:00080000:3.0:1788876710.575742:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13c72a5000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788876710.575902:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876710.575912:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.575922:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876710.575926:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.575937:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876710.575946:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876710.575953:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788876710.575956:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788876710.575959:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788876710.576001:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.576007:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876710.576027:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.576034:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313aeb53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb5a expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.576048:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.576050:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.576052:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876710.576061:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876710.576074:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876710.576116:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876710.576205:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329216 00000100:00100000:2.0:1788876710.576210:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329216 00000100:00100000:2.0:1788876710.576261:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788876710.576269:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532329216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876710.576283:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876710.576302:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313aeb5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb53 expref: 24 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.576317:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876710.576360:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532329216:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876710.576368:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788876710.576409:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329216:0@lo:103:ldlm_bl.0 00010000:00000080:2.0:1788876710.577544:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac00e00 x1875771532329088/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:106/0 lens 224/224 e 0 to 0 dl 1788876721 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876710.577648:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532329088:12345-0@lo:39:umount.0 Request processed in 1961us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876710.577657:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000020:00000080:2.0:1788876710.577670:0:8722:0:(genops.c:885:class_export_put()) final put ffff8a13c72a2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788876710.577754:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c72a2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876710.577816:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c72a5000 for lustre-MDT0000 00000100:00080000:3.0:1788876710.578169:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788876710.578191:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532329088:0@lo:39:umount.0 00000100:00080000:2.0:1788876710.578313:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876710.578318:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788876710.578324:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788876710.579807:0:46595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.579832:0:46595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.579840:0:46595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.579847:0:46595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.579912:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876710.579923:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.579931:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876710.579936:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.579945:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876710.579953:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876710.579959:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788876710.579962:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788876710.580006:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.580014:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876710.580055:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876710.580197:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532329344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876710.580288:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876710.580366:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329344 00000100:00100000:3.0:1788876710.580374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329344 00000100:00100000:3.0:1788876710.580428:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788876710.580438:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3664:x1875771532329344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876710.580453:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876710.580471:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae35c00/0xf5bf0f7e313aea6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aea65 expref: 23 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.580489:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876710.580527:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3664:x1875771532329344:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876710.580534:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788876710.580641:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532329344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876710.580818:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.580820:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.580822:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876710.580897:0:46595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788876710.580903:0:46595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313aea65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea6c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.580918:0:46595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.580926:0:46595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.580933:0:46595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.580940:0:46595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.580968:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876710.580974:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.580982:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876710.580985:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.580993:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876710.581000:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876710.581006:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788876710.581008:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788876710.581028:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581034:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876710.581057:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581066:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.581067:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.581069:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876710.581108:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532329472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876710.581144:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876710.581218:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329472 00000100:00100000:1.0:1788876710.581223:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329472 00000100:00100000:1.0:1788876710.581311:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788876710.581319:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3665:x1875771532329472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876710.581329:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876710.581340:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313aeb99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb92 expref: 22 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581355:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876710.581392:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3665:x1875771532329472:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876710.581399:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788876710.581426:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532329472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876710.581551:0:46595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788876710.581558:0:46595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313aeb92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb99 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876710.581573:0:46595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788876710.581582:0:46595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.581590:0:46595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.581597:0:46595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.581631:0:46595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581731:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876710.581737:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581744:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876710.581748:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581755:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876710.581762:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876710.581768:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788876710.581770:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788876710.581783:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.581789:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788876710.581827:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876710.581855:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876710.581922:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329600 00000100:00100000:0.0:1788876710.581927:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329600 00000100:00100000:0.0:1788876710.581957:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788876710.581967:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3662:x1875771532329600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876710.581977:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876710.581989:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae35a00/0xf5bf0f7e313aeb4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aeb45 expref: 21 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876710.581999:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876710.582042:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.582050:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.582052:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.582054:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876710.582094:0:46595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788876710.582099:0:46595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313aeb45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aeb4c expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876710.582108:0:46595:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788876710.582118:0:46595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.582125:0:46595:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.582132:0:46595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.582139:0:46595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.582154:0:46595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788876710.582157:0:46595:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788876710.582161:0:46595:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788876710.582317:0:46595:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788876710.582323:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788876710.582328:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788876710.582335:0:46595:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1788876710.583581:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876710.583591:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.583628:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876710.583632:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.583643:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876710.583650:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876710.583657:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788876710.583659:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788876710.583662:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788876710.583704:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.583710:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00000080:2.0:1788876710.584661:0:46595:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788876710.585130:0:45277:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 73014444038 is committed 00010000:00010000:2.0:1788876710.585164:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585175:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585183:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585189:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876710.585194:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585202:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585222:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13ff5bbf00) 00010000:00010000:2.0:1788876710.585226:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876710.585231:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.585237:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313aef74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876710.585564:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3662:x1875771532329600:12345-0@lo:103:ldlm_bl.0 Request processed in 3593us (3701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876710.585577:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000020:00000080:2.0:1788876710.585827:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788876710.585835:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0608000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876710.585842:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13f07ad000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876710.585846:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13f07ac000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876710.585854:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0f60800 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 73014444038 stale:0 00000020:00080000:2.0:1788876710.585858:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d15b8800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788876710.585863:0:46595:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c22ecd40) has exports, disconnecting them 00000020:00080000:2.0:1788876710.585868:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d0608000), last request at 1788876707 00000020:00000080:2.0:1788876710.585876:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aec6b 00000100:00080000:2.0:1788876710.585887:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13d060f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.585913:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d0608000): rc 0 00000020:00000080:2.0:1788876710.585915:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13d0608000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788876710.585928:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13f07ad000), last request at 1788876707 00000020:00000080:2.0:1788876710.585931:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aec5d 00000100:00080000:2.0:1788876710.585935:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13f07aa000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.585941:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f07ad000): rc 0 00000020:00000080:2.0:1788876710.585943:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13f07ad000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788876710.585946:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13f07ac000), last request at 1788876677 00000020:00000080:2.0:1788876710.585949:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aec56 00000100:00080000:2.0:1788876710.585952:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ae000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.585956:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f07ac000): rc 0 00000020:00000080:2.0:1788876710.585958:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13f07ac000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788876710.585962:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13d0f60800), last request at 1788876708 00000020:00000080:2.0:1788876710.585970:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeac0 00000020:00010000:2.0:1788876710.585982:0:46595:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13d0f60800: total 3 00000100:00080000:2.0:1788876710.585985:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.586025:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13d0f60800): rc 0 00000020:00080000:2.0:1788876710.586028:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d15b8800), last request at 1788876671 00000020:00000080:2.0:1788876710.586031:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeab9 00000100:00080000:2.0:1788876710.586036:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7bf000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.586041:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d15b8800): rc 0 00000020:00000080:2.0:1788876710.586043:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13d15b8800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1788876710.586050:0:46595:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa62081ff3ae0 00000100:00080000:2.0:1788876710.586072:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876710.586076:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788876710.586422:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.586433:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960600/0xf5bf0f7e313aea57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aea5e expref: -99 pid: 45276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788876710.586447:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13d0f60800: total 4 00010000:00010000:1.0:1788876710.586499:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13d0f60800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788876710.586531:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe52c00/0xf5bf0f7e313aeea2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x109:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704888d expref: 3 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.586552:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13cfe53600/0xf5bf0f7e313aee86 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x107:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048886 expref: 2 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876710.586568:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13d0f60800, canceled 2 locks, left on hash table 0. 00000100:00080000:2.0:1788876710.588133:0:46595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788876710.588176:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788876710.589457:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532329856:0@lo:39:umount.0 00000100:00100000:2.0:1788876710.589548:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876710.589639:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329856 00000100:00100000:2.0:1788876710.589649:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329856 00000100:00100000:2.0:1788876710.589710:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1788876710.589720:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532329856:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788876710.589754:0:13623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb06 00000100:00080000:2.0:1788876710.589764:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a12c2590000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876710.589783:0:13623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967323 00000100:00100000:2.0:1788876710.589950:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532329856:12345-0@lo:39:umount.0 Request processed in 231us (401us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788876710.589957:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00080000:2.0:1788876710.590006:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876710.590016:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532329856:0@lo:39:umount.0 00000100:00100000:3.0:1788876710.590156:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876710.590178:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876710.590187:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876710.590221:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788876710.591525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0608000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876710.591629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ad000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876710.591659:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ac000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876710.591683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d15b8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876710.591715:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d060f800 for lustre-MDT0000 00000020:00000080:0.0:1788876710.591721:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07aa000 for lustre-MDT0000 00000020:00000080:0.0:1788876710.591724:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07ae000 for lustre-MDT0000 00000020:00000080:0.0:1788876710.591727:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fa7bf000 for lustre-MDT0000 00000100:00100000:2.0:1788876710.591844:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329728 00000100:00100000:2.0:1788876710.591855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329728 00000100:00100000:2.0:1788876710.591918:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788876710.591928:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3662:x1875771532329728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876710.591946:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876710.591969:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe53a00/0xf5bf0f7e313aea5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aea57 expref: 20 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876710.591988:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876710.592059:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3662:x1875771532329728:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876710.592066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788876710.592159:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876710.592164:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934857 gen 3 00000100:00100000:3.0:1788876710.592526:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532329728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876710.592681:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788876710.593310:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788876710.593443:0:46595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788876710.594226:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13fd3b4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788876710.594429:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532329984:0@lo:9:umount.0 00000100:00100000:3.0:1788876710.594508:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876710.594591:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532329984 00000100:00100000:0.0:1788876710.594627:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532329984 00000100:00100000:0.0:1788876710.594694:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1788876710.594703:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532329984:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788876710.594731:0:43964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb14 00000100:00080000:0.0:1788876710.594741:0:43964:0:(import.c:65:import_set_state_nolock()) ffff8a13efedb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788876710.594792:0:43964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934857 00000100:00080000:2.0:1788876710.594987:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876710.594991:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967565 gen 3 00000004:00080000:2.0:1788876710.595003:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788876710.595060:0:46595:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788876710.595080:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788876710.595130:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532330112:0@lo:9:umount.0 00000100:00100000:3.0:1788876710.595162:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876710.595354:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532329984:12345-0@lo:9:umount.0 Request processed in 651us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876710.595363:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1788876710.595379:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330112 00000100:00100000:0.0:1788876710.595383:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330112 00000100:00100000:0.0:1788876710.595411:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788876710.595417:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532330112:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788876710.595430:0:43964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb37 00000100:00080000:0.0:1788876710.595435:0:43964:0:(import.c:65:import_set_state_nolock()) ffff8a13d212d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788876710.595455:0:43964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967565 00000100:00100000:0.0:1788876710.595539:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532330112:12345-0@lo:9:umount.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876710.595545:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00080000:0.0:1788876710.595565:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876710.595569:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876710.597399:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788876710.598412:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c22ecd40) has no exports 00000020:00080000:2.0:1788876710.598991:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c22ecd40) has no exports 00000100:00080000:3.0:1788876710.601756:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13fd3b4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788876710.601776:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788876710.601779:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876710.601787:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532329984:0@lo:9:umount.0 00000100:00080000:3.0:1788876710.601833:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788876710.601838:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788876710.601839:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876710.601842:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532330112:0@lo:9:umount.0 00010000:00010000:3.0:1788876710.601886:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788876710.623997:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13d0f60800/f0204769-56bd-4f5c-ab97-74c450c9e072 00010000:00010000:1.0:1788876710.624079:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.624082:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876710.624084:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788876710.624112:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0f60800/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:3.0:1788876710.624234:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5f9d000 for lustre-MDT0000 00000020:00000080:2.0:1788876710.655759:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aead5 00000020:00000080:2.0:1788876710.655781:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c36e4800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788876710.655805:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788876710.655946:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c36e4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788876710.655979:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876710.655989:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788876710.655994:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a12c201b380) has no exports 00000020:00000080:3.0:1788876710.656701:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeace 00000020:00000080:3.0:1788876710.656710:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c22f4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876710.656764:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c22f4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788876710.656782:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876710.656791:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876710.656795:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13efede800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788876710.656797:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13efede800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788876710.656803:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788876710.656945:0:46595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cff91a80 - data ffff8a12c1ca4bd0/ffff8a12c5e0b800 00000020:01000000:3.0:1788876710.657108:0:46595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efc54cc0 - data ffff8a12c1c066c0/ffff8a12c3589000 00000100:00080000:0.0:1788876710.718914:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788876710.718923:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788876710.718938:0:46595:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13fae32d80 x1875771532329856/t4294967324(4294967324) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876720 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876710.718966:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788876710.721134:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788876710.721141:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934857 gen 4 00000004:00080000:0.0:1788876710.721161:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788876710.721163:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788876710.721475:0:45294:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788876710.721480:0:45294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x44:0x0] index 1 count 1 00000040:00080000:2.0:1788876710.721493:0:45294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 17 count 2 00000100:00080000:0.0:1788876710.722328:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788876710.722332:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967565 gen 4 00000004:00080000:0.0:1788876710.722350:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788876710.722352:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788876710.723292:0:45296:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788876710.723298:0:45296:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x46:0x0] index 1 count 1 00000040:00080000:2.0:1788876710.723308:0:45296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 17 count 2 00000020:00000080:0.0:1788876710.724433:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea81 00000020:00000080:0.0:1788876710.724445:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13fd3b5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876710.724701:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fd3b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788876710.725461:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea96 00000020:00000080:0.0:1788876710.725469:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c3409800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788876710.725525:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788876710.725531:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876710.725539:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788876710.725544:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c22e99c0) has no exports 00000004:01000000:0.0:1788876710.725738:0:46595:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788876710.725745:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb29 00000020:00000080:0.0:1788876710.725750:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13ff366800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876710.726330:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c3409800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788876710.726378:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788876710.726383:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876710.726391:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788876710.726394:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c25e8000) has no exports 00000020:00000080:0.0:1788876710.726401:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb22 00000020:00000080:0.0:1788876710.726406:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13ef170000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876710.726673:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff366800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788876710.726680:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef170000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788876710.726955:0:46595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788876710.726960:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788876710.726965:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967565 gen 5 00000004:00080000:0.0:1788876710.726972:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788876710.726974:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876710.727019:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876710.727027:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876710.727033:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb0d 00000020:00000080:0.0:1788876710.727037:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13ff361000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788876710.727041:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788876710.727044:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876710.727048:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788876710.727050:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c25eb380) has no exports 00000020:00000080:0.0:1788876710.727054:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeaff 00000020:00000080:0.0:1788876710.727057:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13fd3b0800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788876710.727414:0:46595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788876710.727417:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788876710.727419:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934857 gen 5 00000004:00080000:0.0:1788876710.727422:0:46595:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788876710.727423:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876710.727445:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876710.727450:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788876710.727459:0:46595:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788876710.727463:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeaf1 00000020:00000080:0.0:1788876710.727467:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13ff367800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788876710.727470:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788876710.727473:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876710.727475:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788876710.727477:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a13f5270000) has no exports 00000020:00000080:0.0:1788876710.727481:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeae3 00000020:00000080:0.0:1788876710.727483:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c340a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876710.727677:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ef173800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788876710.727685:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13ff364800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876710.727687:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff364800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788876710.727691:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876710.727762:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff361000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788876710.727767:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fd3b0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788876710.727771:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fd3b4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788876710.727774:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13ff367000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876710.727777:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff367000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788876710.727780:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876710.727805:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff367800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788876710.727808:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788876710.728659:0:46595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788876710.728664:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876710.728667:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876710.728671:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876710.728704:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876710.728710:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876710.728733:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876710.728736:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876710.728740:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13c5fff000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876710.728743:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5fff000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788876710.728747:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876710.728821:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea9d 00000020:00000080:2.0:1788876710.728827:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c340d000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788876710.728831:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788876710.728834:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876710.728838:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876710.728841:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a13f4538000) has no exports 00000020:00000080:2.0:1788876710.728866:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876710.728869:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788876710.728873:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeaa4 00000020:00000080:2.0:1788876710.728891:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c340c800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788876710.728898:0:46595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c62dc000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788876710.728901:0:46595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c62dc000 3 00000020:01000004:2.0:1788876710.728904:0:46595:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a12c62dc000 from lustre-MDT0000 00000020:00000080:2.0:1788876710.728928:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876710.728932:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788876710.728935:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13fd3b0000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788876710.728937:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fd3b0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788876710.728946:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788876710.728975:0:46595:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788876710.728979:0:46595:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788876710.728982:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788876710.728984:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876710.728986:0:46595:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788876710.728994:0:46595:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f35ad800 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876710.729000:0:46595:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13c486e800 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876710.729004:0:46595:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c22e8000) has exports, disconnecting them 00000020:00080000:2.0:1788876710.729008:0:46595:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13f35ad800), last request at 1788876671 00000020:00000080:2.0:1788876710.729027:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeaea 00000020:00010000:2.0:1788876710.729031:0:46595:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f35ad800: total 2 00000100:00080000:2.0:1788876710.729035:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13f35a9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.729049:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13f35ad800): rc 0 00000020:00080000:2.0:1788876710.729052:0:46595:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13c486e800), last request at 1788876671 00000020:00000080:2.0:1788876710.729089:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea50 00000020:00010000:2.0:1788876710.729092:0:46595:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13c486e800: total 2 00000100:00080000:2.0:1788876710.729094:0:46595:0:(import.c:65:import_set_state_nolock()) ffff8a13c486d000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876710.729101:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c486e800): rc 0 00000020:00080000:2.0:1788876710.729104:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c22e8000) has no exports 00000100:00100000:2.0:1788876710.729152:0:45284:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13d548f400:45284] 2 exiting: rc = 0 00000020:00010000:3.0:1788876710.729769:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f35ad800: total 2 00010000:00010000:3.0:1788876710.729774:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876710.729807:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f35ad800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1788876710.729834:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313aeb7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704886a expref: 5 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.729850:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe53800/0xf5bf0f7e313aeb8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048878 expref: 4 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.729866:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313aeb76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048863 expref: 3 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.729945:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe53400/0xf5bf0f7e313aeb84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048871 expref: 2 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.729956:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f35ad800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1788876710.729975:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13f35ad800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:3.0:1788876710.729981:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13c486e800: total 3 00010000:00010000:3.0:1788876710.729996:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13c486e800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788876710.730009:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe52600/0xf5bf0f7e313aebfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebf4 expref: 14 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730019:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313aec09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec02 expref: 13 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730032:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313aec17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec10 expref: 12 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730041:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7960800/0xf5bf0f7e313aeba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aeba0 expref: 11 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730051:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe53200/0xf5bf0f7e313aec25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec1e expref: 10 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730062:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313aebb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebae expref: 9 pid: 45287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730071:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe52e00/0xf5bf0f7e313aebc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebbc expref: 8 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730080:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34200/0xf5bf0f7e313aec41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec3a expref: 7 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730089:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae35400/0xf5bf0f7e313aebd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebca expref: 6 pid: 45282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730098:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe52a00/0xf5bf0f7e313aec33 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec2c expref: 5 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730107:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7961e00/0xf5bf0f7e313aebed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebe6 expref: 4 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730118:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13cfe53c00/0xf5bf0f7e313aec4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aec48 expref: 3 pid: 45283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730126:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313aebdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aebd8 expref: 2 pid: 45284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876710.730135:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13c486e800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788876710.730145:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13c486e800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00010000:00010000:3.0:1788876710.730150:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876710.730152:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876710.730153:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876710.730249:0:45287:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8a12c256c600:45287] 3 exiting: rc = 0 00000020:00000080:3.0:1788876710.730346:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c3408000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788876710.730352:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a12c22f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876710.730354:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c22f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788876710.730358:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876710.730393:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788876710.730398:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a12c340e800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788876710.730400:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788876710.730403:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788876710.730426:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788876710.730431:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f35ad800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:3.0:1788876710.730453:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c486e800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:3.0:1788876710.730471:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f35a9800 for MGS 00000020:00000080:3.0:1788876710.730475:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c486d000 for MGS 00010000:00010000:2.0:1788876710.761886:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876710.766775:0:45283:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13d548fe00:45283] 1 exiting: rc = 0 00000100:00100000:2.0:1788876710.766897:0:45282:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13c3b8f800:45282] 0 exiting: rc = 1 00010000:00010000:2.0:1788876710.766933:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876710.767046:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767055:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767062:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767067:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767073:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767078:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767084:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767090:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767096:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767101:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767106:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767112:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767117:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767123:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767129:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767134:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767140:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767145:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767151:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767157:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767162:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767167:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767182:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767187:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767193:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767198:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767204:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767209:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767215:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767220:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767226:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767231:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767237:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767242:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767247:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767253:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767258:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767275:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767281:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767287:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767292:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767298:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767304:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767309:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767314:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767320:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767325:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767330:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767335:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767340:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767346:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767351:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767357:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767363:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767367:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767372:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767377:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767383:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767388:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767394:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767399:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767404:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767409:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876710.767414:0:46595:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788876710.771165:0:46595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c22182a0 - data ffff8a13f03d8288/ffff8a13f5556000 00000020:01000000:3.0:1788876710.771310:0:46595:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efc54660 - data ffff8a13f0377798/ffff8a13e7b03800 00000020:00000080:3.0:1788876710.772266:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea49 00000020:00000080:3.0:1788876710.772278:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13c3004800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788876710.772301:0:46595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c62dc000 from MGS, refs=2 00000020:01000004:3.0:1788876710.772304:0:46595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c62dc000 2 00000020:01000004:3.0:1788876710.772307:0:46595:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a12c62dc000 from MGS 00000020:00000080:3.0:1788876710.772332:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876710.772338:0:46595:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788876710.772340:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13d15b9800/MGS 00000020:00000080:3.0:1788876710.772343:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d15b9800/MGS for MGS 00000020:01000000:3.0:1788876710.772350:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788876710.772416:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788876710.772420:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876710.772429:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788876710.772435:0:46595:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a13f07ab800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788876710.772441:0:46595:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c25ecd40) has exports, disconnecting them 00000020:00080000:3.0:1788876710.772446:0:46595:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a13f07ab800), last request at 1788876671 00000020:00000080:3.0:1788876710.772450:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeb68 00000020:00080000:3.0:1788876710.772461:0:46595:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f07ab800): rc 0 00000020:00000080:3.0:1788876710.772464:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13f07ab800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876710.772829:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3004800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876710.772838:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ab800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788876710.777044:0:46595:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788876710.777054:0:46595:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876710.777059:0:46595:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876710.777066:0:46595:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876710.777102:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07ab000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876710.777269:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876710.777281:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788876710.777286:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a13ff37e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788876710.777289:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788876710.777294:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788876710.777367:0:46595:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c62dc000 1 00000020:00000080:2.0:1788876710.777372:0:46595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aea3b 00000020:00000080:2.0:1788876710.777378:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c62d8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788876710.777386:0:46595:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788876710.777394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876710.777402:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876710.777407:0:46595:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788876710.777411:0:46595:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c20199c0) has no exports 00000020:00000080:3.0:1788876711.051395:0:46595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876711.051407:0:46595:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788876711.051413:0:46595:0:(genops.c:885:class_export_put()) final put ffff8a12c62dd000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876711.051418:0:46595:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788876711.051429:0:46595:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788876711.051541:0:46595:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a12c62d9800 00000020:02000400:3.0:1788876711.051595:0:46595:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788876711.792166:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876712.435036:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876712.435075:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876712.435174:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.435235:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330240 00000100:00100000:1.0:1788876712.435244:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330240 00000100:00100000:1.0:1788876712.435327:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1788876712.435338:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532330240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876712.435375:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876712.435423:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532330240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876712.435432:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:1.0:1788876712.436619:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876712.436688:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330240:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876712.809556:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876712.937138:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876712.937231:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.937300:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330880:0@lo:400:kworker.0 00000100:00100000:1.0:1788876712.937328:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.937347:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532331392:0@lo:400:kworker.0 00000100:00100000:1.0:1788876712.937375:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.937402:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788876712.937408:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532330752:0@lo:400:kworker.0 00000100:00100000:1.0:1788876712.937429:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.937448:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532331264:0@lo:400:kworker.0 00000100:00100000:1.0:1788876712.937471:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.937506:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331392 00000100:00100000:1.0:1788876712.937514:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331392 00000100:00100000:1.0:1788876712.937575:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330752 00000100:00100000:1.0:1788876712.937579:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330752 00000100:00100000:0.0:1788876712.937720:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330368 00000100:00100000:0.0:1788876712.937725:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330368 00000100:00100000:0.0:1788876712.937758:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788876712.937768:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3665:x1875771532330368:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788876712.937776:0:6545:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876712.937824:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3665:x1875771532330368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (593us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876712.937832:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1788876712.937856:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330880 00000100:00100000:0.0:1788876712.937859:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330880 00000100:00100000:0.0:1788876712.937888:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1788876712.937894:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532330880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876712.937933:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532330880:12345-0@lo:400:kworker.0 Request processed in 39us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876712.937940:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1788876712.937956:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331264 00000100:00100000:0.0:1788876712.937959:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331264 00000100:00100000:0.0:1788876712.937971:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1788876712.937977:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532331392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876712.938006:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532331392:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876712.938013:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1788876712.938025:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:0.0:1788876712.938029:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532330752:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876712.938033:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876712.938053:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532330752:12345-0@lo:400:kworker.0 Request processed in 22us (623us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876712.938058:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:0.0:1788876712.938068:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1788876712.938072:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532331264:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876712.938076:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876712.938093:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532331264:12345-0@lo:400:kworker.0 Request processed in 19us (621us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876712.938098:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00080000:0.0:1788876712.938140:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876712.938146:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876712.938150:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876712.938156:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876712.938160:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1664 00000100:00080000:0.0:1788876712.938166:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876712.938192:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4674a80 x1875771532331520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876712.938214:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532330752:0@lo:400:kworker.0 00000100:00080000:0.0:1788876712.938226:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876712.938230:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876712.938233:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876712.938236:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876712.938239:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1664 00000100:00080000:0.0:1788876712.938243:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876712.938256:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4676a00 x1875771532331648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876712.938266:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532331264:0@lo:400:kworker.0 00000100:02020000:0.0:1788876712.938278:0:3665:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788876712.938282:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876712.938284:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876712.938287:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876712.938292:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876712.938295:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1664 00000100:00080000:0.0:1788876712.938299:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876712.938315:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f480 x1875771532331776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876712.938336:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330880:0@lo:400:kworker.0 00000100:00100000:0.0:1788876712.938347:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532331392:0@lo:400:kworker.0 00000100:00080000:1.0:1788876712.938461:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876712.938467:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876712.938531:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532330496:0@lo:400:kworker.0 00000400:00000100:2.0:1788876712.938565:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532330496 offset 0 length 224: 4 00000100:00100000:2.0:1788876712.938630:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532331008:0@lo:400:kworker.0 00000100:00100000:2.0:1788876712.938659:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876712.938678:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788876712.938684:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1875771532330624:0@lo:400:kworker.0 00000100:00100000:2.0:1788876712.938691:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532331136:0@lo:400:kworker.0 00000100:00100000:2.0:1788876712.938713:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876712.938750:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331008 00000100:00100000:2.0:1788876712.938755:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331008 00000100:00100000:2.0:1788876712.938774:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331136 00000100:00100000:2.0:1788876712.938777:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331136 00000100:00100000:3.0:1788876712.938808:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:3.0:1788876712.938821:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532331136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876712.938869:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1788876712.938870:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532331136:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876712.938879:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3662:x1875771532331008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876712.938882:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000020:00080000:2.0:1788876712.938892:0:6541:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788876712.938913:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532331520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788876712.938926:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3662:x1875771532331008:12345-0@lo:400:kworker.0 Request processed in 47us (266us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788876712.938934:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00100000:3.0:1788876712.938949:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876712.938968:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532331648:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788876712.938993:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876712.942739:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331520 00000100:00100000:2.0:1788876712.942761:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331520 00000100:00100000:2.0:1788876712.942810:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331648 00000100:00100000:2.0:1788876712.942814:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331648 00000100:00100000:2.0:1788876712.942832:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1788876712.942842:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331520:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788876712.942871:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876712.942895:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532331776:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788876712.942956:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331520:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 114us (4007us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876712.942964:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876712.942969:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1788876712.942991:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1788876712.942997:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331648:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788876712.943007:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788876712.943028:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1788876712.943036:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331648:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37us (4042us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788876712.943037:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876712.943046:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532331520:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788876712.943051:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00080000:3.0:1788876712.943067:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876712.943072:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876712.943076:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532331648:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788876712.943084:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876712.944108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532331136:0@lo:400:kworker.0 00000100:00080000:2.0:1788876712.944126:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788876712.944131:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788876712.944136:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788876712.944141:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876712.944146:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1664 00000100:00080000:2.0:1788876712.944154:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876712.944191:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa783800 x1875771532331904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876712.944224:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532331008:0@lo:400:kworker.0 00000100:00100000:3.0:1788876712.944992:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331776 00000100:00100000:3.0:1788876712.945000:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331776 00000100:00100000:1.0:1788876712.945090:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532331904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788876712.945160:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876712.945376:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532331904 00000100:00100000:1.0:1788876712.945381:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532331904 00000100:00100000:1.0:1788876712.945406:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:1.0:1788876712.945413:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331904:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788876712.945433:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876712.945476:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532331904:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 63us (316us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876712.945484:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00080000:1.0:1788876712.945515:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876712.945520:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876712.945525:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532331904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788876712.945716:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1788876712.945722:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532331776:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788876712.945732:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876712.945775:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532331776:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 52us (2814us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876712.945781:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00080000:1.0:1788876712.946319:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876712.946331:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876712.946335:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532331776:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788876713.452508:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876713.452540:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532332032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876713.452660:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876713.452725:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332032 00000100:00100000:3.0:1788876713.452735:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332032 00000100:00100000:3.0:1788876713.452797:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788876713.452807:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532332032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876713.452844:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876713.452897:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532332032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876713.452903:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788876713.452964:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532332032:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1788876713.653001:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511251328 offset 0 length 224: 4 00000100:00100000:3.0:1788876713.653058:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876713.653087:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876713.653106:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876713.653146:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876713.653181:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251584 00000100:00100000:3.0:1788876713.653193:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251584 00000100:00100000:3.0:1788876713.653269:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251456 00000100:00100000:3.0:1788876713.653272:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251456 00000100:00100000:3.0:1788876713.653294:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1645 00000100:00100000:3.0:1788876713.653307:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511251584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876713.653412:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511251584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876713.653421:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1645 00000100:00100000:3.0:1788876713.653444:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2476 00000100:00100000:3.0:1788876713.653448:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1875771511251456:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:3.0:1788876713.653455:0:15659:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:3.0:1788876713.653481:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2397:x1875771511251456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (373us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788876713.653487:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2476 00000100:00100000:3.0:1788876713.653509:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251840 00000100:00100000:3.0:1788876713.653513:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251840 00000100:00100000:3.0:1788876713.653542:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251712 00000100:00100000:3.0:1788876713.653545:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251712 00000100:00100000:3.0:1788876713.653566:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1214 00000100:00100000:3.0:1788876713.653572:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511251840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876713.653636:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511251840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876713.653643:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1214 00000100:00100000:3.0:1788876713.653654:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1215 00000100:00100000:3.0:1788876713.653660:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511251712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876713.653682:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511251712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876713.653688:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1215 00000100:00080000:3.0:1788876713.653711:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876713.655941:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876713.655956:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876713.669278:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876713.669364:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511251968 00000100:00100000:2.0:1788876713.669377:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511251968 00000100:00100000:2.0:1788876713.669437:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2477 00000100:00100000:2.0:1788876713.669448:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511251968:12345-192.168.203.11@tcp:38:ptlrpcd_01_00.0 00010000:00020000:2.0:1788876713.669478:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876713.669570:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511251968:12345-192.168.203.11@tcp:38:ptlrpcd_01_00.0 Request processed in 121us (306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876713.669579:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2477 00010000:00010000:2.0:1788876713.833016:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876714.856884:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876715.881235:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788876716.017823:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876716.017833:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13d212e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876716.021152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d212e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788876716.021226:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d212d000 for lustre-OST0001 00000001:00100000:1.0:1788876716.022533:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788876716.022546:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967324 is committed 00000020:00000080:1.0:1788876716.022550:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a12c2593800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876716.023138:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2593800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788876716.023236:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c2590000 for lustre-MDT0001 00000001:00100000:2.0:1788876716.023559:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876716.023565:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13efeda000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876716.023642:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13efeda000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788876716.023691:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13efedb000 for lustre-OST0000 00010000:00010000:2.0:1788876716.905716:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876717.546229:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876717.546261:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532332160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876717.546368:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876717.546932:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332160 00000100:00100000:1.0:1788876717.546948:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332160 00000100:00100000:1.0:1788876717.547035:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1788876717.547045:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532332160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876717.547080:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788876717.547118:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876717.547196:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532332160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876717.547204:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1788876717.548875:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532332160:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876717.929114:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876718.056841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876718.056851:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876718.056856:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876718.056867:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1700 00000100:00080000:0.0:1788876718.056875:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876718.056884:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876718.056914:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f480 x1875771532332416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876718.056945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876718.056949:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876718.056951:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876718.056955:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1700 00000100:00080000:0.0:1788876718.056958:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876718.056962:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876718.056976:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4676a00 x1875771532332544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876718.056995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876718.056999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876718.057001:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876718.057004:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1700 00000100:00080000:0.0:1788876718.057007:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876718.057011:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876718.057022:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4674700 x1875771532332800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876718.057068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876718.057072:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876718.057079:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876718.057083:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1700 00000100:00080000:0.0:1788876718.057086:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876718.057091:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876718.057104:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3c90000 x1875771532333056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876718.057147:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532332928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876718.057148:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532332288:0@lo:400:kworker.0 00000100:00100000:2.0:1788876718.057217:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532332416:0@lo:38:kworker.0 00000100:00100000:1.0:1788876718.057250:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532332672:0@lo:400:kworker.0 00000100:00100000:0.0:1788876718.057409:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876718.057477:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876718.057484:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788876718.057508:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876718.057751:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332928 00000400:00000100:3.0:1788876718.057804:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532332288 offset 0 length 224: 4 00000100:00100000:3.0:1788876718.057842:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333184 00000100:00100000:3.0:1788876718.057848:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333184 00000100:00100000:3.0:1788876718.057917:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1788876718.057929:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532333184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876718.057996:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532333184:12345-0@lo:400:kworker.0 Request processed in 69us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876718.058086:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332928 00000100:00100000:0.0:1788876718.058121:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:0.0:1788876718.058137:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532332928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876718.058168:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1788876718.058191:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532332928:12345-0@lo:400:kworker.0 Request processed in 55us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876718.058199:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00080000:3.0:1788876718.058238:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876718.058289:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788876718.058305:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532332928:0@lo:400:kworker.0 00000100:00100000:2.0:1788876718.061007:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876718.061193:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532332544:0@lo:38:kworker.0 00000100:00100000:2.0:1788876718.061238:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876718.061278:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532332800:0@lo:38:kworker.0 00000100:00100000:2.0:1788876718.061304:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876718.061327:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532333056:0@lo:38:kworker.0 00000100:00100000:2.0:1788876718.061350:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876718.061405:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332544 00000100:00100000:2.0:1788876718.061414:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332544 00000100:00100000:2.0:1788876718.061452:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332800 00000100:00100000:2.0:1788876718.061455:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332800 00000100:00100000:2.0:1788876718.061469:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333056 00000100:00100000:2.0:1788876718.061471:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333056 00000100:00100000:2.0:1788876718.061484:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1788876718.061491:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532332544:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876718.061530:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876718.061590:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532332544:12345-0@lo:38:kworker.0 Request processed in 97us (350us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876718.061598:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1788876718.061642:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1788876718.061648:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532332800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876718.061658:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876718.061683:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532332800:12345-0@lo:38:kworker.0 Request processed in 34us (379us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876718.061687:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876718.061689:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1788876718.061700:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1788876718.061704:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532333056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876718.061713:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876718.061734:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332672 00000100:00100000:2.0:1788876718.061735:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532333056:12345-0@lo:38:kworker.0 Request processed in 29us (385us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876718.061737:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332672 00000100:00100000:2.0:1788876718.061741:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:1.0:1788876718.061786:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00080000:2.0:1788876718.061788:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788876718.061794:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532332672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788876718.061794:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876718.061798:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532332544:0@lo:38:kworker.0 00000100:00080000:2.0:1788876718.061807:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876718.061811:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876718.061814:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532332800:0@lo:38:kworker.0 00000100:00080000:2.0:1788876718.061821:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876718.061824:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876718.061827:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532333056:0@lo:38:kworker.0 00000100:00100000:1.0:1788876718.061841:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532332672:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876718.061848:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00080000:1.0:1788876718.061866:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876718.062149:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532332416 00000100:00100000:0.0:1788876718.062155:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532332416 00000100:00100000:0.0:1788876718.062184:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1788876718.062189:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f36b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532332416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876718.062200:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876718.062234:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f36b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532332416:12345-0@lo:38:kworker.0 Request processed in 44us (1237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876718.062240:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00080000:2.0:1788876718.062745:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876718.062751:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876718.062754:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532332416:0@lo:38:kworker.0 00000100:00100000:2.0:1788876718.062787:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532332672:0@lo:400:kworker.0 00000100:00100000:2.0:1788876718.571675:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876718.571711:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532333312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876718.571816:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876718.572025:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333312 00000100:00100000:3.0:1788876718.572036:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333312 00000100:00100000:3.0:1788876718.572110:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1788876718.572121:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532333312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876718.572164:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876718.572229:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532333312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876718.572236:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1788876718.572367:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532333312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876718.767529:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876718.767684:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788876718.767753:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511252096 offset 0 length 224: 4 00000100:00100000:0.0:1788876718.767779:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876718.767837:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252352 00000100:00100000:2.0:1788876718.767849:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252352 00000100:00100000:2.0:1788876718.767939:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1648 00000100:00100000:2.0:1788876718.767951:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511252352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876718.768050:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511252352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876718.768058:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1648 00000100:00080000:1.0:1788876718.769203:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876718.774598:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252608 00000100:00100000:1.0:1788876718.774638:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252608 00000100:00100000:1.0:1788876718.774713:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252480 00000100:00100000:1.0:1788876718.774717:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252480 00000100:00100000:1.0:1788876718.774751:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1217 00000100:00100000:1.0:1788876718.774763:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511252608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876718.774867:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511252608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 105us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876718.774876:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1217 00000100:00100000:1.0:1788876718.774895:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1218 00000100:00100000:1.0:1788876718.774902:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511252480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876718.774928:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511252480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (7148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876718.774934:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1218 00000100:00080000:0.0:1788876718.775896:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876718.775904:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876718.776077:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876718.776155:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252224 00000100:00100000:0.0:1788876718.776162:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252224 00000100:00100000:0.0:1788876718.776204:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2481 00000100:00100000:0.0:1788876718.776212:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511252224:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876718.776243:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876718.777154:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511252224:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 98us (237us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876718.777169:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2481 00010000:00010000:2.0:1788876718.956141:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876719.976971:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876721.001565:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876722.026513:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876722.665067:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876722.665096:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532333440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876722.665196:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876722.665391:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333440 00000100:00100000:2.0:1788876722.665401:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333440 00000100:00100000:2.0:1788876722.665497:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1788876722.665508:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532333440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876722.665558:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876722.665652:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532333440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876722.665660:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00080000:0.0:1788876722.665780:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876722.665841:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532333440:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876723.050844:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876723.176998:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876723.177007:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876723.177012:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876723.177023:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1705 00000100:00080000:3.0:1788876723.177030:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876723.177039:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876723.177071:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c362c700 x1875771532333696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876723.177099:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876723.177104:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876723.177106:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876723.177109:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1705 00000100:00080000:3.0:1788876723.177113:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876723.177116:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876723.177135:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e4700 x1875771532333824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876723.177151:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876723.177154:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876723.177156:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876723.177159:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1705 00000100:00080000:3.0:1788876723.177161:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876723.177164:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876723.177173:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e4a80 x1875771532334080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876723.177210:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876723.177213:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876723.177215:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876723.177219:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1705 00000100:00080000:3.0:1788876723.177221:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876723.177225:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876723.177237:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3036d80 x1875771532334464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876723.177302:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532334208:0@lo:400:kworker.0 00000100:00100000:3.0:1788876723.177390:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876723.177471:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876723.177478:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532334336:0@lo:400:kworker.0 00000100:00100000:3.0:1788876723.177506:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876723.177551:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334208 00000100:00100000:3.0:1788876723.177561:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334208 00000100:00100000:1.0:1788876723.177629:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532333952:0@lo:400:kworker.0 00000100:00100000:3.0:1788876723.177669:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:1.0:1788876723.177670:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876723.177684:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532334208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876723.177704:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788876723.177713:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532333568:0@lo:400:kworker.0 00000400:00000100:1.0:1788876723.177742:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532333568 offset 0 length 224: 4 00000100:00100000:3.0:1788876723.177751:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532334208:12345-0@lo:400:kworker.0 Request processed in 69us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876723.177761:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:1.0:1788876723.177768:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532334592:0@lo:400:kworker.0 00000100:00100000:1.0:1788876723.177795:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876723.177845:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334336 00000100:00100000:1.0:1788876723.177850:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334336 00000100:00100000:1.0:1788876723.177885:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333952 00000100:00100000:1.0:1788876723.177888:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333952 00000100:00100000:1.0:1788876723.177922:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1788876723.177923:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334592 00000100:00100000:0.0:1788876723.177929:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334592 00000100:00100000:1.0:1788876723.177931:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532334336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876723.177967:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:1.0:1788876723.177974:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532334336:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876723.177980:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876723.177987:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1788876723.178004:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:1.0:1788876723.178012:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532333952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876723.178034:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532334592:12345-0@lo:400:kworker.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876723.178043:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:1.0:1788876723.178051:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532333952:12345-0@lo:400:kworker.0 Request processed in 39us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876723.178059:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00080000:0.0:1788876723.178100:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876723.178106:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532334592:0@lo:400:kworker.0 00000100:00080000:0.0:1788876723.178107:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876723.178127:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532333952:0@lo:400:kworker.0 00000100:00100000:1.0:1788876723.178172:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532334336:0@lo:400:kworker.0 00000100:00100000:1.0:1788876723.178183:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e785d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532334208:0@lo:400:kworker.0 00000100:00100000:2.0:1788876723.178327:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532333696:0@lo:38:kworker.0 00000100:00100000:2.0:1788876723.178528:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876723.178594:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532333824:0@lo:38:kworker.0 00000100:00100000:2.0:1788876723.178708:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876723.178742:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532334080:0@lo:38:kworker.0 00000100:00100000:2.0:1788876723.178763:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876723.178794:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532334464:0@lo:38:kworker.0 00000100:00100000:2.0:1788876723.178816:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876723.178872:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333824 00000100:00100000:2.0:1788876723.178880:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333824 00000100:00100000:2.0:1788876723.178911:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334080 00000100:00100000:2.0:1788876723.178914:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334080 00000100:00100000:2.0:1788876723.178926:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334464 00000100:00100000:2.0:1788876723.178929:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334464 00000100:00100000:2.0:1788876723.178942:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1788876723.178948:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532333824:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876723.178969:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876723.179007:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532333824:12345-0@lo:38:kworker.0 Request processed in 57us (298us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876723.179013:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1788876723.179027:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1788876723.179031:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532334080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876723.179039:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876723.179058:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532334080:12345-0@lo:38:kworker.0 Request processed in 26us (294us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876723.179064:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1788876723.179074:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1788876723.179078:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532334464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876723.179090:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876723.179126:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532334464:12345-0@lo:38:kworker.0 Request processed in 46us (308us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876723.179132:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00080000:2.0:1788876723.179308:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876723.179313:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876723.179317:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532333824:0@lo:38:kworker.0 00000100:00080000:2.0:1788876723.179324:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876723.179327:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876723.179330:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532334080:0@lo:38:kworker.0 00000100:00080000:2.0:1788876723.179336:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876723.179339:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876723.179341:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532334464:0@lo:38:kworker.0 00000100:00100000:0.0:1788876723.179427:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532333696 00000100:00100000:0.0:1788876723.179432:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532333696 00000100:00100000:0.0:1788876723.179460:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1788876723.179466:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532333696:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876723.179475:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876723.179515:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532333696:12345-0@lo:38:kworker.0 Request processed in 49us (1004us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876723.179529:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00080000:1.0:1788876723.180439:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876723.180447:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876723.180450:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532333696:0@lo:38:kworker.0 00000100:00100000:1.0:1788876723.688953:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532334720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876723.689033:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876723.689468:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334720 00000100:00100000:3.0:1788876723.689477:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334720 00000100:00100000:3.0:1788876723.689542:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1788876723.689552:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532334720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876723.689585:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876723.689671:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532334720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876723.689678:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1788876723.689804:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532334720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876723.888855:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876723.888884:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876723.888899:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511252736 offset 0 length 224: 4 00000100:00100000:3.0:1788876723.888916:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876723.888937:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876723.888960:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252992 00000100:00100000:3.0:1788876723.888969:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252992 00000100:00100000:3.0:1788876723.889019:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511252864 00000100:00100000:3.0:1788876723.889021:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511252864 00000100:00100000:3.0:1788876723.889038:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1651 00000100:00100000:3.0:1788876723.889046:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511252992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876723.889122:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511252992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876723.889130:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1651 00000100:00100000:3.0:1788876723.889150:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2485 00000100:00100000:3.0:1788876723.889155:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511252864:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788876723.889179:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876723.889206:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511252864:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 49us (267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876723.889212:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2485 00000100:00100000:3.0:1788876723.889232:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253248 00000100:00100000:3.0:1788876723.890281:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253248 00000100:00100000:3.0:1788876723.890325:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253120 00000100:00100000:3.0:1788876723.890329:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253120 00000100:00100000:3.0:1788876723.890353:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1221 00000100:00100000:3.0:1788876723.890360:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511253248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876723.890404:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511253248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876723.890411:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1221 00000100:00100000:3.0:1788876723.890424:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1222 00000100:00100000:3.0:1788876723.890430:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511253120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876723.890453:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511253120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876723.890459:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1222 00000100:00080000:3.0:1788876723.890486:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876723.890490:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876723.890492:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876724.077945:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876725.101425:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876726.120863:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876727.145445:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876727.785530:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532334848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876727.785632:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876727.785711:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532334848 00000100:00100000:2.0:1788876727.785719:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532334848 00000100:00100000:2.0:1788876727.785783:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00080000:1.0:1788876727.785787:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876727.785794:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532334848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876727.785823:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876727.785889:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532334848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876727.785896:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1788876727.786188:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532334848:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876728.173489:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788876728.232751:0:3662:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876712/real 1788876712] req@ffff8a13fae32d80 x1875771532330496/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876728 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876728.232787:0:3662:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13fae32d80 x1875771532330496/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876728.232795:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788876728.232798:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788876728.232802:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788876728.232804:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788876728.232807:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fae32d80 x1875771532330496/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876728 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876728.232817:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a12c606dc00 x1875771532332288/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876734 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876728.232837:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a12c362d180 x1875771532333568/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876739 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788876728.232848:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788876728.232850:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788876728.232851:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788876728.232853:0:3662:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1788876728.232878:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532330496:0@lo:400:kworker.0 00000100:00100000:1.0:1788876728.232997:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532332288:0@lo:400:kworker.0 00000100:00100000:1.0:1788876728.233024:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532333568:0@lo:400:kworker.0 00000100:00080000:3.0:1788876728.237225:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876728.237236:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788876728.237240:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876728.237249:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1659 00000100:00080000:3.0:1788876728.237257:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876728.237293:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f41cea00 x1875771532334976/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876728.237335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876728.237339:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876728.237341:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876728.237344:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1711 00000100:00080000:3.0:1788876728.237348:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876728.237352:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876728.237368:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f41cd180 x1875771532335104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876728.237377:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876728.237380:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876728.237382:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876728.237385:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1711 00000100:00080000:3.0:1788876728.237387:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876728.237390:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876728.237403:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7876d80 x1875771532335232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876728.237431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876728.237435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876728.237436:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876728.237439:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1711 00000100:00080000:3.0:1788876728.237442:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876728.237445:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876728.237455:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7aad880 x1875771532335488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876728.237495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876728.237499:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876728.237501:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876728.237505:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1711 00000100:00080000:3.0:1788876728.237507:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876728.237511:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876728.237521:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eeed6300 x1875771532335872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876728.237563:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532335360:0@lo:400:kworker.0 00000100:00100000:0.0:1788876728.237796:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532334976:0@lo:250:kworker.0 00000400:00000100:0.0:1788876728.237830:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532334976 offset 0 length 520: 4 00000100:00100000:0.0:1788876728.237884:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532335104:0@lo:38:kworker.0 00000100:00100000:0.0:1788876728.237912:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876728.237932:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532335232:0@lo:38:kworker.0 00000100:00100000:0.0:1788876728.237953:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876728.237968:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532335488:0@lo:38:kworker.0 00000100:00100000:0.0:1788876728.237986:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876728.238000:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532335872:0@lo:38:kworker.0 00000100:00100000:0.0:1788876728.238018:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876728.238053:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335104 00000100:00100000:0.0:1788876728.238059:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335104 00000100:00100000:0.0:1788876728.238093:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1788876728.238100:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532335104:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876728.238117:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876728.238157:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532335104:12345-0@lo:38:kworker.0 Request processed in 57us (245us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876728.238164:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1788876728.238187:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335232 00000100:00100000:0.0:1788876728.238203:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335232 00000100:00100000:0.0:1788876728.238220:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335488 00000100:00100000:0.0:1788876728.238222:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335488 00000100:00100000:0.0:1788876728.238233:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335872 00000100:00100000:0.0:1788876728.238235:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335872 00000100:00100000:0.0:1788876728.238244:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1788876728.238248:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335232:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876728.238258:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876728.238281:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335232:12345-0@lo:38:kworker.0 Request processed in 32us (327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876728.238287:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1788876728.238297:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:0.0:1788876728.238301:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335488:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876728.238309:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876728.238341:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335488:12345-0@lo:38:kworker.0 Request processed in 38us (354us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876728.238350:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:0.0:1788876728.238360:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:0.0:1788876728.238364:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876728.238372:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876728.238391:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532335872:12345-0@lo:38:kworker.0 Request processed in 26us (372us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876728.238396:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00080000:0.0:1788876728.238440:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876728.238444:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876728.238448:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532335104:0@lo:38:kworker.0 00000100:00080000:0.0:1788876728.238455:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876728.238458:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876728.238461:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532335232:0@lo:38:kworker.0 00000100:00080000:0.0:1788876728.238467:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876728.238470:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876728.238472:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532335488:0@lo:38:kworker.0 00000100:00080000:0.0:1788876728.238491:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876728.238494:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876728.238497:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532335872:0@lo:38:kworker.0 00000100:00100000:3.0:1788876728.238838:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876728.238888:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876728.238895:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532336000:0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.238919:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876728.238948:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.238972:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876728.238987:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876728.238992:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532335744:0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.239012:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876728.239039:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335360 00000100:00100000:3.0:1788876728.239042:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335360 00000100:00100000:3.0:1788876728.239084:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335744 00000100:00100000:3.0:1788876728.239087:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335744 00000100:00100000:3.0:1788876728.239106:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1788876728.239113:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532335360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.239154:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532335360:12345-0@lo:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876728.239160:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:3.0:1788876728.239472:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1788876728.239479:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532335744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.239525:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532335744:12345-0@lo:400:kworker.0 Request processed in 47us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876728.239532:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:3.0:1788876728.239548:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876728.239579:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532335360:0@lo:400:kworker.0 00000100:00100000:3.0:1788876728.239691:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532335744:0@lo:400:kworker.0 00000100:00100000:0.0:1788876728.241464:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336000 00000100:00100000:0.0:1788876728.241478:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336000 00000100:00100000:0.0:1788876728.241560:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532335616 00000100:00100000:0.0:1788876728.241564:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532335616 00000100:00100000:0.0:1788876728.241588:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1788876728.241597:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532336000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876728.241709:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532336000:12345-0@lo:400:kworker.0 Request processed in 113us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876728.241716:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1788876728.241731:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1788876728.241738:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876728.241773:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532335616:12345-0@lo:400:kworker.0 Request processed in 36us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876728.241779:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1788876728.241818:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eeed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532336000:0@lo:400:kworker.0 00000100:00100000:0.0:1788876728.241851:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532335616:0@lo:400:kworker.0 00000100:00080000:3.0:1788876728.242205:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876728.808806:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876728.808830:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532336128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876728.808899:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876728.808945:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336128 00000100:00100000:3.0:1788876728.808953:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336128 00000100:00100000:3.0:1788876728.809001:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1788876728.809010:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532336128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876728.809036:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876728.809078:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532336128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876728.809085:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1788876728.809127:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f35fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532336128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876729.007284:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876729.007332:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876729.007352:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511253376 offset 0 length 224: 4 00000100:00100000:3.0:1788876729.007369:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876729.007423:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253632 00000100:00100000:1.0:1788876729.007432:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253632 00000100:00100000:3.0:1788876729.007448:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876729.007470:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253888 00000100:00100000:3.0:1788876729.007474:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253888 00000100:00100000:1.0:1788876729.007500:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253504 00000100:00100000:1.0:1788876729.007503:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253504 00000100:00100000:3.0:1788876729.007511:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511253760 00000100:00100000:3.0:1788876729.007513:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511253760 00000100:00100000:1.0:1788876729.007521:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1654 00000100:00100000:1.0:1788876729.007529:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511253632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876729.007532:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1225 00000100:00100000:3.0:1788876729.007539:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511253888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876729.007620:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511253632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876729.007628:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1654 00000100:00100000:1.0:1788876729.007644:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2489 00000100:00100000:1.0:1788876729.007649:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511253504:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876729.007669:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876729.010436:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1226 00000100:00100000:3.0:1788876729.010458:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511253760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876729.010531:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511253760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876729.010539:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1226 00000100:00080000:3.0:1788876729.010567:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876729.010572:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876729.010576:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876729.010845:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511253888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3305us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876729.010854:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1225 00000100:00100000:1.0:1788876729.012366:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511253504:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 4708us (4910us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876729.012378:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2489 00010000:00010000:2.0:1788876729.195922:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876730.098738:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876730.098781:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876730.098855:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254272 00000100:00100000:1.0:1788876730.098865:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254272 00000100:00100000:1.0:1788876730.098926:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1655 00000100:00100000:1.0:1788876730.098936:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511254272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876730.099025:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511254272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876730.099033:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1655 00000100:00100000:3.0:1788876730.099501:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876730.104570:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511254016 offset 0 length 520: 4 00000100:00100000:3.0:1788876730.104643:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876730.106819:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254144 00000100:00100000:0.0:1788876730.106831:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254144 00000100:00100000:0.0:1788876730.106879:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2490 00000100:00100000:0.0:1788876730.106888:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511254144:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876730.106910:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876730.106973:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511254144:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 85us (2331us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876730.106981:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2490 00000100:00100000:2.0:1788876730.108475:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254400 00000100:00100000:2.0:1788876730.108486:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254400 00000100:00100000:2.0:1788876730.108551:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254528 00000100:00100000:2.0:1788876730.108555:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254528 00000100:00100000:2.0:1788876730.108691:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1227 00000100:00100000:2.0:1788876730.108701:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511254400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876730.108771:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511254400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (9989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876730.108779:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1227 00000100:00100000:2.0:1788876730.108795:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1228 00000100:00100000:2.0:1788876730.108801:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511254528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876730.108828:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511254528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (9329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876730.108834:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1228 00010000:00010000:1.0:1788876730.217114:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876731.242880:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876732.268297:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876732.906880:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532336256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876732.906963:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876732.907062:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336256 00000100:00100000:1.0:1788876732.907070:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336256 00000100:00100000:1.0:1788876732.907129:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1788876732.907138:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532336256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876732.907166:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876732.912012:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532336256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4866us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876732.912026:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00080000:1.0:1788876732.912061:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876732.912163:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532336256:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876733.289270:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876733.421491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876733.421503:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788876733.421506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876733.421510:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876733.421514:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876733.421523:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1716 00000100:00080000:0.0:1788876733.421528:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876733.421534:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876733.421569:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fae32a00 x1875771532336384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876733.421596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876733.421615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876733.421617:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876733.421624:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1716 00000100:00080000:0.0:1788876733.421627:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876733.421630:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876733.421642:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fae33800 x1875771532336512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876733.421678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876733.421681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876733.421683:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876733.421687:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1716 00000100:00080000:0.0:1788876733.421689:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876733.421693:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876733.421705:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7aae680 x1875771532336768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876733.421939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876733.421944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876733.421946:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876733.421950:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1716 00000100:00080000:0.0:1788876733.421953:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876733.421957:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876733.421972:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7876d80 x1875771532337152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876733.422012:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532336640:0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422092:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876733.422164:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876733.422172:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532337280:0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422201:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876733.422232:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532336896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422255:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876733.422271:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876733.422276:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337024:0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422404:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876733.422437:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336640 00000100:00100000:0.0:1788876733.422452:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336640 00000100:00100000:0.0:1788876733.422511:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337024 00000100:00100000:0.0:1788876733.422514:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337024 00000100:00100000:0.0:1788876733.422541:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1788876733.422549:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532336640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422629:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532336640:12345-0@lo:400:kworker.0 Request processed in 80us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876733.422636:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1788876733.422655:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1788876733.422661:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422696:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337024:12345-0@lo:400:kworker.0 Request processed in 35us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876733.422702:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1788876733.422751:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337024:0@lo:400:kworker.0 00000100:00100000:0.0:1788876733.422779:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532336640:0@lo:400:kworker.0 00000100:00100000:1.0:1788876733.422866:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337280 00000100:00100000:1.0:1788876733.422871:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337280 00000100:00100000:1.0:1788876733.422906:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336896 00000100:00100000:1.0:1788876733.422909:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336896 00000100:00100000:1.0:1788876733.422931:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1788876733.422938:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532337280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876733.422977:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532337280:12345-0@lo:400:kworker.0 Request processed in 40us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876733.422984:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1788876733.422996:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1788876733.423002:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532336896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876733.423033:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532336896:12345-0@lo:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876733.423039:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00080000:1.0:1788876733.423058:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876733.423062:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876733.423075:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532336384:0@lo:38:kworker.0 00000100:00100000:1.0:1788876733.423101:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876733.423130:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532336512:0@lo:38:kworker.0 00000100:00100000:1.0:1788876733.423168:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876733.423185:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532336768:0@lo:38:kworker.0 00000100:00100000:1.0:1788876733.423209:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876733.423227:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532337152:0@lo:38:kworker.0 00000100:00100000:1.0:1788876733.423248:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876733.423280:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336384 00000100:00100000:1.0:1788876733.423449:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336384 00000100:00100000:1.0:1788876733.423477:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1788876733.423486:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532336384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876733.423508:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876733.423547:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532336384:12345-0@lo:38:kworker.0 Request processed in 60us (445us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876733.423553:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1788876733.423575:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336512 00000100:00100000:1.0:1788876733.423579:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336512 00000100:00100000:1.0:1788876733.423598:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532336768 00000100:00100000:1.0:1788876733.423626:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532336768 00000100:00100000:1.0:1788876733.423636:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337152 00000100:00100000:1.0:1788876733.423642:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337152 00000100:00100000:1.0:1788876733.423652:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1788876733.423657:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532336512:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876733.423667:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876733.423692:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532336512:12345-0@lo:38:kworker.0 Request processed in 34us (535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876733.423698:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1788876733.423709:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1788876733.423713:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532336768:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876733.423726:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876733.423756:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532336768:12345-0@lo:38:kworker.0 Request processed in 38us (543us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876733.423761:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1788876733.423778:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:1.0:1788876733.423782:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532337152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876733.423793:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876733.423823:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532337152:12345-0@lo:38:kworker.0 Request processed in 40us (575us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876733.423829:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:1.0:1788876733.423877:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532336896:0@lo:400:kworker.0 00000100:00080000:1.0:1788876733.423902:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876733.423907:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876733.423909:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532336384:0@lo:38:kworker.0 00000100:00080000:1.0:1788876733.423917:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876733.423920:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876733.423923:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532336512:0@lo:38:kworker.0 00000100:00080000:1.0:1788876733.423930:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876733.423933:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876733.423936:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532336768:0@lo:38:kworker.0 00000100:00080000:1.0:1788876733.423942:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876733.423944:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876733.423947:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532337152:0@lo:38:kworker.0 00000100:00100000:1.0:1788876733.424128:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788876733.931640:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876733.931663:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532337408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876733.931727:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876733.931776:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337408 00000100:00100000:3.0:1788876733.931783:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337408 00000100:00100000:3.0:1788876733.931829:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1788876733.931837:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532337408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876733.931867:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876733.931907:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532337408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876733.931914:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1788876733.931963:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532337408:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876734.312924:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788876735.015206:0:47214:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788876735.015215:0:47214:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788876735.015216:0:47214:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788876735.015344:0:47214:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a13ff33b000 00000020:01000004:2.0:1788876735.015360:0:47214:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788876735.015374:0:47214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788876735.015390:0:47214:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c5e38000) 00000020:00000080:2.0:1788876735.015422:0:47214:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788876735.164565:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876735.164636:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876735.164713:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254784 00000100:00100000:1.0:1788876735.164723:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254784 00000100:00100000:1.0:1788876735.164789:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254656 00000100:00100000:1.0:1788876735.164792:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254656 00000100:00100000:1.0:1788876735.164811:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1658 00000100:00100000:1.0:1788876735.164831:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511254784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876735.164907:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511254784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876735.164915:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1658 00000100:00100000:1.0:1788876735.164934:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2494 00000100:00100000:1.0:1788876735.164938:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511254656:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876735.164957:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876735.164981:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511254656:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 41us (345us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876735.164987:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2494 00000100:00080000:0.0:1788876735.165328:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00100000:10000000:3.0:1788876735.169498:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00000100:00100000:1.0:1788876735.170682:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876735.170986:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255040 00000100:00100000:3.0:1788876735.170996:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255040 00000100:00100000:3.0:1788876735.171069:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1231 00000100:00100000:3.0:1788876735.171079:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511255040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876735.171160:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e785d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511255040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876735.171168:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1231 00000100:00080000:1.0:1788876735.173022:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876735.192040:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876735.193030:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511254912 00000100:00100000:0.0:1788876735.193042:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511254912 00000100:00100000:0.0:1788876735.193106:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1232 00000100:00100000:0.0:1788876735.193117:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511254912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876735.193204:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511254912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 89us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876735.193212:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1232 00000100:00080000:1.0:1788876735.193912:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00100000:10000000:2.0:1788876735.194237:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788876735.197033:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.197924:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.198125:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.198361:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.199066:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.199787:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.200207:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.200933:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.201704:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788876735.201986:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.202544:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.203197:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.204367:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788876735.204997:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788876735.206933:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788876735.207507:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788876735.207905:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788876735.208214:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788876735.209065:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788876735.209362:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788876735.210729:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788876735.211009:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.216692:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.218284:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.218979:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.219749:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.220263:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.220769:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.221050:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.221335:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.221651:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.221982:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.222245:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.222565:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.225572:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.227099:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.228626:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.230000:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.230660:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.231453:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.231949:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.232163:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788876735.232954:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788876735.233731:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788876735.235286:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788876735.239313:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788876735.239721:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788876735.240229:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788876735.241812:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788876735.242085:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788876735.242379:0:47214:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788876735.243692:0:47214:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788876735.243899:0:47214:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788876735.243907:0:47214:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788876735.243919:0:47214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aef89 00000020:01000004:1.0:1788876735.243925:0:47214:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788876735.243936:0:47214:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788876735.243941:0:47214:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13ff33b000 from MGS 00000020:01000004:1.0:1788876735.243944:0:47214:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788876735.243954:0:47214:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c25e99c0) 00000020:00000080:1.0:1788876735.243965:0:47214:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788876735.244024:0:47214:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13ff33b000 from MGS, refs=2 00080000:01000000:1.0:1788876735.244028:0:47214:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788876735.244033:0:47214:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aef97 00010000:00010000:1.0:1788876735.244174:0:47214:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788876735.249146:0:47214:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788876735.250779:0:47218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788876735.250892:0:47214:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788876735.250943:0:47214:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788876735.252337:0:47214:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788876735.253637:0:47214:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788876735.253816:0:47214:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788876735.253821:0:47214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788876735.263030:0:47214:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788876735.263049:0:47214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788876735.263892:0:47214:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788876735.263901:0:47214:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788876735.264957:0:47214:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788876735.264985:0:47214:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788876735.264987:0:47214:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788876735.264991:0:47214:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788876735.264997:0:47214:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 37, was 0): CONNECTING 00000100:00100000:0.0:1788876735.265003:0:47214:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1788876735.336907:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876736.360935:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876737.384760:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876738.025341:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876738.025429:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.025580:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337536 00000100:00100000:2.0:1788876738.025589:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337536 00000100:00100000:2.0:1788876738.025684:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1788876738.025695:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876738.025724:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788876738.025804:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876738.046274:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20569us (20834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.046291:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1788876738.047015:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337536:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788876738.409327:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876738.540811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.540821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788876738.540825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.540829:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876738.540833:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876738.540842:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1721 00000100:00080000:2.0:1788876738.540848:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876738.540855:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.540892:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39f80 x1875771532337664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.540907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.540911:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876738.540913:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876738.540916:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1721 00000100:00080000:2.0:1788876738.540918:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876738.540921:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.540932:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3bb80 x1875771532337792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.540969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.540973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876738.540975:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876738.540978:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1721 00000100:00080000:2.0:1788876738.540980:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876738.540983:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.540994:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3b800 x1875771532338048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.541038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.541041:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876738.541043:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876738.541047:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1721 00000100:00080000:2.0:1788876738.541049:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876738.541052:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.541064:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f408a680 x1875771532338432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876738.541105:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532338304:0@lo:400:kworker.0 00000100:00100000:2.0:1788876738.541171:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.541229:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876738.541236:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532338176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876738.541263:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.541303:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338176 00000100:00100000:2.0:1788876738.541310:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338176 00000100:00100000:2.0:1788876738.541362:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1788876738.541371:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532338176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876738.541437:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532338176:12345-0@lo:400:kworker.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.541444:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1788876738.541483:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788876738.541557:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788876738.541589:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.541637:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876738.541643:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788876738.541664:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.541736:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338560 00000100:00100000:1.0:1788876738.541741:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338560 00000100:00100000:1.0:1788876738.541778:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:1.0:1788876738.541786:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532338560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876738.541828:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532338560:12345-0@lo:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.541834:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:1.0:1788876738.541855:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876728/real 1788876728] req@ffff8a13f41cea00 x1875771532334976/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876738 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876738.541876:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13f41cea00 x1875771532334976/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876738 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876738.541888:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532337664:0@lo:38:kworker.0 00000100:00100000:1.0:1788876738.541913:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.541935:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532337792:0@lo:38:kworker.0 00000100:00100000:1.0:1788876738.541954:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.541968:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532338048:0@lo:38:kworker.0 00000100:00100000:1.0:1788876738.541987:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.542000:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532338432:0@lo:38:kworker.0 00000100:00100000:1.0:1788876738.542019:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876738.542033:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876738.542043:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788876738.542049:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532334976:0@lo:250:kworker.0 00000100:00100000:1.0:1788876738.542069:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337792 00000100:00100000:1.0:1788876738.542073:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337792 00000100:00100000:1.0:1788876738.542084:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338048 00000100:00100000:1.0:1788876738.542087:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338048 00000100:00100000:1.0:1788876738.542094:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338432 00000100:00100000:1.0:1788876738.542096:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338432 00000100:00100000:1.0:1788876738.542105:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1788876738.542110:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532337792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876738.542127:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876738.542158:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532337792:12345-0@lo:38:kworker.0 Request processed in 47us (203us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876738.542165:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1788876738.542177:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1788876738.542181:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532338048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876738.542189:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876738.542214:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532338048:12345-0@lo:38:kworker.0 Request processed in 31us (225us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876738.542220:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:1.0:1788876738.542232:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:1.0:1788876738.542236:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532338432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876738.542246:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876738.542268:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532338432:12345-0@lo:38:kworker.0 Request processed in 29us (247us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876738.542273:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00080000:1.0:1788876738.542296:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876738.542300:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876738.542303:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532337792:0@lo:38:kworker.0 00000100:00080000:1.0:1788876738.542310:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876738.542313:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876738.542316:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532338048:0@lo:38:kworker.0 00000100:00080000:1.0:1788876738.542323:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876738.542326:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876738.542329:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532338432:0@lo:38:kworker.0 00000100:00100000:1.0:1788876738.542357:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788876738.542445:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337664 00000100:00100000:0.0:1788876738.542449:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337664 00000100:00100000:0.0:1788876738.542763:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1788876738.542769:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532337664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876738.542780:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876738.542819:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532337664:12345-0@lo:38:kworker.0 Request processed in 49us (905us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876738.542825:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00080000:0.0:1788876738.542851:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876738.542854:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876738.542857:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532337664:0@lo:38:kworker.0 10000000:01000000:0.0:1788876738.542878:0:47214:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788876738.542893:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.542904:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.542911:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788876738.542923:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.542931:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35200/0xf5bf0f7e313aec2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec33 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.542948:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.542956:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.542961:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.542964:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.542968:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487200/0xf5bf0f7e313aeba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aeba7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.542978:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.542983:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.542989:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.542992:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.542995:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961400/0xf5bf0f7e313aebae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebb5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543003:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543009:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543023:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543027:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543030:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13cfe52800/0xf5bf0f7e313aebca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebd1 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543038:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543044:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543052:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543056:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543059:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313aebd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebdf expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543068:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543073:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543086:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543089:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543092:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961800/0xf5bf0f7e313aebf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebfb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543100:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543105:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543110:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543113:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543116:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34a00/0xf5bf0f7e313aec10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec17 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543124:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543130:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543135:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543138:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543140:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313aec48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec4f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543152:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543163:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543168:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543172:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543175:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13cfe53000/0xf5bf0f7e313aec02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec09 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543186:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543192:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543197:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876738.543199:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543202:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313aec1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec25 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543213:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543219:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543224:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876738.543227:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543231:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487800/0xf5bf0f7e313aebbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebc3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543244:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543250:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543255:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876738.543258:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543261:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960c00/0xf5bf0f7e313aebe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aebed expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.543269:0:47214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876738.543274:0:47214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876738.543278:0:47214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876738.543281:0:47214:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876738.543284:0:47214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35800/0xf5bf0f7e313aec3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313aec41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788876738.543296:0:47214:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 37, was 0): DISCONN 00000100:00080000:0.0:1788876738.543301:0:47214:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876738.543305:0:47214:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1716 00000100:00080000:0.0:1788876738.543309:0:47214:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876738.543313:0:47214:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876738.543332:0:47214:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fae32a00 x1875771532338688/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876738.543351:0:47214:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1788876738.543363:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532338688:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788876738.543395:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876738.543512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876738.543516:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788876738.543591:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338688 00000100:00100000:1.0:1788876738.543596:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338688 00000100:00100000:1.0:1788876738.543651:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788876738.543657:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532338688:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788876738.543675:0:47219:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 1726 last 0 00000020:00000080:1.0:1788876738.543705:0:47219:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313aef9e 00000100:00080000:1.0:1788876738.543840:0:47219:0:(import.c:65:import_set_state_nolock()) ffff8a13f07a8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876738.545216:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532338688:12345-0@lo:250:mount.lustre.0 Request processed in 1550us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.545230:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788876738.545343:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 18 00000100:00080000:0.0:1788876738.545352:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1788876738.545360:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788876738.545365:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788876738.545369:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788876738.545372:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788876738.545397:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788876738.545417:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532338688:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1788876738.545451:0:47214:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788876738.545464:0:47214:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788876738.545506:0:47214:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788876738.545512:0:47214:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788876738.545674:0:47214:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788876738.545726:0:47214:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788876738.545731:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788876738.545732:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876738.545733:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876738.545735:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876738.545736:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876738.545737:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876738.545739:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876738.545740:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876738.545742:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876738.545743:0:47214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876738.545746:0:47214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788876738.545748:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788876738.545749:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876738.545750:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876738.545752:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876738.545753:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876738.545754:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876738.545755:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876738.545756:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876738.545757:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876738.545758:0:47214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876738.545779:0:47214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788876738.545796:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532338816:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788876738.545837:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.545863:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234780 going to sleep for 11 seconds 00000100:00100000:3.0:1788876738.545953:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338304 00000100:00100000:3.0:1788876738.545960:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338304 00000100:00100000:3.0:1788876738.546000:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1788876738.546009:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532338304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876738.546056:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532338304:12345-0@lo:400:kworker.0 Request processed in 48us (4884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.546065:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1788876738.546077:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532337920 00000100:00100000:3.0:1788876738.546080:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532337920 00000100:00100000:3.0:1788876738.546106:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1788876738.546111:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876738.546145:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532337920:12345-0@lo:400:kworker.0 Request processed in 34us (4479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.546150:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00080000:3.0:1788876738.546180:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876738.546184:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876738.546299:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338816 00000100:00100000:2.0:1788876738.546304:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338816 00000100:00100000:2.0:1788876738.546340:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788876738.546348:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:47214:x1875771532338816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788876738.546379:0:47222:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788876738.546383:0:47222:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788876738.546385:0:47222:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:2.0:1788876738.546442:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532338304:0@lo:400:kworker.0 00000020:01000000:1.0:1788876738.546788:0:36:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:1.0:1788876738.546800:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1788876738.546803:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788876738.546805:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788876738.546806:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876738.546808:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876738.546809:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876738.546810:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876738.546812:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876738.546813:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876738.546814:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788876738.546847:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788876738.546859:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1788876738.546861:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788876738.546862:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788876738.546864:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876738.546865:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876738.546866:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876738.546867:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876738.546868:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788876738.546869:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876738.546870:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788876738.546897:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1788876738.546903:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1788876738.546906:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788876738.546907:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788876738.546908:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876738.546909:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876738.546911:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876738.546912:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876738.546913:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788876738.546914:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876738.546915:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1788876738.546927:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1788876738.546950:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532339200:0@lo:253:kworker.0 00000100:00100000:1.0:1788876738.546984:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.547011:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876738.547017:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532339072:0@lo:253:kworker.0 00000100:00100000:1.0:1788876738.547044:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.547078:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532337920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876738.547091:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876738.547095:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532338944:0@lo:253:kworker.0 00000100:00100000:1.0:1788876738.547122:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.547149:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339200 00000100:00100000:1.0:1788876738.547153:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339200 00000100:00100000:1.0:1788876738.547174:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339072 00000100:00100000:1.0:1788876738.547177:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339072 00000100:00100000:1.0:1788876738.547187:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532338944 00000100:00100000:1.0:1788876738.547190:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532338944 00000100:00100000:1.0:1788876738.547207:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788876738.547213:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532339200:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788876738.547229:0:47221:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1788876738.547469:0:47224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788876738.547579:0:47222:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 71 20000000:01000000:2.0:1788876738.558792:0:47225:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788876738.558800:0:47225:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788876738.558804:0:47225:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788876738.558806:0:47225:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788876738.559026:0:47225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788876738.559238:0:47222:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788876738.559253:0:47222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788876738.560787:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47214:x1875771532338816:12345-0@lo:253:mount.lustre.0 Request processed in 14433us (14943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.560805:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788876738.560845:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788876738.560855:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3663:x1875771532339072:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788876738.560883:0:47222:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788876738.560898:0:47222:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788876738.561057:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532338816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788876738.561073:0:47214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788876738.561076:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788876738.561078:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876738.561079:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876738.561080:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876738.561082:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876738.561083:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876738.561084:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876738.561086:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876738.561088:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876738.561089:0:47214:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788876738.561108:0:47214:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13ff33b000 from lustre-MDT0000 10000000:01000000:3.0:1788876738.561149:0:47214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788876738.561152:0:47214:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788876738.561160:0:47214:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a13ff33b000 10000000:01000000:3.0:1788876738.561165:0:47214:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788876738.561170:0:47214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a13ff33b000 10000000:01000000:3.0:1788876738.561173:0:47214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788876738.561176:0:47214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13ff33b000 from 1 10000000:01000000:3.0:1788876738.561179:0:47214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788876738.561214:0:47214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.561224:0:47214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.561233:0:47214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.561253:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876738.561284:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.561317:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.561405:0:47219:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788876738.561441:0:47219:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788876738.561661:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339328 00000100:00100000:3.0:1788876738.561667:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339328 00000100:00100000:0.0:1788876738.561760:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788876738.561768:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532338944:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788876738.561783:0:47226:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788876738.563925:0:47222:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876738.563942:0:47222:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788876738.564204:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532339072:12345-0@lo:253:kworker.0 Request processed in 3347us (17155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.564216:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788876738.564253:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788876738.564263:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:47214:x1875771532339328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876738.564275:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876738.564297:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fad52200/0xf5bf0f7e313aefac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aefa5 expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.564322:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fad52200/0xf5bf0f7e313aefac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aefa5 expref: 8 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.564333:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fad52200/0xf5bf0f7e313aefac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aefa5 expref: 8 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.564342:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fad52200, rc 0) 00000100:00100000:0.0:1788876738.564372:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47214:x1875771532339328:12345-0@lo:101:mount.lustre.0 Request processed in 112us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.564378:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788876738.564520:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876738.564538:0:47214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564549:0:47214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876738.564566:0:47214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876738.564585:0:47214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564594:0:47214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876738.564630:0:47214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788876738.564635:0:47214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788876738.564641:0:47214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a13ff33b000 10000000:01000000:3.0:1788876738.564643:0:47214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788876738.564647:0:47214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788876738.564650:0:47214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788876738.564672:0:47214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564680:0:47214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564689:0:47214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.564706:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876738.564735:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.564760:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203900 going to sleep for 11 seconds 20000000:01000000:3.0:1788876738.564781:0:47226:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788876738.564885:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339456 00000100:00100000:3.0:1788876738.564892:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339456 00000100:00100000:3.0:1788876738.564919:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788876738.564926:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47214:x1875771532339456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876738.564932:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876738.564942:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313aefba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aefb3 expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564954:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313aefba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aefb3 expref: 9 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564962:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313aefba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aefb3 expref: 9 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.564972:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221e00, rc 0) 00000100:00100000:3.0:1788876738.564997:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:47214:x1875771532339456:12345-0@lo:101:mount.lustre.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.565002:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788876738.565029:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876738.565039:0:47214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.565046:0:47214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.565094:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876738.565129:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.565143:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203900 going to sleep for 11 seconds 00000100:00100000:3.0:1788876738.565155:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339584 00000100:00100000:3.0:1788876738.565158:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339584 00000100:00100000:3.0:1788876738.565174:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788876738.565180:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:47214:x1875771532339584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876738.565277:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47214:x1875771532339584:12345-0@lo:501:mount.lustre.0 Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.565283:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788876738.565312:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876738.565337:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876738.565376:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.565388:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203900 going to sleep for 11 seconds 00000100:00100000:3.0:1788876738.565399:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339712 00000100:00100000:3.0:1788876738.565402:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339712 00000100:00100000:3.0:1788876738.565429:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788876738.565434:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47214:x1875771532339712:12345-0@lo:503:mount.lustre.0 00000020:01000004:1.0:1788876738.565480:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788876738.565483:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788876738.565484:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876738.565487:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876738.565488:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876738.565489:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876738.565491:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788876738.565492:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876738.565494:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788876738.565498:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532339072:0@lo:253:kworker.0 20000000:01000000:2.0:1788876738.565882:0:47224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876738.565887:0:47224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788876738.565901:0:47224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565911:0:47224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788876738.565918:0:47224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000031775s 00010000:00010000:2.0:1788876738.565922:0:47224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565929:0:47224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565935:0:47224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565941:0:47224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565948:0:47224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876738.565952:0:47224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565959:0:47224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565969:0:47224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565976:0:47224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.565982:0:47224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313aefc1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788876738.570466:0:47226:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788876738.570483:0:47226:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788876738.570533:0:47221:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788876738.570755:0:47224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876738.570760:0:47224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788876738.570783:0:47224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570801:0:47224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788876738.570811:0:47224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051653s 00010000:00010000:2.0:1788876738.570817:0:47224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570825:0:47224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570838:0:47224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.570839:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3664:x1875771532338944:12345-0@lo:253:kworker.0 Request processed in 9066us (23710us total) trans 0 rc 0/0 00010000:00010000:2.0:1788876738.570855:0:47224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.570859:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788876738.570867:0:47224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876738.570872:0:47224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570882:0:47224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570895:0:47224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570903:0:47224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.570910:0:47224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313aefc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788876738.570989:0:3664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788876738.570991:0:3664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788876738.570993:0:3664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876738.570994:0:3664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876738.570996:0:3664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876738.570997:0:3664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876738.570998:0:3664:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876738.571000:0:3664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876738.571002:0:3664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788876738.571006:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532338944:0@lo:253:kworker.0 20000000:01000000:1.0:1788876738.577767:0:47221:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788876738.577786:0:47221:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788876738.578078:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:3663:x1875771532339200:12345-0@lo:253:kworker.0 Request processed in 30861us (31089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.578090:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:2.0:1788876738.578213:0:47224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876738.578219:0:47224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788876738.578239:0:47224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578254:0:47224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788876738.578262:0:47224:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051653s 00010000:00010000:2.0:1788876738.578268:0:47224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578274:0:47224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578282:0:47224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578289:0:47224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578295:0:47224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876738.578299:0:47224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578306:0:47224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578318:0:47224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578326:0:47224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.578332:0:47224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313aefcf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788876738.578465:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876738.578469:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788876738.578471:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876738.578472:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876738.578474:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876738.578476:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876738.578478:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876738.578480:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876738.578481:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876738.578485:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532339200:0@lo:253:kworker.0 00000100:00100000:3.0:1788876738.578512:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47214:x1875771532339712:12345-0@lo:503:mount.lustre.0 Request processed in 13074us (13131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.578521:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788876738.578647:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532339712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876738.579038:0:47227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47227:1875771532339840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876738.579083:0:47227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.579127:0:47227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e7d65900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.579218:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339840 00000100:00100000:0.0:1788876738.579224:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339840 00000100:00100000:0.0:1788876738.579264:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788876738.579273:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47227:x1875771532339840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876738.579877:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47227:x1875771532339840:12345-0@lo:502:llog_process_th.0 Request processed in 604us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.579885:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788876738.579967:0:47227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47227:1875771532339840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876738.579990:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876738.580002:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876738.580004:0:47227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788876738.580009:0:47227:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788876738.580012:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876738.580027:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c25ecd40) 00000020:00000080:1.0:1788876738.580050:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788876738.580055:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788876738.580147:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788876738.580156:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aefdd 00000020:00000080:1.0:1788876738.580362:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788876738.580367:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876738.580370:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876738.580371:0:47227:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788876738.580374:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876738.580377:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876738.580379:0:47227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788876738.580382:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876738.580389:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c25eb380) 00000020:00000080:1.0:1788876738.580400:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788876738.580403:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788876738.580405:0:47227:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788876738.580418:0:47227:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788876738.580424:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788876738.580467:0:47227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13ff33b000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788876738.580479:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c25e8000) 00000020:00000080:1.0:1788876738.580489:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788876738.580541:0:47227:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788876738.580547:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313aeff2 00000020:00000080:1.0:1788876738.580688:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788876738.580695:0:47227:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788876738.580700:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313aeff9 00080000:01000000:1.0:1788876738.580705:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788876738.580708:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af000 00010000:00010000:3.0:1788876738.715771:0:47227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788876738.715899:0:47227:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 73014444032 lx: 0 gen 1 00000001:00080000:3.0:1788876738.715943:0:47227:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 68719477400 srv lr: 73014444032 lx: 0 gen 4 00000001:00000004:3.0:1788876738.715964:0:47227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 18, last_transno is 73014444032 00000001:00080000:3.0:1788876738.716123:0:47227:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788876738.716383:0:47227:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c2dd26c0: xid 1875771511247488, transno 73014444033, client gen 4, slot idx 0 00000001:00080000:3.0:1788876738.716395:0:47227:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c7e4d000: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:3.0:1788876738.716401:0:47227:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c7e4df00: xid 1875771511235712, transno 68719477400, client gen 4, slot idx 2 00000001:00080000:3.0:1788876738.716416:0:47227:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13fa7db600: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:3.0:1788876738.716917:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a13f5270000) 00000020:00000080:3.0:1788876738.716938:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788876738.717006:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788876738.717013:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af01c 00000020:00000080:3.0:1788876738.719931:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876738.724506:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313af023 00000020:00000080:0.0:1788876738.724890:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788876738.724904:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876738.724910:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.724912:0:47227:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788876738.724916:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788876738.724919:0:47227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788876738.724920:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876738.724922:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876738.724924:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788876738.724926:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.724928:0:47227:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788876738.724930:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876738.724934:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.724936:0:47227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788876738.724940:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788876738.724980:0:47227:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788876738.725061:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876738.725067:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.725068:0:47227:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788876738.725073:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876738.725188:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.725190:0:47227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788876738.725195:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788876738.725200:0:47227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:0.0:1788876738.725228:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876738.725243:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a12c201cd40) 00000020:00000080:0.0:1788876738.725337:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788876738.725343:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788876738.725510:0:47227:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788876738.725517:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788876738.725524:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af031 00010000:00080000:0.0:1788876738.725559:0:47227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c5f36000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788876738.730098:0:47227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788876738.737900:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876738.737914:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788876738.737952:0:47227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788876738.737972:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af038 00000100:00080000:2.0:1788876738.737982:0:47227:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876738.737987:0:47227:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a12c5f36000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.738030:0:47227:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb29ed80 x1875771532339968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.738128:0:47227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788876738.738200:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876738.738205:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.738206:0:47227:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788876738.738209:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788876738.738212:0:47227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788876738.738214:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876738.738215:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876738.738216:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788876738.738219:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.738220:0:47227:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788876738.738222:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788876738.738227:0:47227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788876738.738231:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.738232:0:47227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788876738.738235:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788876738.738239:0:47227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1788876738.738261:0:47227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788876738.738264:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788876738.738276:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c5e3b380) 00000020:00000080:2.0:1788876738.738291:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788876738.738296:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788876738.738342:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532339968:0@lo:38:llog_process_th.0 00000004:00080000:2.0:1788876738.738353:0:47227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788876738.738359:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788876738.738364:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af046 00010000:00080000:2.0:1788876738.738391:0:47227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c36e6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:0.0:1788876738.738481:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.738568:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532339968 00010000:00010000:2.0:1788876738.738570:0:47227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1788876738.738575:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532339968 00000100:00100000:1.0:1788876738.738629:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1788876738.738636:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532339968:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788876738.738662:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1726 last 0 00000020:00000080:1.0:1788876738.738689:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af04d 00000004:00100000:1.0:1788876738.738703:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876738.738790:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876738.738860:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532339968:12345-0@lo:38:llog_process_th.0 Request processed in 223us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.738867:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1788876738.738988:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876738.739006:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788876738.739013:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788876738.739017:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788876738.739020:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c5f36000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788876738.739035:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532339968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876738.739266:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876738.739276:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532340096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876738.739303:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1788876738.739537:0:47227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788876738.739560:0:47227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788876738.739650:0:47227:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 16, last_idx 17 00000100:00100000:1.0:1788876738.739747:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340096 00000100:00100000:1.0:1788876738.739753:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340096 00000100:00100000:1.0:1788876738.739792:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1788876738.739800:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532340096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876738.739828:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876738.739871:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532340096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.739877:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1788876738.739941:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532340096:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788876738.740296:0:47227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788876738.740324:0:47227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].18, 64 off9344 00000040:00080000:2.0:1788876738.740484:0:47227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x48:0x0].1, 64 off8256 00000040:00080000:2.0:1788876738.741485:0:47233:0:(llog.c:805:llog_process_thread()) index: 17, lh_last_idx: 18 synced_idx: 0 lgh_last_idx: 18 00000040:00080000:2.0:1788876738.741492:0:47233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x44:0x0] at index 17 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788876738.741958:0:47233:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 17, last_idx 18 00000040:00080000:0.0:1788876738.741982:0:47233:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x44:0x0] at index 17 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788876738.742281:0:47233:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 18 synced_idx: 18 lgh_last_idx: 18 00000040:00080000:0.0:1788876738.742285:0:47233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x48:0x0] at index 18 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788876738.742544:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876738.742556:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876738.742590:0:47227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788876738.742637:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af054 00000100:00080000:2.0:1788876738.742647:0:47227:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876738.742653:0:47227:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a12c36e6000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.742691:0:47227:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb29ed80 x1875771532340224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.742714:0:47227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788876738.742819:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876738.742825:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.742827:0:47227:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788876738.742830:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788876738.742833:0:47227:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788876738.742835:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876738.742836:0:47227:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876738.742838:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788876738.742841:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.742842:0:47227:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788876738.742845:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788876738.742850:0:47227:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788876738.742853:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.742855:0:47227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788876738.742857:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788876738.742861:0:47227:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1788876738.742887:0:47227:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788876738.742890:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788876738.742902:0:47227:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c5e399c0) 00000020:00000080:2.0:1788876738.742919:0:47227:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788876738.742923:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788876738.742980:0:47227:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788876738.742985:0:47227:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788876738.742990:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af062 00010000:00080000:2.0:1788876738.743023:0:47227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13d212a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1788876738.743204:0:47227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788876738.743328:0:47227:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788876738.743342:0:47227:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788876738.743486:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532340224:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788876738.743551:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.743998:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340224 00000100:00100000:2.0:1788876738.744010:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340224 00000100:00100000:2.0:1788876738.744049:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1788876738.744057:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3661:x1875771532340224:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788876738.744094:0:43966:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1726 last 0 00000020:00000080:2.0:1788876738.744128:0:43966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af069 00002000:00100000:2.0:1788876738.744144:0:43966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13d2129800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788876738.744149:0:43966:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788876738.744152:0:43966:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788876738.744220:0:43966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788876738.744243:0:43966:0:(import.c:65:import_set_state_nolock()) ffff8a13f53b7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876738.744506:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532340224:12345-0@lo:8:llog_process_th.0 Request processed in 448us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.744513:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1788876738.744654:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876738.744663:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788876738.744669:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788876738.744674:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788876738.744676:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788876738.744695:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788876738.744700:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532340224:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788876738.744964:0:47233:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788876738.745017:0:47233:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1726640414596ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788876738.745023:0:47233:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788876738.745199:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876738.745211:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532340352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876738.745259:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.745328:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340352 00000100:00100000:2.0:1788876738.745334:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340352 00000100:00100000:2.0:1788876738.745381:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1788876738.745389:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532340352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876738.745421:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876738.745456:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532340352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.745462:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00080000:3.0:1788876738.745670:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876738.745700:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532340352:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788876738.745933:0:47227:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 16, last_idx 17 00000040:00080000:1.0:1788876738.746885:0:47227:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876738.746912:0:47227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].18, 64 off9344 00000040:00080000:1.0:1788876738.747091:0:47227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4a:0x0].1, 64 off8256 00000004:00080000:2.0:1788876738.751876:0:47215:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1788876738.755390:0:47235:0:(llog.c:805:llog_process_thread()) index: 17, lh_last_idx: 18 synced_idx: 0 lgh_last_idx: 18 00000040:00080000:3.0:1788876738.755401:0:47235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x46:0x0] at index 17 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788876738.755644:0:47235:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 17, last_idx 18 00000040:00080000:3.0:1788876738.755669:0:47235:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x46:0x0] at index 17 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788876738.755812:0:47235:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 18 synced_idx: 18 lgh_last_idx: 18 00000040:00080000:3.0:1788876738.755816:0:47235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4a:0x0] at index 18 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788876738.758873:0:47227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876738.758888:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876738.758931:0:47227:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788876738.758953:0:47227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af070 00000100:00080000:2.0:1788876738.758963:0:47227:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876738.758969:0:47227:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13d212a000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.759002:0:47227:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb29ed80 x1875771532340480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.759024:0:47227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788876738.759071:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876738.759085:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.759087:0:47227:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788876738.759091:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876738.759095:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.759097:0:47227:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788876738.759100:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788876738.759102:0:47227:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788876738.759104:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876738.759107:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.759108:0:47227:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788876738.759110:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876738.759113:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.759115:0:47227:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788876738.759181:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788876738.759213:0:47227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47227:1875771532340608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.759353:0:47227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.759403:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532340480:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788876738.759446:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.759502:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340480 00000100:00100000:3.0:1788876738.759508:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340480 00000100:00100000:3.0:1788876738.759536:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1788876738.759542:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3661:x1875771532340480:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788876738.759565:0:43963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1726 last 0 00000020:00000080:3.0:1788876738.759590:0:43963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af077 00002000:00100000:3.0:1788876738.759618:0:43963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ff3dc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788876738.759623:0:43963:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788876738.759625:0:43963:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788876738.759693:0:43963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788876738.759714:0:43963:0:(import.c:65:import_set_state_nolock()) ffff8a13ff3da800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876738.759757:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532340480:12345-0@lo:8:llog_process_th.0 Request processed in 213us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.759764:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1788876738.759799:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876738.759806:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788876738.759812:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788876738.759816:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788876738.759819:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d212a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788876738.759826:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788876738.759831:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532340480:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788876738.759853:0:47235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788876738.759904:0:47235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1726655301077ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788876738.759909:0:47235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788876738.760201:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876738.760234:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.760505:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340736 00000100:00100000:3.0:1788876738.760510:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340736 00000100:00100000:3.0:1788876738.760555:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1788876738.760561:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532340736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876738.760574:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876738.760633:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532340736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.760639:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00080000:0.0:1788876738.760977:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876738.761002:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532340736:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788876738.762043:0:47215:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788876738.762387:0:47227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876738.762463:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340608 00000100:00100000:1.0:1788876738.762472:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340608 00000100:00100000:1.0:1788876738.762519:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788876738.762527:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47227:x1875771532340608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876738.762800:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47227:x1875771532340608:12345-0@lo:502:llog_process_th.0 Request processed in 273us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.762808:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788876738.762898:0:47227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47227:1875771532340608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788876738.762928:0:47227:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876738.762934:0:47227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876738.762936:0:47227:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788876738.762941:0:47227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788876738.763215:0:47214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788876738.763241:0:47214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788876738.763329:0:47214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.763341:0:47214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876738.763349:0:47214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13ff33b000 from 1 10000000:01000000:3.0:1788876738.763352:0:47214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788876738.763384:0:47214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.763393:0:47214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.763401:0:47214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.763434:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532340864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876738.763473:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.763508:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7e60600 going to sleep for 11 seconds 00000100:00100000:1.0:1788876738.763593:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340864 00000100:00100000:1.0:1788876738.763629:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340864 00000100:00100000:1.0:1788876738.763659:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788876738.763667:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:47214:x1875771532340864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876738.763676:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876738.763691:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af07e expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.763713:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 9 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.763724:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 9 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.763733:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487000, rc 0) 00000100:00100000:1.0:1788876738.763768:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:47214:x1875771532340864:12345-0@lo:101:mount.lustre.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.763774:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788876738.763906:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532340864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876738.763921:0:47214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.763929:0:47214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876738.764798:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532340992:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788876738.764853:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.764927:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876738.767786:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532340992 00000100:00100000:1.0:1788876738.767802:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532340992 00000100:00100000:1.0:1788876738.767875:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788876738.767885:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:47214:x1875771532340992:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788876738.767921:0:47219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788876738.767955:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788876738.767960:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788876738.767962:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788876738.767965:0:47219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 74 00000100:00100000:2.0:1788876738.768238:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532340992:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788876738.768922:0:47214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788876738.768943:0:47214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.768955:0:47214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876738.768964:0:47214:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13ff33b000 from 1 10000000:01000000:2.0:1788876738.768968:0:47214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788876738.769000:0:47214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769009:0:47214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769019:0:47214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876738.769038:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876738.769076:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.769109:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.769147:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341120 00000100:00100000:2.0:1788876738.769151:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341120 00000100:00100000:2.0:1788876738.769178:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788876738.769186:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47214:x1875771532341120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876738.769195:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876738.769208:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313af093 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af08c expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769229:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313af093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af08c expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769240:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313af093 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af08c expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769252:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73200, rc 0) 00000100:00100000:2.0:1788876738.769283:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341120:12345-0@lo:101:mount.lustre.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.769290:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788876738.769326:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876738.769338:0:47214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.769346:0:47214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876738.769396:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.769431:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.769443:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.769455:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341248 00000100:00100000:2.0:1788876738.769458:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341248 00000100:00100000:2.0:1788876738.769474:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788876738.769479:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.769598:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341248:12345-0@lo:501:mount.lustre.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.769623:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788876738.769653:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.769679:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341376:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876738.769716:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.769730:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c8014600 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.769743:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341376 00000100:00100000:2.0:1788876738.769746:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341376 00000100:00100000:2.0:1788876738.769762:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788876738.769767:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341376:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876738.769837:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341376:12345-0@lo:503:mount.lustre.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.769843:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788876738.769877:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876738.770191:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47214:x1875771532340992:12345-0@lo:256:mount.lustre.0 Request processed in 236us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.770200:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788876738.771812:0:47237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47237:1875771532341504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876738.771910:0:47237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.771970:0:47237:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c518c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.773343:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341504 00000100:00100000:2.0:1788876738.773355:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341504 00000100:00100000:2.0:1788876738.773425:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788876738.773436:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47237:x1875771532341504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.773901:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47237:x1875771532341504:12345-0@lo:502:llog_process_th.0 Request processed in 466us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.773909:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788876738.774006:0:47237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47237:1875771532341504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876738.774042:0:47237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876738.774052:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.774055:0:47237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788876738.774063:0:47237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13ff33b000 00000020:00000080:0.0:1788876738.774065:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788876738.774073:0:47237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876738.774087:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.774089:0:47237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788876738.774092:0:47237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876738.774094:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.774095:0:47237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788876738.774098:0:47237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13ff33b000 00000020:00000080:0.0:1788876738.774100:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788876738.774204:0:47237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47237:1875771532341632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876738.774244:0:47237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.774374:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341632 00000100:00100000:0.0:1788876738.774378:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341632 00000100:00100000:0.0:1788876738.774403:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788876738.774419:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47237:x1875771532341632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876738.774490:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47237:x1875771532341632:12345-0@lo:502:llog_process_th.0 Request processed in 72us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.774498:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788876738.774535:0:47237:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.774549:0:47237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47237:1875771532341632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876738.774567:0:47237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876738.774571:0:47237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876738.774573:0:47237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788876738.774576:0:47237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788876738.776776:0:47214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788876738.776819:0:47214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876738.776846:0:47214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.776868:0:47214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876738.776930:0:47214:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788876738.776933:0:47214:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a13ff33b000 10000000:01000000:3.0:1788876738.776936:0:47214:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a13ff33b000 10000000:01000000:3.0:1788876738.776941:0:47214:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788876738.776947:0:47214:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13ff33b000 from 1 10000000:01000000:3.0:1788876738.776949:0:47214:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788876738.776990:0:47214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.776999:0:47214:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.777011:0:47214:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876738.777039:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876738.777196:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.777244:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7e60480 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.778487:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341760 00000100:00100000:2.0:1788876738.778499:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341760 00000100:00100000:2.0:1788876738.778554:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788876738.778564:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:47214:x1875771532341760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876738.778576:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876738.778592:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313af0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af09a expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.778638:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313af0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af09a expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.778649:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313af0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af09a expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.778659:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72c00, rc 0) 00000100:00100000:2.0:1788876738.778730:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341760:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.778737:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788876738.778790:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876738.778806:0:47214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.778816:0:47214:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876738.778883:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.778914:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.778939:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2d4d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.778954:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532341888 00000100:00100000:2.0:1788876738.778958:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532341888 00000100:00100000:2.0:1788876738.778981:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876738.778987:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.779106:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532341888:12345-0@lo:501:mount.lustre.0 Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.779113:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876738.779144:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532341888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876738.779171:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532342016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876738.779208:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.779221:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2d4d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.779233:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342016 00000100:00100000:2.0:1788876738.779236:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342016 00000100:00100000:2.0:1788876738.779839:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788876738.779848:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532342016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876738.779931:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532342016:12345-0@lo:503:mount.lustre.0 Request processed in 85us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.779937:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788876738.782802:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532342016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876738.787981:0:47239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876738.788069:0:47239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.788109:0:47239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7e60780 going to sleep for 11 seconds 00000100:00100000:3.0:1788876738.789724:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342144 00000100:00100000:3.0:1788876738.789735:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342144 00000100:00100000:3.0:1788876738.789792:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788876738.789803:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876738.789971:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342144:12345-0@lo:502:llog_process_th.0 Request processed in 169us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876738.789978:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788876738.790042:0:47239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342144:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788876738.790108:0:47239:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788876738.790714:0:47239:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a13f5274d40) 00000020:00000080:3.0:1788876738.790742:0:47239:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788876738.790834:0:47239:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13ff33b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788876738.790839:0:47239:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13ff33b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788876738.790842:0:47239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13ff33b000 4 00010000:00080000:3.0:1788876738.790881:0:47239:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ff363000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1788876738.795721:0:47239:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1788876738.795941:0:47239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788876738.795997:0:47239:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788876738.796011:0:47239:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313af0af 00000100:00080000:2.0:1788876738.796023:0:47239:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876738.796029:0:47239:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13ff363000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876738.796072:0:47239:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39f80 x1875771532342272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876738.796094:0:47239:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788876738.796543:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532342272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788876738.796647:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.797225:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342272 00000100:00100000:1.0:1788876738.797235:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342272 00000100:00100000:1.0:1788876738.797286:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1788876738.797296:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532342272:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876738.797366:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532342272:12345-0@lo:38:llog_process_th.0 Request processed in 70us (718us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788876738.797374:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:2.0:1788876738.798270:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788876738.798281:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876738.798286:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788876738.798290:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532342272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788876738.802470:0:47239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.802555:0:47239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.802595:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342400 00000100:00100000:2.0:1788876738.803211:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342400 00000100:00100000:2.0:1788876738.803658:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788876738.803669:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.803800:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342400:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.803808:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788876738.803869:0:47239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2d4db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.803891:0:47239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.803940:0:47239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876738.803972:0:47239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.803998:0:47239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2d4db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788876738.804337:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342528 00000100:00100000:1.0:1788876738.804343:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342528 00000100:00100000:1.0:1788876738.804370:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788876738.804376:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876738.804473:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47239:x1875771532342528:12345-0@lo:502:llog_process_th.0 Request processed in 97us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.804480:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788876738.809936:0:47239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47239:1875771532342528:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788876738.809981:0:47239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788876738.810346:0:47214:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788876738.810373:0:47214:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876738.810390:0:47214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.810402:0:47214:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788876738.810456:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788876738.810458:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876738.810460:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876738.810461:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876738.810462:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876738.810464:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876738.810465:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876738.810466:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876738.810468:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876738.810469:0:47214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788876738.810473:0:47214:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788876738.810475:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788876738.810477:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876738.810478:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876738.810479:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876738.810480:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876738.810481:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876738.810482:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876738.810483:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876738.810484:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876738.810485:0:47214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788876738.810508:0:47214:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788876738.810527:0:47214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532342656:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788876738.810622:0:47214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.810660:0:47214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c6b60900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.810685:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342656 00000100:00100000:0.0:1788876738.810691:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342656 00000100:00100000:0.0:1788876738.810735:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788876738.810744:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532342656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788876738.810772:0:47219:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788876738.810787:0:47219:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788876738.824634:0:47219:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788876738.824651:0:47219:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788876738.825394:0:47224:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876738.825402:0:47224:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788876738.825435:0:47224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.825457:0:47224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.825467:0:47224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.825509:0:47224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876738.825524:0:47224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 1826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876738.825539:0:47224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:47224:1875771532342784:0@lo:104: 00000100:00100000:2.0:1788876738.825637:0:47224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876738.825673:0:47224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2d4db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.825733:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342784 00000100:00100000:0.0:1788876738.825741:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342784 00000100:00100000:0.0:1788876738.825791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788876738.825799:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:47224:x1875771532342784:12345-0@lo:104: 00010000:00010000:0.0:1788876738.825812:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.825872:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788876738.825877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:47224:x1875771532342784:12345-0@lo:104: Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.825885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788876738.825968:0:47224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:47224:1875771532342784:0@lo:104: 00010000:00010000:3.0:1788876738.825988:0:47224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.826674:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876738.826684:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.826693:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876738.826698:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.826707:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876738.826715:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876738.826934:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788876738.827034:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.827042:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876738.827063:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.827070:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221a00/0xf5bf0f7e313af07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af085 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876738.827098:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876738.827099:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876738.827101:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876738.827187:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfc69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:47214:x1875771532342656:12345-0@lo:253:mount.lustre.0 Request processed in 16442us (16563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876738.827196:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788876738.827455:0:47214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:47214:1875771532342656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788876738.827470:0:47214:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788876738.827473:0:47214:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788876738.827475:0:47214:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876738.827476:0:47214:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876738.827478:0:47214:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876738.827479:0:47214:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876738.827480:0:47214:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876738.827481:0:47214:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876738.827483:0:47214:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876738.827485:0:47214:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876738.827486:0:47214:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788876738.827503:0:47214:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788876738.829036:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532342912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876738.829092:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876738.829760:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532342912 00000100:00100000:0.0:1788876738.829767:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532342912 00010000:00010000:0.0:1788876738.829794:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 1826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876738.829829:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788876738.829837:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3663:x1875771532342912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876738.829850:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876738.829855:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 1826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829867:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 1826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829883:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313af085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313af07e expref: 11 pid: 47222 timeout: 1826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829898:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829906:0:9553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788876738.829921:0:9553:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004520715s 00010000:00010000:0.0:1788876738.829925:0:9553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829932:0:9553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829940:0:9553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829946:0:9553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829951:0:9553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876738.829955:0:9553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829963:0:9553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829984:0:9553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876738.829994:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876738.830034:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3663:x1875771532342912:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.830041:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788876738.830073:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532342912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876738.830267:0:47224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.830276:0:47224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876738.830283:0:47224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af0b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 47224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788876738.836465:0:47214:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:3.0:1788876738.836814:0:47214:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788876738.836883:0:47245:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:1.0:1788876738.836887:0:47245:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:1.0:1788876738.837149:0:47246:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788876738.837453:0:47214:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788876738.838301:0:47247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788876738.838580:0:47247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876738.838785:0:47247:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c27369c0 going to sleep for 11 seconds 00000040:01000000:3.0:1788876738.839231:0:47214:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788876738.839279:0:47214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788876738.839839:0:47214:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788876738.839846:0:47214:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788876738.839882:0:47214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788876738.848667:0:47214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788876738.850668:0:47246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788876738.850752:0:47246:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788876738.858090:0:47214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788876738.859323:0:47214:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788876738.860731:0:47214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788876738.862529:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343040 00000100:00100000:0.0:1788876738.862551:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343040 00000100:00100000:2.0:1788876738.864361:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788876738.864381:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876738.864542:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (25962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.864550:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1788876738.864694:0:47247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343040:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788876738.864748:0:47247:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788876738.864812:0:47247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876738.864869:0:47247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.864902:0:47247:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:0.0:1788876738.865239:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343168 00000100:00100000:0.0:1788876738.865256:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343168 00000100:00100000:0.0:1788876738.865303:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1788876738.865311:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876738.865450:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.865456:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788876738.865656:0:47247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876738.865751:0:47247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876738.865780:0:47247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.865794:0:47247:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00080000:10000000:1.0:1788876738.865990:0:47214:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x45:0x0] (8/32) registered 00000100:00100000:0.0:1788876738.866217:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343296 00000100:00100000:0.0:1788876738.866223:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343296 00000100:00100000:0.0:1788876738.866330:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1788876738.866340:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876738.866400:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876738.866416:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1788876738.866711:0:47247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876738.866795:0:47247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876738.866858:0:47247:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876738.866884:0:47247:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876738.866925:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343424 00000100:00100000:2.0:1788876738.866931:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343424 00000100:00100000:2.0:1788876738.866957:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1788876738.866964:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876738.867177:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:47247:x1875771532343424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 213us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876738.867183:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:3.0:1788876738.867364:0:47247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:47247:1875771532343424:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788876738.876159:0:47247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788876738.876243:0:47247:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788876738.876263:0:47247:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1788876738.876647:0:47214:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 73014444033 00010000:00080000:1.0:1788876738.877927:0:47248:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 47248 00010000:02000000:1.0:1788876738.877942:0:47248:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1788876738.878281:0:47214:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788876738.878306:0:47214:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788876738.878329:0:47214:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788876738.878366:0:47214:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788876738.882220:0:47214:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876738.882568:0:47214:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1788876738.918346:0:47248:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788876738.918354:0:47248:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:0.0:1788876739.049842:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876739.049865:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532343552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876739.049937:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.049980:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343552 00000100:00100000:0.0:1788876739.049987:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343552 00000100:00100000:0.0:1788876739.050030:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1788876739.050038:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532343552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876739.050058:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876739.050096:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532343552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876739.050106:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1788876739.051286:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532343552:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876739.433050:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788876739.819633:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788876739.819642:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13ff33b000 from 75 10000000:01000000:2.0:1788876739.819649:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788876739.819704:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.819717:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.819729:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.819759:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.820203:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.820249:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876739.820924:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343680 00000100:00100000:1.0:1788876739.820933:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343680 00000100:00100000:1.0:1788876739.820986:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788876739.821062:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c249a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532343680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.821077:0:47221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876739.821095:0:47221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313af0c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af0bd expref: -99 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.821933:0:47221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313af0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0bd expref: 11 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.821953:0:47221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313af0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0bd expref: 11 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.821965:0:47221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486000, rc 0) 00000100:00100000:1.0:1788876739.822987:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c249a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532343680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1921us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.823268:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.823299:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.823312:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.823389:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.823447:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.823495:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.823506:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343808 00000100:00100000:3.0:1788876739.823515:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343808 00000100:00100000:3.0:1788876739.823563:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788876739.823572:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532343808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788876739.823592:0:47226:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788876739.823623:0:47226:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788876739.823627:0:47226:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 75 00000100:00100000:3.0:1788876739.823718:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532343808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.823727:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788876739.824208:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788876739.824746:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788876739.824805:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788876739.825231:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.825245:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876739.825258:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876739.825261:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:2.0:1788876739.825266:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876739.825306:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.825315:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.825326:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.825346:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.825412:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.825451:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.826372:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532343936 00000100:00100000:3.0:1788876739.826381:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532343936 00000100:00100000:3.0:1788876739.826448:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788876739.826457:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c249bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532343936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.826470:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876739.826486:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313af0d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af0cb expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.826512:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313af0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0cb expref: 12 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.826523:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313af0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0cb expref: 12 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.826532:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221000, rc 0) 00000100:00100000:3.0:1788876739.826589:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c249bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532343936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.826596:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788876739.827593:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532343936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.827629:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.827643:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.827723:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.827765:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.827938:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344064 00000100:00100000:0.0:1788876739.827945:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344064 00000100:00100000:0.0:1788876739.827996:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788876739.828006:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532344064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.828136:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532344064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876739.828143:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788876739.831440:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.831480:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.831538:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.831623:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.831659:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.831685:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344192 00000100:00100000:3.0:1788876739.831694:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344192 00000100:00100000:3.0:1788876739.831744:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788876739.831754:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c249ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532344192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.831866:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c249ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532344192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.831874:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788876739.832908:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876739.838532:0:47299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788876739.839687:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788876739.839792:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788876739.839805:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.839817:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876739.839827:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788876739.839830:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788876739.839833:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788876739.839870:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.839879:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.839889:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.839915:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.840358:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.840557:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13efdfc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.842686:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344320 00000100:00100000:2.0:1788876739.842703:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344320 00000100:00100000:2.0:1788876739.842761:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788876739.842771:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532344320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.842790:0:47221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.842809:0:47221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313af0e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af0d9 expref: -99 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.842837:0:47221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313af0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0d9 expref: 13 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.842847:0:47221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313af0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0d9 expref: 13 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.842856:0:47221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72400, rc 0) 00000100:00100000:2.0:1788876739.842958:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.843114:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788876739.843916:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.843993:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.844006:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.844082:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.844127:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.844156:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13efdfc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.844286:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344448 00000100:00100000:2.0:1788876739.844291:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344448 00000100:00100000:2.0:1788876739.844334:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788876739.844343:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c379b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.844514:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c379b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.844522:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788876739.844682:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.844715:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.844757:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.844785:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e7d65a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.844943:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344576 00000100:00100000:2.0:1788876739.844948:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344576 00000100:00100000:2.0:1788876739.844991:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788876739.844999:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c379a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.845706:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c379a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 705us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.845715:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788876739.845820:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876739.846781:0:47301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1788876739.846909:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1788876739.846934:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788876739.846945:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.846957:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876739.846968:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788876739.846972:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:2.0:1788876739.846975:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788876739.847007:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.847016:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.847025:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.847045:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.847091:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.847129:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876739.847413:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344704 00000100:00100000:0.0:1788876739.847420:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344704 00000100:00100000:0.0:1788876739.847465:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788876739.847474:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532344704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876739.847486:0:47226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876739.847500:0:47226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fad52400/0xf5bf0f7e313af0ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af0e7 expref: -99 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.847526:0:47226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fad52400/0xf5bf0f7e313af0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0e7 expref: 14 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.847538:0:47226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fad52400/0xf5bf0f7e313af0ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0e7 expref: 14 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.847547:0:47226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fad52400, rc 0) 00000100:00100000:0.0:1788876739.847596:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532344704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876739.847635:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788876739.847736:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.847751:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.847761:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.847827:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.847854:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.847882:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.847896:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344832 00000100:00100000:3.0:1788876739.847901:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344832 00000100:00100000:3.0:1788876739.848053:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788876739.848062:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532344832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.848196:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532344832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.848205:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788876739.848221:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.848273:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.848315:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.848339:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.848512:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532344960 00000100:00100000:2.0:1788876739.848517:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532344960 00000100:00100000:2.0:1788876739.848550:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788876739.848558:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532344960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.848672:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532344960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.848679:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788876739.848808:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532344960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876739.850893:0:47302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788876739.852805:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788876739.852839:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876739.852851:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.852863:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876739.852873:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876739.852876:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:2.0:1788876739.852879:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876739.852921:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.852930:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.853038:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.853069:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.853147:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.853239:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.853322:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345088 00000100:00100000:3.0:1788876739.853330:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345088 00000100:00100000:3.0:1788876739.853384:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788876739.853394:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532345088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.853597:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876739.853635:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220000/0xf5bf0f7e313af0fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af0f5 expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.853663:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220000/0xf5bf0f7e313af0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0f5 expref: 15 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.853673:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220000/0xf5bf0f7e313af0fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af0f5 expref: 15 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.853683:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220000, rc 0) 00000100:00100000:3.0:1788876739.853807:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.853814:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788876739.853896:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.853914:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.853924:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.854062:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.854091:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.854121:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.854165:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345216 00000100:00100000:3.0:1788876739.854171:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345216 00000100:00100000:3.0:1788876739.854198:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788876739.854205:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.854315:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.854323:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788876739.854396:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.854553:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.854631:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.854648:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d28840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.854772:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345344 00000100:00100000:3.0:1788876739.854777:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345344 00000100:00100000:3.0:1788876739.854849:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788876739.854857:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.854957:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1ae0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.854964:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788876739.855204:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876739.856631:0:47304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788876739.856861:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788876739.856893:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788876739.856905:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.856919:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876739.856930:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788876739.856933:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1788876739.856936:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788876739.856978:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.856987:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.857000:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876739.857025:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.857081:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.857203:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345472 00000100:00100000:2.0:1788876739.857210:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345472 00000100:00100000:2.0:1788876739.857255:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788876739.857264:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532345472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.857276:0:47226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.857289:0:47226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313af10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af103 expref: -99 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.857314:0:47226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313af10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af103 expref: 16 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.857326:0:47226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313af10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af103 expref: 16 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.857334:0:47226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73600, rc 0) 00000100:00100000:1.0:1788876739.857381:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c8014b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.857529:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.857536:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788876739.857685:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.857700:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.857709:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876739.857764:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.857788:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.857803:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c8014b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.857872:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345600 00000100:00100000:2.0:1788876739.857876:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345600 00000100:00100000:2.0:1788876739.857910:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876739.857918:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.858071:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.858079:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788876739.858149:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.858177:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.858215:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.858230:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c8014b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.858254:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345728 00000100:00100000:3.0:1788876739.858260:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345728 00000100:00100000:3.0:1788876739.858333:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788876739.858342:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.858931:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 589us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.858939:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788876739.859022:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876739.860679:0:47305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788876739.861024:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788876739.861054:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788876739.861067:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.861084:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876739.861094:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788876739.861097:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:2.0:1788876739.861100:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788876739.861145:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.861153:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.861163:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.861188:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.861259:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.861313:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876739.861331:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345856 00000100:00100000:1.0:1788876739.861339:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345856 00000100:00100000:1.0:1788876739.861395:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788876739.861414:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532345856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.861429:0:47221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876739.861446:0:47221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313af118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af111 expref: -99 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.861477:0:47221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313af118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af111 expref: 17 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.861488:0:47221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313af118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af111 expref: 17 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.861497:0:47221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487800, rc 0) 00000100:00100000:1.0:1788876739.861551:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532345856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876739.861557:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788876739.861643:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.861658:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.861668:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876739.861732:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.861758:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.861783:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34d4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876739.862549:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532345984 00000100:00100000:1.0:1788876739.862555:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532345984 00000100:00100000:1.0:1788876739.862594:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788876739.862618:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532345984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.862756:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532345984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876739.862765:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788876739.862782:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.862816:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.862859:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.862909:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346112 00000100:00100000:3.0:1788876739.862914:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346112 00000100:00100000:2.0:1788876739.862993:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.863029:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788876739.863038:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532346112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.863125:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532346112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.863132:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788876739.863200:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876739.867268:0:47306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788876739.867432:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788876739.867460:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876739.867471:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.867483:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876739.867493:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788876739.867496:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:3.0:1788876739.867498:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788876739.867539:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.867547:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.867558:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.867582:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.867717:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.867754:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca2cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.869914:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346240 00000100:00100000:2.0:1788876739.869940:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346240 00000100:00100000:2.0:1788876739.869997:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788876739.870008:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532346240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.870023:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.870039:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72800/0xf5bf0f7e313af126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af11f expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.870066:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72800/0xf5bf0f7e313af126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af11f expref: 18 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.870077:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72800/0xf5bf0f7e313af126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af11f expref: 18 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.870087:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72800, rc 0) 00000100:00100000:2.0:1788876739.870167:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.870174:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788876739.870291:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.870310:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.870321:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.870394:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.870445:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.870486:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca2cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.870846:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346368 00000100:00100000:2.0:1788876739.870852:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346368 00000100:00100000:2.0:1788876739.870886:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788876739.870895:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.871044:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.871051:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788876739.871248:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.871283:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.871324:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.871351:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca2cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.871408:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346496 00000100:00100000:2.0:1788876739.871413:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346496 00000100:00100000:2.0:1788876739.871446:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788876739.871453:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.871540:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c728c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.871546:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788876739.871627:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876739.872497:0:47307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788876739.873813:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788876739.873845:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876739.873857:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.873869:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876739.873882:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788876739.873886:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 72 10000000:01000000:0.0:1788876739.873890:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876739.873936:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.873945:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.873955:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876739.874071:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.874145:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.874193:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.874238:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346624 00000100:00100000:3.0:1788876739.874246:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346624 00000100:00100000:3.0:1788876739.874301:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788876739.874311:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532346624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.874323:0:47221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876739.874338:0:47221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221400/0xf5bf0f7e313af134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af12d expref: -99 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.874362:0:47221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221400/0xf5bf0f7e313af134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af12d expref: 19 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.874373:0:47221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221400/0xf5bf0f7e313af134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af12d expref: 19 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.874382:0:47221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221400, rc 0) 00000100:00100000:3.0:1788876739.874442:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c728d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532346624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.874449:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788876739.874642:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.874658:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.874667:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876739.874724:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.874757:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.874783:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876739.875160:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346752 00000100:00100000:0.0:1788876739.875167:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346752 00000100:00100000:0.0:1788876739.875194:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788876739.875203:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532346752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788876739.875220:0:47219:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788876739.875238:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788876739.875242:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788876739.875246:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788876739.875249:0:47219:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788876739.875252:0:47219:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 75 00000100:00100000:0.0:1788876739.875346:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532346752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876739.875354:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788876739.876032:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788876739.876133:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876739.876143:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.876153:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876739.876162:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788876739.876165:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788876739.876168:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788876739.876199:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.876206:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.876215:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876739.876233:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.876277:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.876320:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.879212:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532346880 00000100:00100000:2.0:1788876739.879233:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532346880 00000100:00100000:2.0:1788876739.879293:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788876739.879303:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532346880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.879322:0:47221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.879342:0:47221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af13b expref: -99 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.879371:0:47221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af13b expref: 20 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.879383:0:47221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af13b expref: 20 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.879392:0:47221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73400, rc 0) 00000100:00100000:2.0:1788876739.879485:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532346880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.879492:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788876739.879547:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532346880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.879570:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.879579:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876739.879668:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.879714:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.879749:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.883129:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347008 00000100:00100000:2.0:1788876739.883146:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347008 00000100:00100000:2.0:1788876739.883210:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788876739.883222:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532347008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.883474:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532347008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.883483:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788876739.883547:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.883621:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.883666:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876739.883690:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347136 00000100:00100000:2.0:1788876739.883694:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347136 00000100:00100000:2.0:1788876739.883718:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788876739.883724:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532347136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876739.883888:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c1a400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.890722:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532347136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6989us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.890735:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788876739.890837:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876739.893231:0:47309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788876739.893419:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788876739.893445:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788876739.893458:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.893469:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876739.893479:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788876739.893481:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:3.0:1788876739.893484:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788876739.893523:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.893531:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.893542:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.893566:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.893651:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.893685:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.893806:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347264 00000100:00100000:2.0:1788876739.893814:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347264 00000100:00100000:2.0:1788876739.893860:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788876739.893869:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532347264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.893880:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.893893:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313af150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af149 expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.893916:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313af150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af149 expref: 21 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.893935:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313af150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af149 expref: 21 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.893945:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73000, rc 0) 00000100:00100000:2.0:1788876739.893983:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532347264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.893989:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788876739.894103:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876739.894118:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.894126:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876739.894142:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876739.894146:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.894154:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876739.894160:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788876739.894162:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788876739.894164:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788876739.894180:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.894188:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.894195:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876739.894206:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.894231:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876739.894253:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.894650:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347392 00000100:00100000:2.0:1788876739.894657:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347392 00000100:00100000:2.0:1788876739.894687:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876739.894694:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532347392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.894701:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.894711:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313af15e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af157 expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.894737:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313af15e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af157 expref: 22 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.894745:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313af15e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af157 expref: 22 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.894752:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72e00, rc 0) 00000100:00100000:2.0:1788876739.894790:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532347392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.894800:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788876739.894964:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876739.894977:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.894985:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876739.894999:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788876739.895003:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.895009:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876739.895016:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788876739.895018:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:0.0:1788876739.895020:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788876739.895038:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.895045:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.895052:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876739.895066:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.895094:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.895122:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876739.895218:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347520 00000100:00100000:2.0:1788876739.895223:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347520 00000100:00100000:2.0:1788876739.895256:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876739.895264:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532347520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876739.895270:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876739.895280:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73c00/0xf5bf0f7e313af16c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af165 expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.895294:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73c00/0xf5bf0f7e313af16c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af165 expref: 23 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.895302:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73c00/0xf5bf0f7e313af16c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af165 expref: 23 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876739.895308:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73c00, rc 0) 00000100:00100000:2.0:1788876739.895344:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876739.895350:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788876739.895440:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876739.895451:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.895459:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876739.895510:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.895534:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.895559:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:3.0:1788876739.895597:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347648 00000100:00100000:3.0:1788876739.895625:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347648 00000100:00100000:3.0:1788876739.895652:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788876739.895659:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876739.895760:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876739.895767:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788876739.910446:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.910539:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.910657:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876739.910696:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c80149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876739.911862:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347776 00000100:00100000:0.0:1788876739.911877:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347776 00000100:00100000:0.0:1788876739.911963:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788876739.911975:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.912143:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876739.912151:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788876739.913463:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876739.914804:0:47311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788876739.916452:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788876739.916481:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788876739.916493:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.916505:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876739.916516:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788876739.916519:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:0.0:1788876739.916523:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788876739.916562:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.916570:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.916581:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876739.916622:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.916680:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.916721:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876739.916994:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532347904 00000100:00100000:1.0:1788876739.917002:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532347904 00000100:00100000:1.0:1788876739.917051:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788876739.917060:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532347904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876739.917072:0:47222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876739.917084:0:47222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487400/0xf5bf0f7e313af17a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af173 expref: -99 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.917107:0:47222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487400/0xf5bf0f7e313af17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af173 expref: 24 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.917118:0:47222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487400/0xf5bf0f7e313af17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af173 expref: 24 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876739.917127:0:47222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487400, rc 0) 00000100:00100000:1.0:1788876739.917168:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532347904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876739.917176:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876739.917620:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532347904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876739.917636:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876739.917646:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876739.917699:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532348032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876739.917731:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876739.917761:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876739.917914:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348032 00000100:00100000:1.0:1788876739.917991:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348032 00000100:00100000:1.0:1788876739.918025:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788876739.918034:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532348032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876739.918128:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532348032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (395us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788876739.918136:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788876739.920589:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532348032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788876739.920656:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788876739.920667:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876739.920679:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876740.270960:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876740.270995:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876740.271142:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876740.271165:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876740.271192:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876740.274295:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255296 00000100:00100000:1.0:1788876740.274312:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255296 00000100:00100000:1.0:1788876740.274409:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255168 00000100:00100000:1.0:1788876740.274413:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255168 00000100:00100000:1.0:1788876740.274441:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1661 00000100:00100000:1.0:1788876740.274455:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511255296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876740.274544:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511255296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (3599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876740.274552:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1661 00000100:00100000:1.0:1788876740.274572:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2499 00000100:00100000:1.0:1788876740.274576:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511255168:12345-192.168.203.11@tcp:38:kworker.0 00010000:00080000:1.0:1788876740.274635:0:6539:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13fd3b1000, cookie 0xf5bf0f7e313af00e 00010000:00080000:1.0:1788876740.274642:0:6539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t73014444034 exp ffff8a13fd3b1000 cur 1728 last 1788876738 00010000:02000400:1.0:1788876740.274650:0:6539:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788876740.274657:0:6539:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788876740.274686:0:6539:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788876740.274840:0:6539:0:(import.c:65:import_set_state_nolock()) ffff8a13d15bb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876740.274873:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511255168:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 295us (3707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876740.274880:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2499 00000100:00100000:1.0:1788876740.274905:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255680 00000100:00100000:1.0:1788876740.274909:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255680 00000100:00100000:1.0:1788876740.274929:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1788876740.274934:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1875771511255680:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:1.0:1788876740.274948:0:47222:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 1728 last 0 00000020:00000080:1.0:1788876740.275098:0:47222:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313af181 00000100:00080000:1.0:1788876740.275282:0:47222:0:(import.c:65:import_set_state_nolock()) ffff8a13c8696800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876740.275309:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511255680:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 373us (4115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876740.275316:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00080000:1.0:1788876740.275347:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876740.277460:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255552 00000100:00100000:1.0:1788876740.277474:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255552 00000100:00100000:1.0:1788876740.277534:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255424 00000100:00100000:1.0:1788876740.277537:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255424 00000100:00100000:1.0:1788876740.277568:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1235 00000100:00100000:1.0:1788876740.277578:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511255552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876740.277666:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511255552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 89us (6669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876740.277674:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1235 00000100:00100000:1.0:1788876740.277690:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1236 00000100:00100000:1.0:1788876740.277711:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511255424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876740.277740:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511255424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (6598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876740.277746:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1236 00000100:00080000:1.0:1788876740.277816:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876740.277820:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876740.315497:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876740.315577:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248384 00000100:00100000:1.0:1788876740.315587:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248384 00000100:00100000:1.0:1788876740.315670:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2500 00000100:00100000:1.0:1788876740.315680:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511248384:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:3.0:1788876740.318361:0:8722:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 73014444034, current: 73014444034, replaying 00000100:00100000:3.0:1788876740.318460:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511248384:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 2776us (2966us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876740.318471:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2500 00010000:00080000:1.0:1788876740.327446:0:47248:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1788876740.458580:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876741.486511:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876741.873172:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876741.874057:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255808 00000100:00100000:3.0:1788876741.874068:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255808 00000100:00100000:3.0:1788876741.874123:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1788876741.874133:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511255808:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876741.874151:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876741.874168:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220600/0xf5bf0f7e313af188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488c5 expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.874193:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220600/0xf5bf0f7e313af188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488c5 expref: 6 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.874205:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220600/0xf5bf0f7e313af188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488c5 expref: 6 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.874214:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220600, rc 0) 00000100:00100000:3.0:1788876741.874264:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511255808:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 132us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876741.874272:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1788876741.895473:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876741.895544:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511255936 00000100:00100000:0.0:1788876741.895557:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511255936 00000100:00100000:0.0:1788876741.895638:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1788876741.895649:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511255936:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788876741.895672:0:47222:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788876741.895689:0:47222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788876741.895694:0:47222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788876741.895697:0:47222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788876741.895700:0:47222:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788876741.895703:0:47222:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 75 00000100:00100000:3.0:1788876741.900833:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511255936:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 5175us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876741.900848:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1788876741.905476:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876741.905549:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256064 00000100:00100000:3.0:1788876741.905559:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256064 00000100:00100000:3.0:1788876741.905677:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1788876741.905688:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511256064:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876741.905705:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876741.905723:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313af18f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488cc expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.905751:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313af18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488cc expref: 7 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.905766:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313af18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488cc expref: 7 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876741.905775:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221a00, rc 0) 00000100:00100000:3.0:1788876741.905828:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511256064:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876741.905835:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1788876741.919223:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876741.919289:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256192 00000100:00100000:2.0:1788876741.919299:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256192 00000100:00100000:2.0:1788876741.919352:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1788876741.919361:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511256192:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876741.919534:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511256192:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 173us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876741.919542:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1788876741.922592:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876741.923337:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256320 00000100:00100000:0.0:1788876741.923348:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256320 00000100:00100000:0.0:1788876741.924205:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1788876741.924217:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511256320:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876741.924378:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511256320:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 163us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876741.924397:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1788876741.943167:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876741.949890:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256448 00000100:00100000:2.0:1788876741.949904:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256448 00000100:00100000:2.0:1788876741.950010:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1788876741.950022:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511256448:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876741.950037:0:47226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876741.950057:0:47226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313af196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488d3 expref: -99 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876741.950084:0:47226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313af196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488d3 expref: 9 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876741.950095:0:47226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313af196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488d3 expref: 9 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876741.950105:0:47226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73e00, rc 0) 00000100:00100000:2.0:1788876741.951671:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256448:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 1643us (8503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876741.951683:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:1.0:1788876741.960794:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876741.960831:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256576 00000100:00100000:1.0:1788876741.960840:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256576 00000100:00100000:1.0:1788876741.960884:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1788876741.960893:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256576:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876741.961073:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256576:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 180us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876741.961081:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1788876741.974509:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876741.976320:0:47222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256704 00000100:00100000:0.0:1788876741.976334:0:47222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256704 00000100:00100000:0.0:1788876741.976557:0:47222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1788876741.976568:0:47222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256704:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876741.976719:0:47222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256704:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 152us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876741.976727:0:47222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1788876741.985738:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876741.985814:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256832 00000100:00100000:0.0:1788876741.985823:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256832 00000100:00100000:0.0:1788876741.985876:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1788876741.985886:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511256832:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876741.985901:0:47219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876741.985918:0:47219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fad52c00/0xf5bf0f7e313af19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488da expref: -99 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876741.985944:0:47219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fad52c00/0xf5bf0f7e313af19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488da expref: 10 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876741.985956:0:47219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fad52c00/0xf5bf0f7e313af19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488da expref: 10 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876741.985965:0:47219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fad52c00, rc 0) 00000100:00100000:0.0:1788876741.986015:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511256832:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 130us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876741.986023:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1788876741.994517:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876741.995370:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511256960 00000100:00100000:1.0:1788876741.995380:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511256960 00000100:00100000:1.0:1788876741.995443:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1788876741.995452:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511256960:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876741.995567:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511256960:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 116us (1059us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788876741.995587:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:0.0:1788876742.510333:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876743.146811:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532348160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876743.146887:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876743.147671:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348160 00000100:00100000:0.0:1788876743.147682:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348160 00000100:00100000:0.0:1788876743.147737:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1788876743.147747:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532348160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876743.147776:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788876743.150957:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876743.151182:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532348160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3431us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876743.151197:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1788876743.156133:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532348160:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876743.533490:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788876743.557399:0:47498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788876744.168800:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876744.168820:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532348288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876744.168925:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876744.168981:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876744.168997:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876744.169001:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876744.169007:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1726 00000100:00080000:1.0:1788876744.169011:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876744.169018:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876744.169041:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e4a80 x1875771532348672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876744.169060:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876744.169064:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876744.169066:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876744.169070:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1726 00000100:00080000:1.0:1788876744.169073:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876744.169077:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876744.169092:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e4700 x1875771532348800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876744.169102:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876744.169105:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876744.169107:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876744.169111:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1726 00000100:00080000:1.0:1788876744.169113:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1788876744.169115:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532348416:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788876744.169119:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876744.169136:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e7480 x1875771532348928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876744.169159:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876744.169163:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876744.169165:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788876744.169172:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876744.169175:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1726 00000100:00080000:1.0:1788876744.169179:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876744.169183:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876744.169198:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cff7d880 x1875771532349312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876744.169203:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876744.169212:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532349184:0@lo:400:kworker.0 00000100:00080000:1.0:1788876744.169233:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788876744.169236:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876744.169239:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876744.169247:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13ff363000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876744.169250:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.169260:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c5591f80 x1875771532349824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876744.169277:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532349440:0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.169344:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532348544:0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.169396:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.169424:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876744.169426:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532349568:0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.169460:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.169475:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532349056:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.169487:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348288 00000100:00100000:0.0:1788876744.169497:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348288 00000100:00100000:1.0:1788876744.169516:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.169542:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532349696:0@lo:400:kworker.0 00000100:00100000:1.0:1788876744.169572:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876744.169618:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348416 00000100:00100000:2.0:1788876744.169623:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348416 00000100:00100000:1.0:1788876744.169628:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532348672:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.169653:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.169671:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532348800:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.169691:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.169753:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1788876744.169765:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532348288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876744.169793:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876744.169836:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532348288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.169843:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1788876744.169865:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349184 00000100:00100000:0.0:1788876744.169868:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349184 00000100:00100000:0.0:1788876744.169891:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349568 00000100:00100000:0.0:1788876744.169894:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349568 00000100:00100000:0.0:1788876744.169912:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349696 00000100:00100000:0.0:1788876744.169915:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349696 00000100:00100000:2.0:1788876744.170030:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348672 00000100:00100000:2.0:1788876744.170034:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348672 00000100:00100000:2.0:1788876744.170044:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1788876744.170050:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532348416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876744.170072:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876744.170104:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532348416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876744.170110:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1788876744.170121:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1788876744.170125:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532348672:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788876744.170159:0:13623:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a13fd3b4000, cookie 0xf5bf0f7e313af007 00010000:00080000:2.0:1788876744.170164:0:13623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a13fd3b4000 cur 1732 last 1788876738 00000004:00100000:2.0:1788876744.170180:0:13623:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876744.170300:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a13f4441000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876744.170416:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532348672:12345-0@lo:38:kworker.0 Request processed in 289us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876744.170422:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1788876744.170710:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1788876744.170719:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532349184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.170768:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532349184:12345-0@lo:400:kworker.0 Request processed in 51us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.170774:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1788876744.170786:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1788876744.170792:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532349568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.170821:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532349568:12345-0@lo:400:kworker.0 Request processed in 29us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.170826:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1788876744.170837:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1788876744.170842:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532349696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.170870:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532349696:12345-0@lo:400:kworker.0 Request processed in 28us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.170876:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1788876744.170928:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532349696:0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.171178:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349440 00000100:00100000:3.0:1788876744.171185:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349440 00000100:00100000:3.0:1788876744.171221:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349056 00000100:00100000:3.0:1788876744.171224:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349056 00000100:00100000:3.0:1788876744.171247:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1788876744.171254:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532349440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.171289:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532349440:12345-0@lo:400:kworker.0 Request processed in 36us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876744.171295:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1788876744.171308:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1788876744.171314:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532349056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.171338:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532349056:12345-0@lo:400:kworker.0 Request processed in 24us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876744.171344:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1788876744.171362:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348544 00000100:00100000:3.0:1788876744.171366:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348544 00000100:00100000:3.0:1788876744.171405:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788876744.171413:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532348544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876744.171446:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532348544:12345-0@lo:400:kworker.0 Request processed in 34us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876744.171453:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788876744.172441:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532349056:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.172471:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532348544:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.172489:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532349568:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.172519:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532349440:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.172530:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532349184:0@lo:400:kworker.0 00000100:00100000:0.0:1788876744.172545:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532348416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876744.172561:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532348288:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788876744.174064:0:47248:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1788876744.174074:0:47248:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 73014444034 00000020:00080000:0.0:1788876744.174138:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.174142:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 73014444034, next_transno: 73014444034 00010000:00080000:0.0:1788876744.174147:0:47248:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (73014444034) 00000020:00080000:0.0:1788876744.174150:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.174165:0:47248:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511248384 t73014444034 from 192.168.203.11@tcp req@ffff8a13eb298a80 x1875771511248384/t0(73014444034) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:136/0 lens 528/0 e 0 to 0 dl 1788876751 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788876744.177799:0:47248:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3560us 00000001:00100000:0.0:1788876744.177846:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1788876744.179344:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876744.179354:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876744.179357:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788876744.181142:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788876744.183024:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348800 00000100:00100000:1.0:1788876744.183036:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348800 00000100:00100000:1.0:1788876744.183081:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1788876744.183089:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532348800:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876744.183119:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1732 last 0 00000020:00000080:1.0:1788876744.183169:0:8722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313af1a4 00000004:00100000:1.0:1788876744.183183:0:8722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876744.183212:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13d060c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876744.183279:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532348800:12345-0@lo:38:kworker.0 Request processed in 189us (13587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876744.183286:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00010000:00080000:1.0:1788876744.183329:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13ff5e4700 x1875771532348800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.183346:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 18 00000100:00080000:1.0:1788876744.185792:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a13ff5e4700 x1875771532348800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.185805:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788876744.185810:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788876744.185814:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788876744.185820:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532348800:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.185861:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532348928:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.186708:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.186747:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532349312:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.186779:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.186811:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532348928 00000100:00100000:1.0:1788876744.186817:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532348928 00000100:00100000:1.0:1788876744.186846:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349312 00000100:00100000:1.0:1788876744.186849:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349312 00000100:00100000:1.0:1788876744.186866:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:1.0:1788876744.186872:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532348928:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876744.186897:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1732 last 0 00000100:00100000:0.0:1788876744.187250:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1788876744.187257:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532349312:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788876744.187270:0:15659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1732 last 0 00000020:00000080:0.0:1788876744.187297:0:15659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313af1b2 00000004:00100000:0.0:1788876744.187320:0:15659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788876744.187353:0:15659:0:(import.c:65:import_set_state_nolock()) ffff8a12c49f9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876744.187432:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532349312:12345-0@lo:38:kworker.0 Request processed in 174us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.187440:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000001:00100000:0.0:1788876744.187472:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876744.187734:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313af1ab 00000004:00100000:1.0:1788876744.187743:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876744.187764:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13c72a2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876744.187797:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532348928:12345-0@lo:38:kworker.0 Request processed in 925us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876744.187804:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00010000:00080000:1.0:1788876744.187844:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13cff7d880 x1875771532349312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.187859:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 18 00000100:00080000:1.0:1788876744.193772:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13cff7d880 x1875771532349312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.193786:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788876744.193792:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788876744.193795:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788876744.193801:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532349312:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.193816:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532349824:0@lo:38:kworker.0 00000100:00100000:1.0:1788876744.193895:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.194066:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349824 00000100:00100000:0.0:1788876744.194074:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349824 00000100:00100000:0.0:1788876744.194113:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:0.0:1788876744.194120:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532349824:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788876744.194146:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1732 last 0 00000020:00000080:0.0:1788876744.194183:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313af1b9 00000100:00080000:1.0:1788876744.197833:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 18 00000100:00080000:1.0:1788876744.197859:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1788876744.197865:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1788876744.197868:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:1.0:1788876744.197874:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:1.0:1788876744.197879:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1788876744.198067:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532348672:0@lo:38:kworker.0 00010000:00080000:1.0:1788876744.198092:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13ff5e7480 x1875771532348928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.198105:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 18 00000100:00080000:1.0:1788876744.203902:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13ff5e7480 x1875771532348928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876769 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.203917:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1788876744.203933:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1788876744.203938:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1788876744.203945:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532348928:0@lo:38:kworker.0 00010000:00080000:1.0:1788876744.203993:0:47522:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1788876744.203999:0:47522:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1788876744.204005:0:47522:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1788876744.205072:0:47522:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1788876744.205132:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532349952:0@lo:400:ldlm_lock_repla.0 00000004:00100000:0.0:1788876744.205739:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788876744.205782:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fd000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1788876744.213182:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.213214:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.213230:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.213242:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.213249:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.213256:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876744.215016:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.215345:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532349824:12345-0@lo:38:kworker.0 Request processed in 21221us (21447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876744.215356:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00010000:00080000:1.0:1788876744.215419:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a12c5591f80 x1875771532349824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876744.215438:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 18 00000100:00080000:1.0:1788876744.215446:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788876744.215451:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788876744.215455:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788876744.215462:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532349824:0@lo:38:kworker.0 00010000:00010000:0.0:1788876744.216188:0:47248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216202:0:47248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216210:0:47248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216215:0:47248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876744.216220:0:47248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216229:0:47248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216245:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83b00) 00010000:00010000:0.0:1788876744.216248:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876744.216252:0:47248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216258:0:47248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52600/0xf5bf0f7e313af1c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876744.216276:0:47248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ab4fb78 reply state 00000000683e83ad transno 73014444034 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216287:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.216294:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83d00) 00010000:00010000:0.0:1788876744.216296:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876744.216298:0:47248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788876744.216410:0:47248:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788876744.216426:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.216429:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 73014444035 00000020:00080000:0.0:1788876744.216433:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.216435:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 73014444035 00000100:00100000:2.0:1788876744.216640:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532349952 00000100:00100000:2.0:1788876744.216648:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532349952 00000100:00100000:2.0:1788876744.216690:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1788876744.216698:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532349952:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788876744.216716:0:13623:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13eb25e680 x1875771532349952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:140/0 lens 224/0 e 0 to 0 dl 1788876755 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876744.216728:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532349952:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (1719us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788876744.216734:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000020:00080000:0.0:1788876744.218283:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.218291:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 73014444035 00000100:00100000:2.0:1788876744.220156:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876744.220231:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511248896 00000100:00100000:0.0:1788876744.220241:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511248896 00000100:00100000:0.0:1788876744.220304:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2505 00000100:00100000:0.0:1788876744.220315:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511248896:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:0.0:1788876744.220336:0:6540:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 73014444035, current: 73014444035, replaying 00000100:00100000:0.0:1788876744.220350:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511248896:12345-192.168.203.11@tcp:36:rm.0 Request processed in 39us (203us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788876744.220357:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2505 00000020:00080000:0.0:1788876744.220380:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.220384:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 73014444035, next_transno: 73014444035 00010000:00080000:0.0:1788876744.220388:0:47248:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (73014444035) 00000020:00080000:0.0:1788876744.220391:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.220400:0:47248:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511248896 t73014444035 from 192.168.203.11@tcp req@ffff8a13fad3bb80 x1875771511248896/t0(73014444035) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:140/0 lens 512/0 e 0 to 0 dl 1788876755 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788876744.220478:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220494:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220505:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220518:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220525:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220531:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220643:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220652:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.220659:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221420:0:47248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221431:0:47248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221437:0:47248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221443:0:47248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876744.221448:0:47248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221455:0:47248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221467:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10b:0x0].0x0 (ffff8a13fae83e00) 00010000:00010000:0.0:1788876744.221470:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876744.221474:0:47248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221481:0:47248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52a00/0xf5bf0f7e313af1dc lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221503:0:47248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221509:0:47248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221515:0:47248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221519:0:47248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876744.221522:0:47248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221527:0:47248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221534:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83000) 00010000:00010000:0.0:1788876744.221536:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876744.221539:0:47248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221544:0:47248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53e00/0xf5bf0f7e313af1ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876744.221557:0:47248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a659882f reply state 000000003738a3ae transno 73014444035 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221569:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.221575:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83d00) 00010000:00010000:0.0:1788876744.221578:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876744.221581:0:47248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788876744.221671:0:47248:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788876744.221686:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.221689:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 73014444036 00000020:00080000:0.0:1788876744.221693:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.221695:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 73014444036 00000100:00100000:0.0:1788876744.226174:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876744.226245:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511250688 00000100:00100000:1.0:1788876744.226254:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511250688 00000100:00100000:1.0:1788876744.226311:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2506 00000100:00100000:1.0:1788876744.226321:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511250688:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:1.0:1788876744.226341:0:6539:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 73014444036, current: 73014444038, replaying 00000100:00100000:1.0:1788876744.226355:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511250688:12345-192.168.203.11@tcp:36:rm.0 Request processed in 36us (193us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876744.226362:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2506 00000020:00080000:0.0:1788876744.226415:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.226420:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 73014444038, next_transno: 73014444036 00010000:00080000:0.0:1788876744.226425:0:47248:0:(ldlm_lib.c:2284:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 73014444036, ql: 1, comp: 1, conn: 2, next: 73014444038, next_update 0 last_committed: 73014444033) 00000020:00080000:0.0:1788876744.226430:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.226439:0:47248:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511250688 t73014444038 from 192.168.203.11@tcp req@ffff8a12c261ea00 x1875771511250688/t0(73014444038) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:140/0 lens 504/0 e 0 to 0 dl 1788876755 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788876744.226527:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226544:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226557:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226571:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226577:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226587:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226786:0:47248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226795:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.226802:0:47248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876744.227020:0:47248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10a:0x0]: returning size 4096 00010000:00010000:0.0:1788876744.227036:0:47248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227043:0:47248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227050:0:47248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227055:0:47248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876744.227059:0:47248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227066:0:47248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227077:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10a:0x0].0x0 (ffff8a13fae83900) 00010000:00010000:0.0:1788876744.227080:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876744.227085:0:47248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227090:0:47248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53200/0xf5bf0f7e313af1f1 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227109:0:47248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227114:0:47248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227120:0:47248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227125:0:47248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876744.227128:0:47248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227134:0:47248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227142:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83400) 00010000:00010000:0.0:1788876744.227145:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876744.227147:0:47248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227152:0:47248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53000/0xf5bf0f7e313af1e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876744.227162:0:47248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a96e8831 reply state 00000000ac75a6b8 transno 73014444038 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227175:0:47248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.227181:0:47248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13fae83f00) 00010000:00010000:0.0:1788876744.227183:0:47248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876744.227186:0:47248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788876744.227265:0:47248:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788876744.227281:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.227283:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 73014444039 00000020:00080000:0.0:1788876744.227287:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876744.227289:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 73014444039 00000001:00080000:2.0:1788876744.238751:0:47215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 73014444034 is committed 00010000:00010000:1.0:1788876744.241735:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241752:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241760:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241766:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876744.241771:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241779:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241799:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83d00) 00010000:00010000:1.0:1788876744.241802:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876744.241806:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.241812:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53c00/0xf5bf0f7e313af1c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876744.247718:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876744.247794:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257088 00000100:00100000:2.0:1788876744.247804:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257088 00000100:00100000:2.0:1788876744.247863:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1664 00000100:00100000:2.0:1788876744.247872:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511257088:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788876744.247895:0:6541:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13ff5e7480 x1875771511257088/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:140/0 lens 224/0 e 0 to 0 dl 1788876755 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876744.247924:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511257088:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 54us (217us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788876744.247931:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1664 00000020:00080000:3.0:1788876744.248049:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876744.248055:0:47248:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 73014444039 00010000:00080000:3.0:1788876744.248058:0:47248:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788876744.248061:0:47248:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876744.248069:0:47248:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788876744.248072:0:47248:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788876744.248204:0:47248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 18, last_transno is 77309411328 00000001:00100000:2.0:1788876744.249493:0:47215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:2.0:1788876744.249503:0:47215:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788876744.249527:0:47215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 73014444038 is committed 00010000:00010000:3.0:1788876744.249596:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249622:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249630:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249635:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876744.249640:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249648:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249668:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249676:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad52000/0xf5bf0f7e313af1d5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249700:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249706:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249711:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249716:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876744.249719:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249725:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249733:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.249739:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fad53600/0xf5bf0f7e313af1ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 47248 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788876744.255301:0:47248:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788876744.255349:0:47248:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788876744.255363:0:47248:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a13eb25e680 x1875771532349952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:140/0 lens 224/0 e 0 to 0 dl 1788876755 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788876744.255531:0:47248:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13ff5e7480 x1875771511257088/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:140/0 lens 224/0 e 0 to 0 dl 1788876755 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788876744.255584:0:47248:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1788876744.259396:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788876744.259414:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a13eb25f100 x1875771532349952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876760 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788876744.259426:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a13eb25f100 x1875771532349952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876760 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788876744.259432:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788876744.259442:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1788876744.259449:0:3661:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000080e9c19f): req@ffff8a13fa780380 x1875771532330368/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876728 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876744.259467:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532349952:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788876744.259562:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.259621:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532330368 00000100:00100000:0.0:1788876744.259628:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532330368 00000100:00100000:0.0:1788876744.259672:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1788876744.259681:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532330368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876744.259721:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:0.0:1788876744.259768:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532330368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.259775:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:0.0:1788876744.259811:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532330368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876744.259918:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876744.259929:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532350080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876744.259958:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876744.259984:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350080 00000100:00100000:2.0:1788876744.259988:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350080 00000100:00100000:2.0:1788876744.260011:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1788876744.260017:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532350080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876744.260029:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:2.0:1788876744.260060:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532350080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876744.260065:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1788876744.260105:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532350080:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788876744.319562:0:47248:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620886c3e10 00100000:10000000:1.0:1788876744.319576:0:47248:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1788876744.324920:0:47234:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:0.0:1788876744.324987:0:47234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:47234:1875771532350208:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788876744.325062:0:47234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.325102:0:47234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d5729e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788876744.325277:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350208 00000100:00100000:3.0:1788876744.325285:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350208 00000100:00100000:3.0:1788876744.325349:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1788876744.325359:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:47234:x1875771532350208:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788876744.325393:0:8456:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -82 00002000:02000040:3.0:1788876744.325398:0:8456:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:641) 00000004:00080000:1.0:1788876744.327114:0:47236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876744.327156:0:47236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:47236:1875771532350336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876744.327215:0:47236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.327244:0:47236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876744.327268:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350336 00000100:00100000:1.0:1788876744.327273:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350336 00000100:00100000:1.0:1788876744.327721:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1788876744.327732:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:47236:x1875771532350336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788876744.327756:0:43971:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 641 -> diff = -82 00002000:02000040:1.0:1788876744.327760:0:43971:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:641) 00002000:00010000:0.0:1788876744.354836:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.354854:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.354873:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x281:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.354878:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.354885:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.354904:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.354916:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.354924:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.354977:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.355102:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.355107:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.355115:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x280:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.355118:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.355122:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.355130:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.355137:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.355144:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.355159:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788876744.355376:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.355384:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355392:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.355398:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355406:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355549:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355558:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001047b313/0xf5bf0f7e313af1f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355595:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.355599:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355633:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.355637:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355645:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355655:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355662:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ba56f7c/0xf5bf0f7e313af1ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.355675:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.355676:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.355678:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.356022:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.356029:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356038:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27f:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.356042:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.356048:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356059:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356067:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356075:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356102:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.356161:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.356167:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356175:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27e:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.356178:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.356182:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356703:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356717:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356724:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356742:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788876744.356796:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.356801:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356811:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27d:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.356814:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.356817:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356825:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356832:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356838:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356846:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788876744.356882:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.356887:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356895:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27c:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.356898:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.356902:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356911:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356919:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.356926:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357044:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876744.357050:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357057:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.357061:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357070:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357083:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357090:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c786ca/0xf5bf0f7e313af206 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357109:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.357112:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357118:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.357120:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357126:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357135:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357141:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067954f3a/0xf5bf0f7e313af20d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357151:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.357154:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357161:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.357165:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357172:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357179:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357186:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001048062f/0xf5bf0f7e313af214 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357271:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.357273:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.357274:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.357416:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876744.357493:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.357498:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357506:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.357509:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357517:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357528:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357535:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068765ba1/0xf5bf0f7e313af21b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.357549:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.357551:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.357552:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.357719:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.357726:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357735:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27b:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.357738:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.357743:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357753:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357768:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357776:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357824:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.357862:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.357867:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357875:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27a:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.357879:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.357883:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357892:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357901:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.357909:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.359971:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.359986:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.359998:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.360003:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360013:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360036:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360046:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622f130e/0xf5bf0f7e313af222 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360080:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.360084:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360091:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad52000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.360094:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360103:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360114:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.360123:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.360125:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.360127:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.362351:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.362377:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2dd37b/0xf5bf0f7e313af229 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.362557:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.362565:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362580:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x279:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.362585:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.362619:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362636:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362646:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362653:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.362746:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.362755:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.362763:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.362768:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.362782:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.362802:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.362812:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.362814:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.362815:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.362878:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.362883:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000672a6207/0xf5bf0f7e313af230 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.362958:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.362963:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362972:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x278:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.362974:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.362977:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362985:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362992:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.362999:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364562:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.364573:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364584:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fad53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.364587:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364597:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364628:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364639:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.364641:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.364642:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.364740:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.364748:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897196b5/0xf5bf0f7e313af237 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.364856:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.364862:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.364877:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x277:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.364881:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.364886:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.364897:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.364905:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.364912:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.364997:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.365002:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365009:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.365013:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365021:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365033:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365041:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365043:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365045:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.365096:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.365101:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a171ad/0xf5bf0f7e313af23e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.365150:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.365155:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365163:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x276:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.365165:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.365170:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365180:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365189:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365206:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365288:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.365294:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365301:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.365304:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365313:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365328:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365336:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365338:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365340:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.365398:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.365403:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6ac6ab/0xf5bf0f7e313af245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.365454:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.365459:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365467:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x275:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.365470:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.365474:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365484:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365497:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365504:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365638:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.365644:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365652:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.365655:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365664:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365677:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365686:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365688:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.365690:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.365761:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.365766:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046ebdf36/0xf5bf0f7e313af24c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.365820:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.365825:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365833:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x274:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.365836:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.365840:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365851:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365859:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.365872:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365909:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.365913:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365924:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.365927:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.365999:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366010:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366018:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366019:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366021:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.366075:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.366080:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049bc5332/0xf5bf0f7e313af253 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.366130:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.366134:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366142:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x273:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.366144:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.366148:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366156:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366163:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366170:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366531:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.366537:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366546:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.366550:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366560:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366574:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366584:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366586:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366589:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.366686:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.366691:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e68bb19/0xf5bf0f7e313af25a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.366746:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.366752:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366760:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x272:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.366764:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.366768:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366778:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366787:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366795:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366818:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.366823:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366830:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.366834:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366842:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366854:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.366862:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366863:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.366865:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.366912:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.366917:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005475ced0/0xf5bf0f7e313af261 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.366973:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.366978:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.366987:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x271:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.366990:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.366995:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367004:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367012:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367020:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367092:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.367097:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367105:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.367109:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367118:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367129:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367138:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.367140:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.367142:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.367189:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.367200:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941c4222/0xf5bf0f7e313af268 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.367244:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.367249:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367261:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x270:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.367264:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.367268:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367277:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367285:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367293:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367408:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.367413:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367420:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.367424:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367432:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367443:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367451:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.367452:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.367454:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.367505:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.367510:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bf5cc1c/0xf5bf0f7e313af26f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.367559:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.367564:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367571:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26f:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.367574:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.367578:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367587:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367595:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367623:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367663:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.367685:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.367693:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.367773:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.367811:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.367816:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367824:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26e:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.367827:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.367832:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367841:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367851:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.367859:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367882:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.367886:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367894:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.367898:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367908:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367919:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.367928:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000005e171d/0xf5bf0f7e313af276 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368009:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.368013:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368020:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.368024:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368033:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368045:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368054:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368056:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368060:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.368114:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.368120:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e1715c7/0xf5bf0f7e313af27d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.368172:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.368177:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368185:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26d:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.368188:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876744.368254:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.368279:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368289:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368297:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368305:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368414:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.368456:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.368461:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368469:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.368472:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.368476:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368486:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368493:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368500:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368531:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.368536:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368543:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.368547:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368554:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368565:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368571:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033029961/0xf5bf0f7e313af284 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368584:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.368587:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368594:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.368597:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368625:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368634:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368642:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368644:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368646:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.368716:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.368720:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d277be/0xf5bf0f7e313af28b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.368768:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.368773:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368781:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.368784:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.368788:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368796:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368803:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.368810:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368834:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.368839:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368845:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.368848:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368856:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368866:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.368875:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368876:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.368878:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.368997:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.369003:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000028a1052/0xf5bf0f7e313af292 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.369056:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.369061:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.369069:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.369073:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.369077:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.369086:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.369094:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.369100:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.369124:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.369129:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.369136:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.369140:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.369147:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.369158:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.369167:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.369168:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.369170:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.369288:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.369293:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3a4136/0xf5bf0f7e313af299 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788876744.371074:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.371085:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.371100:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.371105:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.371110:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.371120:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.371135:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.371142:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.371197:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.371205:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.371213:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe53e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.371217:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.371226:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.371243:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.371253:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.371255:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.371257:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.377805:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876744.377820:0:8456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb782a54/0xf5bf0f7e313af2a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.378021:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.378076:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.378083:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378096:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.378101:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.378108:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378121:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378132:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378145:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378165:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.378204:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.378209:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378217:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.378220:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.378224:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378233:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378241:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378248:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378260:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788876744.378321:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.378326:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378345:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.378348:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.378353:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378362:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378377:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378383:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378400:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788876744.378408:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876744.378413:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378422:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13cfe52400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.378427:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378436:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378458:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378465:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d6d968a/0xf5bf0f7e313af2a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378480:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876744.378482:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378487:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.378490:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378496:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378503:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378510:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb979e6/0xf5bf0f7e313af2ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378519:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.378522:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378529:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.378532:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378538:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378548:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378556:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fb0f74/0xf5bf0f7e313af2b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.378565:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.378567:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.378568:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.379032:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.379038:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876744.379967:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876744.379976:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.379987:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:3.0:1788876744.379991:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876744.379996:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380006:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380015:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380027:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380044:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876744.380146:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876744.380151:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380159:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:3.0:1788876744.380162:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876744.380166:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380174:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380182:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380188:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380200:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788876744.380207:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876744.380211:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380219:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.380222:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380230:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380244:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380251:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bef5e16/0xf5bf0f7e313af2bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380266:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.380269:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380275:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.380278:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380285:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380296:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380303:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af2c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380314:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.380315:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.380317:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876744.380377:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876744.380382:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380390:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:3.0:1788876744.380393:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876744.380396:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380405:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380412:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380419:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380432:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876744.380439:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876744.380443:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380450:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876744.380453:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380461:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380470:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380477:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004587c1d8/0xf5bf0f7e313af2ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380489:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.380490:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876744.380492:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876744.380534:0:8456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876744.380539:0:8456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380547:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:3.0:1788876744.380550:0:8456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876744.380554:0:8456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380569:0:8456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380577:0:8456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380584:0:8456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876744.380598:0:8456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876744.380640:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876744.380649:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.380660:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.380664:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.380675:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.380690:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.380700:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005527fe58/0xf5bf0f7e313af2d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.380720:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.380723:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.380726:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788876744.380981:0:8456:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:3.0:1788876744.381078:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:47234:x1875771532350208:12345-0@lo:5:osp-pre-0-0.0 Request processed in 55717us (56012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876744.381087:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00010000:00010000:0.0:1788876744.381302:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876744.382972:0:47234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:47234:1875771532350208:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788876744.382996:0:47234:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x281:0x0] from OST, last_created [0x280000401:0x281:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788876744.383090:0:47234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:47234:1875771532350592:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788876744.383155:0:47234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876744.383188:0:47234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876744.383506:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532350464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876744.383553:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.383821:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350464 00000100:00100000:1.0:1788876744.383830:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350464 00000100:00100000:1.0:1788876744.383923:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1788876744.383933:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532350464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876744.383959:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491648704 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876744.383983:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350592 00000100:00100000:0.0:1788876744.383990:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350592 00000100:00100000:1.0:1788876744.384017:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532350464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.384026:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1788876744.384027:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1788876744.384038:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:47234:x1875771532350592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788876744.384077:0:17045:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 642 00000100:00100000:0.0:1788876744.385674:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:47234:x1875771532350592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1635us (2515us total) trans 8589934858 rc 0/0 00000100:00100000:0.0:1788876744.385684:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1788876744.385746:0:47234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb299f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:47234:1875771532350592:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876744.385760:0:47234:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x281:0x0]-[0x280000401:0x2a1:0x0] 00002000:00010000:0.0:1788876744.385837:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x281:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.385845:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385861:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x281:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.385865:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x281:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.385872:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385888:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385899:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385908:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385927:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.385938:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.385943:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385950:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.385955:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385964:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385980:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.385987:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008037d843/0xf5bf0f7e313af2d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x281:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386005:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386008:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386009:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386085:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x280:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386091:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386099:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x280:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386102:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x280:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386106:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386115:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386122:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386130:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386143:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386150:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386154:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386160:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386163:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386171:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386180:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386188:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032a9120c/0xf5bf0f7e313af2df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x280:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386201:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386203:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386204:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386243:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386249:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386257:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27f:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386260:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386263:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386271:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386279:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386286:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386299:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386307:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386311:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386317:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386321:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386328:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386339:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386346:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b902073d/0xf5bf0f7e313af2e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386360:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386362:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386364:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386415:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386421:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386429:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27e:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386432:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386436:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386444:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386452:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386458:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386477:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386483:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386487:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386493:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386497:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386504:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386514:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386522:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bb0d6ca/0xf5bf0f7e313af2ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386533:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386535:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386537:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386574:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386579:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386587:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27d:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386590:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386594:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386623:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386631:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386638:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386649:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386654:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386658:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386663:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386666:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386674:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386684:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386696:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9567305/0xf5bf0f7e313af2f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386708:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386710:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386711:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386750:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386755:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386763:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27c:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386766:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386770:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386779:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386787:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386794:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386806:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386813:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386816:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386823:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386826:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386833:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386842:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386850:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac2074c/0xf5bf0f7e313af2fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386862:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386864:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.386865:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.386902:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.386907:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386915:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27b:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.386919:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.386923:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386936:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386945:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386952:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386965:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.386970:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.386974:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386981:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.386984:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.386992:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387001:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387007:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967cad1b/0xf5bf0f7e313af302 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387020:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387022:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387023:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.387063:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.387068:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387076:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27a:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.387079:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.387083:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387091:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387099:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387106:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387118:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.387124:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.387128:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387139:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.387142:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387149:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387158:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387165:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056d0d7a9/0xf5bf0f7e313af309 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387178:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387180:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387181:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.387218:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x279:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.387224:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387232:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x279:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.387235:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x279:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.387239:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387247:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387255:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387261:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387273:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.387280:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.387283:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387289:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.387292:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387298:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387306:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387313:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d549ee/0xf5bf0f7e313af310 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x279:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.387324:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387327:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.387328:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.387362:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x278:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.390576:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390597:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x278:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.390613:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x278:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.390619:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390634:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390646:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390653:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390678:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.390783:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x277:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.390788:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390795:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x277:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.390799:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x277:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.390803:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390812:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390821:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390827:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390845:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876744.390856:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876744.390863:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390869:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.390874:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390884:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390899:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.390906:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f65c6cc/0xf5bf0f7e313af317 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x278:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.391195:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.394138:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.394156:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.394171:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.394177:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.394192:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.394219:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.394228:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f157e0a3/0xf5bf0f7e313af31e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x277:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.394259:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.394261:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.394264:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.395583:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x276:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.395593:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395622:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x276:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.395628:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x276:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.395635:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395648:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395658:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395666:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395692:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.395707:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.395713:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395721:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.395726:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395735:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395749:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395763:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000436ba013/0xf5bf0f7e313af325 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x276:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395783:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.395785:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.395786:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.395868:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x275:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.395874:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395882:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x275:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.395885:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x275:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.395889:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395898:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395907:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.395914:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398221:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.398243:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.398251:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398265:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b10e00 already unused, calling callback (ffffffffc0cf24f0) 00000100:00100000:1.0:1788876744.398266:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532350464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788876744.398271:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398283:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398302:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398309:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da1eec9/0xf5bf0f7e313af32c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x275:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.398329:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.398343:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.398345:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.399124:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x274:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.399133:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399147:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x274:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.399151:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x274:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.399158:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399175:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399184:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399191:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399218:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876744.399241:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876744.399248:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.399258:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b11e00 already unused, calling callback (ffffffffc0cf24f0) 00002000:00010000:0.0:1788876744.399259:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x273:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.399263:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399266:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399289:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x273:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.399293:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x273:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.399294:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399299:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399311:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399324:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.399330:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.399350:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.399351:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457e0b13/0xf5bf0f7e313af333 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x274:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.399385:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.399387:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.399388:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.400886:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.400908:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.400916:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.400928:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.401586:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401637:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401661:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401669:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313af33a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x273:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401699:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.401701:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.401704:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.401844:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x272:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.401852:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401863:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x272:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.401867:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x272:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.401873:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401885:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401894:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401901:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.401921:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.401928:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.402529:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402540:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.402544:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402553:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402568:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402575:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313af341 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x272:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402594:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.402596:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.402598:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876744.402678:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x271:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.402683:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402692:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x271:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.402695:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x271:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.402699:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402708:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402715:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402722:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402739:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876744.402775:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x270:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876744.402780:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402787:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x270:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:0.0:1788876744.402790:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x270:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876744.402793:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402802:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402809:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402815:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402828:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876744.402835:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876744.402839:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402846:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.402850:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402857:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402866:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402872:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313af348 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x271:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402886:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.402890:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402896:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.402899:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402906:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402915:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.402921:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313af34f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x270:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.404268:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.405291:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.405300:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405327:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26f:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.405331:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.405337:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405351:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405362:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405381:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405399:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876744.405441:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.405446:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405454:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26e:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.405456:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.405460:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405468:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405475:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405482:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405492:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876744.405499:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876744.405503:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405510:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876744.405514:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405522:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405536:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405542:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313af356 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405556:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876744.405559:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405565:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876744.405568:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405574:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405582:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405589:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027de8643/0xf5bf0f7e313af35d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405597:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405599:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405613:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.405660:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.405666:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405673:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26d:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.405676:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.405680:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405689:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405697:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405705:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405717:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876744.405724:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876744.405727:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405733:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876744.405736:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405743:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405752:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405759:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313af364 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405770:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405772:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405773:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.405809:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.405815:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405823:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26c:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.405825:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.405828:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405841:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405849:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405857:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405871:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876744.405877:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876744.405881:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405887:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876744.405890:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405898:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405908:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405915:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f01aecff/0xf5bf0f7e313af36b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405928:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405929:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.405931:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.405971:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.405976:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405983:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26b:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.405986:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.405990:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.405999:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406006:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406013:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406024:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876744.406030:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876744.406034:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406047:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876744.406050:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406056:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406065:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.406072:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553b174a/0xf5bf0f7e313af372 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.408069:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.408078:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.408082:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.408096:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.408754:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.408757:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876744.408759:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.408882:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.408892:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.408912:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26a:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.408916:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.408922:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.408936:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.408947:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.408955:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.408969:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876744.409009:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x269:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.409014:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.409022:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x269:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.409025:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x269:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.409028:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.409037:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.409045:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.409053:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.409071:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876744.410531:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876744.410543:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410555:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.410560:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410572:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410591:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410598:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000641c294/0xf5bf0f7e313af379 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410635:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.410639:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410646:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.410650:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410658:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410669:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410676:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36789dc/0xf5bf0f7e313af380 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x269:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.410688:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.410690:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.410692:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.410712:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.412524:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x268:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.412536:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.412553:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x268:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.412557:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x268:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.412564:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.412578:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.412589:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.412597:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.413256:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876744.413469:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876744.413477:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.413488:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876744.413493:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.413504:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.413521:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.413530:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d677d3/0xf5bf0f7e313af387 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x268:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876744.413554:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.413556:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876744.413558:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.414420:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x267:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.414432:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.414444:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x267:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.414449:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x267:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.414456:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.414469:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.414479:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.414489:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416020:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876744.416319:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876744.416328:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.416339:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.416345:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.416355:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.416385:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.416392:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313af38e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x267:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.416413:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.416415:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.416416:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876744.416480:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x266:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.416487:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416496:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x266:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.416500:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x266:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.416506:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416516:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416525:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416532:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416554:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876744.416595:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x265:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.416619:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416638:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x265:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.416642:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x265:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.416646:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416654:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416662:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416669:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416683:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788876744.416720:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x264:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.416725:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416733:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x264:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.416736:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x264:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.416740:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416750:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416757:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416764:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416776:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788876744.416813:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x263:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.416817:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416824:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x263:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.416827:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x263:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.416831:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416839:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416852:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416860:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416869:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788876744.416906:0:43971:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x262:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876744.416911:0:43971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416918:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x262:0x0].0x0 since=1732s v=(0 0) 00010000:00010000:1.0:1788876744.416921:0:43971:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x262:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876744.416925:0:43971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416934:0:43971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416942:0:43971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416949:0:43971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876744.416963:0:43971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1788876744.417326:0:43971:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00000100:00100000:1.0:1788876744.420776:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:47236:x1875771532350336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93035us (93549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876744.420792:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1788876744.420868:0:47236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:47236:1875771532350336:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788876744.420886:0:47236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x281:0x0] from OST, last_created [0x2c0000401:0x281:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876744.420989:0:47236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:47236:1875771532350848:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876744.421034:0:47236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876744.421065:0:47236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a73c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788876744.421193:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788876744.421206:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421219:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.421225:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421238:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421264:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421271:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000137f9bd3/0xf5bf0f7e313af395 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x266:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421295:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788876744.421299:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421317:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.421320:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421327:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421336:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421343:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be322353/0xf5bf0f7e313af39c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x265:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421354:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876744.421358:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421375:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.421378:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421384:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421393:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421401:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc6279cf/0xf5bf0f7e313af3a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x264:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421413:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876744.421416:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421422:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.421425:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421432:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421441:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421448:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba933059/0xf5bf0f7e313af3aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x263:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421460:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876744.421463:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421468:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876744.421471:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421476:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421484:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421491:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313af3b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x262:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876744.421501:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.421502:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.421504:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876744.421511:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876744.424207:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350848 00000100:00100000:1.0:1788876744.424221:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350848 00000100:00100000:1.0:1788876744.424277:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788876744.424285:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:47236:x1875771532350848:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788876744.424341:0:43966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 642 00000100:00100000:0.0:1788876744.427477:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532350720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876744.427577:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876744.430220:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350720 00000100:00100000:0.0:1788876744.430233:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350720 00000100:00100000:0.0:1788876744.430293:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1788876744.430302:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532350720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876744.430403:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491904064 pending 896 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876744.430483:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532350720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876744.430490:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1788876744.430541:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532350720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788876744.430581:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876744.432036:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:47236:x1875771532350848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7748us (10998us total) trans 4294967566 rc 0/0 00000100:00100000:1.0:1788876744.432048:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1788876744.435550:0:47236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:47236:1875771532350848:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788876744.435578:0:47236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x281:0x0]-[0x2c0000401:0x2a1:0x0] 00010000:00010000:2.0:1788876744.552821:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788876744.836035:0:47554:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788876744.839304:0:47554:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788876745.394316:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876745.394369:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876745.394396:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876745.394413:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876745.394445:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876745.394485:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257472 00000100:00100000:0.0:1788876745.394494:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257472 00000100:00100000:0.0:1788876745.394547:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257344 00000100:00100000:0.0:1788876745.394551:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257344 00000100:00100000:0.0:1788876745.394575:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1665 00000100:00100000:0.0:1788876745.394584:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511257472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876745.394679:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511257472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876745.394687:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1665 00000100:00100000:0.0:1788876745.394706:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1666 00000100:00100000:0.0:1788876745.394713:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511257344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876745.394738:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511257344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876745.394743:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1666 00000100:00100000:0.0:1788876745.394763:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257728 00000100:00100000:0.0:1788876745.394767:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257728 00000100:00100000:0.0:1788876745.394792:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257600 00000100:00100000:0.0:1788876745.394795:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257600 00000100:00100000:0.0:1788876745.394818:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1240 00000100:00100000:0.0:1788876745.394825:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511257728:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876745.394850:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511257728:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876745.394856:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1240 00000100:00100000:0.0:1788876745.394868:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1241 00000100:00100000:0.0:1788876745.394874:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511257600:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876745.395040:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511257600:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 165us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876745.395047:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1241 00000100:00100000:3.0:1788876745.397639:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257216 00000100:00100000:3.0:1788876745.397654:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257216 00000100:00100000:3.0:1788876745.397717:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:3.0:1788876745.397727:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511257216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876745.397799:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511257216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876745.397808:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00080000:3.0:1788876745.397846:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876745.397851:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876745.397854:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788876745.576840:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788876745.950062:0:47604:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876745.950369:0:47604:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788876746.601378:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876747.625978:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876747.969246:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876747.969885:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257856 00000100:00100000:1.0:1788876747.969897:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257856 00000100:00100000:1.0:1788876747.969978:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2507 00000100:00100000:1.0:1788876747.969988:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:35847:x1875771511257856:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1788876747.970007:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876747.970029:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35e00/0xf5bf0f7e313af3b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488e1 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788876747.970064:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788876747.970097:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876747.970111:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876747.970124:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876747.970189:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876747.970193:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876747.970232:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876747.970256:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35e00/0xf5bf0f7e313af3b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488e1 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876747.970273:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488e1 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876747.970282:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:1.0:1788876747.970284:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876747.970287:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34600, rc 0) 00000100:00100000:1.0:1788876747.970355:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:35847:x1875771511257856:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 368us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876747.970362:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2507 00000100:00100000:3.0:1788876747.979993:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876747.981184:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511257984 00000100:00100000:0.0:1788876747.981197:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511257984 00000100:00100000:0.0:1788876747.981268:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2508 00000100:00100000:0.0:1788876747.981278:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:35847:x1875771511257984:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876747.981313:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788876747.981402:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:35847:x1875771511257984:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 125us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876747.981409:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2508 00000100:00100000:0.0:1788876747.983156:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876747.983326:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258112 00000100:00100000:1.0:1788876747.983333:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258112 00000100:00100000:1.0:1788876747.983404:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2509 00000100:00100000:1.0:1788876747.983413:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:35847:x1875771511258112:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876747.983443:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876747.983578:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:35847:x1875771511258112:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 164us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876747.983586:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2509 00000100:00080000:3.0:1788876747.983668:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876747.993416:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876747.993645:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258240 00000100:00100000:2.0:1788876747.993656:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258240 00000100:00100000:2.0:1788876747.993731:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 994 00000100:00100000:2.0:1788876747.993751:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35847:x1875771511258240:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876747.993787:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876747.993861:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35847:x1875771511258240:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 112us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876747.993869:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 994 00000100:00080000:3.0:1788876747.996504:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876747.996714:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876747.996794:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258368 00000100:00100000:0.0:1788876747.996803:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258368 00000100:00100000:0.0:1788876747.996864:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 995 00000100:00100000:0.0:1788876747.996874:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35847:x1875771511258368:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876747.996917:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876747.996994:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:35847:x1875771511258368:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 121us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876747.997002:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 995 00000100:00080000:3.0:1788876747.999711:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876748.267548:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532350976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876748.267657:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876748.267788:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532350976 00000100:00100000:2.0:1788876748.267796:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532350976 00000100:00100000:2.0:1788876748.267875:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788876748.267885:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532350976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876748.267912:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876748.267973:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532350976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876748.267982:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00080000:0.0:1788876748.268255:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876748.269633:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532350976:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876748.651314:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876749.288842:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876749.288867:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532351104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876749.288939:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876749.289115:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351104 00000100:00100000:2.0:1788876749.289124:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351104 00000100:00100000:2.0:1788876749.289183:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1788876749.289193:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532351104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876749.289224:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876749.289274:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532351104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876749.289281:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1788876749.289323:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532351104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876749.289557:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876749.289568:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532351232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876749.289620:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.289648:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351232 00000100:00100000:0.0:1788876749.289652:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351232 00000100:00100000:0.0:1788876749.289688:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1788876749.289696:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532351232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876749.289714:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876749.289745:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532351232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.289751:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:0.0:1788876749.289767:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876749.289791:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532351232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876749.290179:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532351360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876749.290208:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.290261:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351360 00000100:00100000:0.0:1788876749.290265:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351360 00000100:00100000:0.0:1788876749.290292:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1788876749.290299:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532351360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876749.290317:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876749.299744:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532351488:0@lo:400:kworker.0 00000100:00100000:1.0:1788876749.299823:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.304720:0:47219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351488 00000100:00100000:3.0:1788876749.304740:0:47219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351488 00000100:00100000:3.0:1788876749.304826:0:47219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788876749.304840:0:47219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532351488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.305585:0:47219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532351488:12345-0@lo:400:kworker.0 Request processed in 744us (5758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.305595:0:47219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788876749.305740:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532351488:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.305875:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532351360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15574us (15663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.305886:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1788876749.307761:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532351360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876749.308297:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532351616:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.308362:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876749.308429:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351616 00000100:00100000:1.0:1788876749.308436:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351616 00000100:00100000:1.0:1788876749.308478:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:1.0:1788876749.308486:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532351616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876749.314037:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532351616:12345-0@lo:400:kworker.0 Request processed in 5541us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876749.314062:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1788876749.316179:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316246:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.316282:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352384:0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316307:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.316345:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352384 00000100:00100000:3.0:1788876749.316352:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352384 00000100:00100000:3.0:1788876749.316409:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788876749.316418:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316464:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352384:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.316472:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788876749.316510:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352384:0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316527:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788876749.316533:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532352000:0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316554:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.316572:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352512:0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.316593:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.317180:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351872 00000100:00100000:3.0:1788876749.317185:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351872 00000100:00100000:3.0:1788876749.317218:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:3.0:1788876749.317226:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532351872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.317263:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532351872:12345-0@lo:400:kworker.0 Request processed in 38us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.317269:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:3.0:1788876749.317298:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532351872:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320667:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532351616:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320706:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532352128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320772:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.320815:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532352640:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320839:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.320858:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788876749.320864:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532351744:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320883:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.320900:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532352256:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.320919:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.320954:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352000 00000100:00100000:0.0:1788876749.320960:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352000 00000100:00100000:0.0:1788876749.320997:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352512 00000100:00100000:0.0:1788876749.321000:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352512 00000100:00100000:0.0:1788876749.321022:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1788876749.321029:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532352000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321080:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532352000:12345-0@lo:400:kworker.0 Request processed in 51us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.321086:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1788876749.321101:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788876749.321108:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321134:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352512:12345-0@lo:400:kworker.0 Request processed in 27us (4540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.321139:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788876749.321193:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352128 00000100:00100000:0.0:1788876749.321196:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352128 00000100:00100000:0.0:1788876749.321219:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352640 00000100:00100000:3.0:1788876749.321220:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532351744 00000100:00100000:0.0:1788876749.321222:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352640 00000100:00100000:3.0:1788876749.321223:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532351744 00000100:00100000:0.0:1788876749.321231:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352256 00000100:00100000:0.0:1788876749.321234:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352256 00000100:00100000:3.0:1788876749.321245:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1788876749.321252:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532352128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.321290:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532352128:12345-0@lo:400:kworker.0 Request processed in 39us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.321296:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1788876749.321307:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1788876749.321314:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532352640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.321350:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532352640:12345-0@lo:400:kworker.0 Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.321355:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1788876749.321366:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1788876749.321373:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876749.321398:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532351744:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.321404:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1788876749.321479:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1788876749.321486:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532352256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321520:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532352256:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.321525:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00080000:0.0:1788876749.321552:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876749.321556:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876749.321559:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876749.321561:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876749.321582:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532351744:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321592:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532352256:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321618:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532352128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321630:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532352640:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321659:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532352000:0@lo:400:kworker.0 00000100:00100000:0.0:1788876749.321672:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352512:0@lo:400:kworker.0 00010000:00010000:0.0:1788876749.672825:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876749.805296:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876749.805318:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532352768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876749.808978:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876749.809091:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352768 00000100:00100000:3.0:1788876749.809101:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352768 00000100:00100000:3.0:1788876749.809154:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788876749.809163:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532352768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876749.809196:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876749.809254:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532352768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876749.809261:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788876749.809315:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532352768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876749.812722:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876749.812802:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876749.814161:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532352896 00000100:00100000:0.0:1788876749.814173:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532352896 00000100:00100000:0.0:1788876749.814222:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1788876749.814230:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876749.814254:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876749.814317:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532352896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876749.814324:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1788876749.821036:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532352896:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788876750.326193:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967566 is committed 00000001:00080000:0.0:1788876750.329784:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934858 is committed 00000100:00100000:2.0:1788876750.516388:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876750.516428:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876750.516454:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876750.516472:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876750.516496:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876750.516523:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258752 00000100:00100000:2.0:1788876750.516534:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258752 00000100:00100000:2.0:1788876750.516626:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258624 00000100:00100000:2.0:1788876750.516630:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258624 00000100:00100000:2.0:1788876750.516659:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1673 00000100:00100000:2.0:1788876750.516671:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511258752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876750.516747:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511258752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876750.516755:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1673 00000100:00100000:2.0:1788876750.516772:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1674 00000100:00100000:2.0:1788876750.516778:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511258624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876750.516801:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511258624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876750.516807:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1674 00000100:00100000:2.0:1788876750.516841:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259008 00000100:00100000:2.0:1788876750.516844:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259008 00000100:00100000:2.0:1788876750.516869:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258880 00000100:00100000:2.0:1788876750.516872:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258880 00000100:00100000:2.0:1788876750.516889:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1245 00000100:00100000:2.0:1788876750.516895:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511259008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876750.516920:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511259008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876750.516926:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1245 00000100:00100000:2.0:1788876750.516940:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1246 00000100:00100000:2.0:1788876750.516945:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511258880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876750.516968:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511258880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876750.516974:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1246 00000100:00080000:2.0:1788876750.517001:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876750.517004:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876750.517007:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876750.517008:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876750.521455:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511258496 00000100:00100000:3.0:1788876750.521472:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511258496 00000100:00100000:3.0:1788876750.521647:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1788876750.521659:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511258496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876750.521742:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511258496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 85us (5363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876750.521750:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00010000:00010000:2.0:1788876750.702513:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876751.721356:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876752.747172:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876753.388926:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532353024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876753.389006:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876753.389210:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353024 00000100:00100000:2.0:1788876753.389220:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353024 00000100:00100000:2.0:1788876753.389278:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1788876753.389287:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532353024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876753.389326:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876753.389372:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532353024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876753.389383:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00080000:0.0:1788876753.389444:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876753.389647:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532353024:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876753.769879:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876754.408900:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876754.408922:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532353152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876754.408991:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.409124:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353152 00000100:00100000:0.0:1788876754.409139:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353152 00000100:00100000:0.0:1788876754.409195:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1788876754.409208:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532353152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876754.409239:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876754.409289:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532353152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.409305:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1788876754.409345:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532353152:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788876754.409417:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876754.409835:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876754.409846:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532353280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876754.409878:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876754.409914:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353280 00000100:00100000:2.0:1788876754.409917:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353280 00000100:00100000:2.0:1788876754.409946:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788876754.409952:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532353280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876754.409977:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876754.410013:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532353280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.410029:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1788876754.410062:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532353280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876754.410780:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532353664:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.410813:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.410833:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532354176:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.410850:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.410864:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532354688:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.410880:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.410895:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788876754.410899:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532353792:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.410917:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.410930:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532354304:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.410948:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876754.410971:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353664 00000100:00100000:0.0:1788876754.410975:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353664 00000100:00100000:0.0:1788876754.411011:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354176 00000100:00100000:0.0:1788876754.411014:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354176 00000100:00100000:0.0:1788876754.411041:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354688 00000100:00100000:0.0:1788876754.411043:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354688 00000100:00100000:0.0:1788876754.411054:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353792 00000100:00100000:0.0:1788876754.411056:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353792 00000100:00100000:0.0:1788876754.411071:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1788876754.411077:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532353664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411113:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532353664:12345-0@lo:400:kworker.0 Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.411119:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1788876754.411147:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1788876754.411153:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532354176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411179:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532354176:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.411185:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:0.0:1788876754.411196:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1788876754.411202:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532354688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411227:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532354688:12345-0@lo:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.411233:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1788876754.411244:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1788876754.411250:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532353792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411274:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532353792:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.411279:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1788876754.411316:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354304 00000100:00100000:0.0:1788876754.411319:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354304 00000100:00100000:0.0:1788876754.411344:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788876754.411350:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532354304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411380:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532354304:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.411386:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00080000:0.0:1788876754.411404:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876754.411408:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876754.411433:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532353792:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411442:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532354304:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411450:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532353664:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411458:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532354176:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.411466:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532354688:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411746:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532353536:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411779:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.411795:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411828:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.411848:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411871:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.411889:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788876754.411895:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532353408:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411920:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.411944:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532353920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.411965:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.411979:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532354432:0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.412000:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876754.412045:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353408 00000100:00100000:1.0:1788876754.412049:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353408 00000100:00100000:1.0:1788876754.412077:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788876754.412083:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532353408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876754.412117:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532353408:12345-0@lo:400:kworker.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876754.412123:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788876754.412306:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532353408:0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412521:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354560 00000100:00100000:2.0:1788876754.412526:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354560 00000100:00100000:2.0:1788876754.412568:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353920 00000100:00100000:2.0:1788876754.412572:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353920 00000100:00100000:2.0:1788876754.412587:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354432 00000100:00100000:2.0:1788876754.412590:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354432 00000100:00100000:2.0:1788876754.412626:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1788876754.412633:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412676:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532354560:12345-0@lo:400:kworker.0 Request processed in 43us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.412683:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1788876754.412694:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1788876754.412712:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532353920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412740:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532353920:12345-0@lo:400:kworker.0 Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.412746:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1788876754.412757:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1788876754.412763:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532354432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412788:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532354432:12345-0@lo:400:kworker.0 Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.412794:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1788876754.412823:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532353920:0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412832:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934858 gen 2 00000100:00100000:2.0:1788876754.412843:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788876754.412852:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967566 gen 2 00000100:00100000:2.0:1788876754.412860:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532354560:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.413231:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532353536 00000100:00100000:0.0:1788876754.413236:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532353536 00000100:00100000:0.0:1788876754.413269:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354048 00000100:00100000:0.0:1788876754.413272:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354048 00000100:00100000:0.0:1788876754.413303:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1788876754.413311:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532353536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.413351:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532353536:12345-0@lo:400:kworker.0 Request processed in 41us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.413358:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:0.0:1788876754.413370:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1788876754.413376:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532354048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.413400:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532354048:12345-0@lo:400:kworker.0 Request processed in 25us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876754.413405:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1788876754.413433:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532353536:0@lo:400:kworker.0 00000100:00100000:0.0:1788876754.413441:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532354048:0@lo:400:kworker.0 00000100:00080000:1.0:1788876754.413983:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876754.413989:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876754.413991:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876754.414687:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876754.414709:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532354816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876754.414752:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876754.414783:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354816 00000100:00100000:2.0:1788876754.414787:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354816 00000100:00100000:2.0:1788876754.414813:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1788876754.414820:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532354816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876754.414843:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876754.414875:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532354816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.414881:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1788876754.414912:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532354816:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788876754.798077:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876754.893506:0:47797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1788876754.923076:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532354944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876754.923145:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876754.923210:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532354944 00000100:00100000:2.0:1788876754.923218:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532354944 00000100:00100000:2.0:1788876754.923268:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1788876754.923277:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532354944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876754.923313:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876754.923360:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532354944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876754.923377:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1788876754.923428:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532354944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876754.924947:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532355072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876754.924992:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876754.925670:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355072 00000100:00100000:3.0:1788876754.925679:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355072 00000100:00100000:3.0:1788876754.925725:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788876754.925734:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532355072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876754.925753:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876754.925806:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532355072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876754.925814:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788876754.925856:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532355072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876755.632923:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876755.632968:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876755.633001:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876755.633048:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876755.633076:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876755.633904:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259136 00000100:00100000:3.0:1788876755.633913:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259136 00000100:00100000:3.0:1788876755.633967:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:3.0:1788876755.633976:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511259136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876755.634051:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511259136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876755.634058:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:1.0:1788876755.634190:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259648 00000100:00100000:1.0:1788876755.634195:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259648 00000100:00100000:1.0:1788876755.634243:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259520 00000100:00100000:1.0:1788876755.634246:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259520 00000100:00100000:1.0:1788876755.634268:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1250 00000100:00100000:1.0:1788876755.634276:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511259648:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876755.634315:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511259648:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876755.634322:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1250 00000100:00100000:1.0:1788876755.634336:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1251 00000100:00100000:1.0:1788876755.634343:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511259520:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876755.634368:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511259520:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876755.634374:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1251 00000100:00080000:3.0:1788876755.634763:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876755.634768:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876755.634916:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259392 00000100:00100000:0.0:1788876755.634922:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259392 00000100:00100000:2.0:1788876755.634964:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259264 00000100:00100000:2.0:1788876755.634969:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259264 00000100:00100000:0.0:1788876755.634984:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1681 00000100:00100000:0.0:1788876755.634995:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511259392:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876755.635022:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1682 00000100:00100000:2.0:1788876755.635032:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511259264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876755.635051:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511259392:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 58us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876755.635059:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1681 00000100:00100000:2.0:1788876755.635066:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511259264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876755.635074:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1682 00000100:00080000:3.0:1788876755.635240:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788876755.635244:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876755.817396:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876756.846701:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788876756.957950:0:47845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1788876757.865650:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876758.505110:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876758.505148:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532355200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876758.505249:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876758.505571:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355200 00000100:00100000:3.0:1788876758.505584:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355200 00000100:00100000:3.0:1788876758.505709:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1788876758.505723:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532355200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876758.505763:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876758.505830:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532355200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876758.505837:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00080000:1.0:1788876758.505965:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876758.506044:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532355200:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876758.891002:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876759.039751:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876759.040013:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259776 00000100:00100000:2.0:1788876759.040028:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259776 00000100:00100000:2.0:1788876759.040133:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2510 00000100:00100000:2.0:1788876759.040147:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36316:x1875771511259776:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876759.040201:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876759.040304:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36316:x1875771511259776:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 159us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.040313:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2510 00000100:00080000:3.0:1788876759.041061:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876759.047341:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876759.047466:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511259904 00000100:00100000:0.0:1788876759.047480:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511259904 00000100:00100000:0.0:1788876759.047710:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2511 00000100:00100000:0.0:1788876759.047722:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:36316:x1875771511259904:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876759.047776:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876759.047884:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:36316:x1875771511259904:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 164us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876759.047892:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2511 00000100:00080000:3.0:1788876759.048112:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876759.051433:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876759.051656:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260032 00000100:00100000:3.0:1788876759.051670:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260032 00000100:00100000:3.0:1788876759.051765:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1005 00000100:00100000:3.0:1788876759.051781:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36316:x1875771511260032:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788876759.051896:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876759.052114:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36316:x1875771511260032:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 337us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876759.052123:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1005 00000100:00080000:1.0:1788876759.054054:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876759.062982:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876759.063112:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260160 00000100:00100000:3.0:1788876759.063128:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260160 00000100:00100000:3.0:1788876759.063232:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1006 00000100:00100000:3.0:1788876759.063247:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36316:x1875771511260160:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788876759.063299:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876759.063405:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36316:x1875771511260160:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 162us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876759.063414:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1006 00000100:00080000:1.0:1788876759.063583:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876759.134952:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876759.136557:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260288 00000100:00100000:1.0:1788876759.136576:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260288 00000100:00100000:1.0:1788876759.136730:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2512 00000100:00100000:1.0:1788876759.136745:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36332:x1875771511260288:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:1.0:1788876759.136798:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876759.136855:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313af3c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488e8 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.136994:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137023:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137047:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137067:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137073:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137087:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137213:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137222:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137230:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137236:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876759.137241:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137250:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137272:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:1.0:1788876759.137276:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876759.137281:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137288:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313af3cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137304:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137310:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137338:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137343:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876759.137346:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137352:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137360:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6813821 (ffff8a13d27b4500) 00010000:00010000:1.0:1788876759.137363:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876759.137366:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137373:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35200/0xf5bf0f7e313af3d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6813821 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137431:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313af3c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488e8 expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137443:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:1.0:1788876759.137445:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876759.137449:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34a00/0xf5bf0f7e313af3c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488e8 expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876759.137459:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34a00, rc 0) 00000100:00100000:1.0:1788876759.137566:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36332:x1875771511260288:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 823us (2629us total) trans 0 rc 301/301 00000100:00100000:1.0:1788876759.137574:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2512 00000100:00100000:1.0:1788876759.528942:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532355328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876759.529056:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876759.529305:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355328 00000100:00100000:2.0:1788876759.529317:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355328 00000100:00100000:2.0:1788876759.529389:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1788876759.529401:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532355328:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876759.529419:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532355584:0@lo:400:kworker.0 00000004:00000024:2.0:1788876759.529446:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876759.529469:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876759.529495:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532356096:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.529535:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.529585:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355584 00000100:00100000:1.0:1788876759.529591:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355584 00000100:00100000:1.0:1788876759.529648:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788876759.529656:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.529694:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532355584:12345-0@lo:400:kworker.0 Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876759.529702:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788876759.529843:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532355328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 443us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.529850:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1788876759.529875:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532355456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876759.529905:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876759.529929:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.529959:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.530151:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.530176:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.530197:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532356224:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.530226:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355456 00000100:00100000:1.0:1788876759.530230:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355456 00000100:00100000:1.0:1788876759.530248:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355712 00000100:00100000:1.0:1788876759.530251:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355712 00000100:00100000:1.0:1788876759.530275:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1788876759.530281:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532355456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876759.530305:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876759.530340:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532355456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876759.530345:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1788876759.530359:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788876759.530365:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.530397:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532355712:12345-0@lo:400:kworker.0 Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876759.530404:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788876759.530429:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532355840:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.540865:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532356480:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.541011:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532356608:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.541144:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356096 00000100:00100000:1.0:1788876759.541155:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356096 00000100:00100000:1.0:1788876759.541236:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:1.0:1788876759.541246:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532356096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.541330:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.541338:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532356096:12345-0@lo:400:kworker.0 Request processed in 92us (11800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876759.541348:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:1.0:1788876759.541368:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356480 00000100:00100000:3.0:1788876759.541424:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876759.541479:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532355584:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.541496:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876759.541706:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355968 00000100:00100000:0.0:1788876759.541711:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355968 00000100:00100000:0.0:1788876759.541752:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1788876759.541761:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532355968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876759.541803:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532355968:12345-0@lo:400:kworker.0 Request processed in 44us (11843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876759.541809:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1788876759.542000:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532356992:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.542279:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356608 00000100:00100000:3.0:1788876759.542285:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356608 00000100:00100000:3.0:1788876759.542334:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1788876759.542342:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532356608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.542417:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876759.542479:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532355456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876759.542492:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.542509:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876759.542519:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532357120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876759.542774:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532356608:12345-0@lo:400:kworker.0 Request processed in 431us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876759.542781:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1788876759.542798:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356992 00000100:00100000:3.0:1788876759.542802:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356992 00000100:00100000:3.0:1788876759.542821:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1788876759.542827:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532356992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.542860:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532356992:12345-0@lo:400:kworker.0 Request processed in 33us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876759.542866:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1788876759.542888:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876759.542930:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532356736:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.542964:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876759.542969:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876759.542976:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876759.542980:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876759.542994:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356224 00000100:00100000:0.0:1788876759.542999:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356224 00000100:00100000:3.0:1788876759.543006:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532355712:0@lo:400:kworker.0 00000100:00100000:0.0:1788876759.543033:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:3.0:1788876759.543040:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356736 00000100:00100000:0.0:1788876759.543042:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.543045:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356736 00000100:00100000:0.0:1788876759.543094:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532356224:12345-0@lo:400:kworker.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876759.543100:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00080000:0.0:1788876759.543114:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876759.543116:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876759.543252:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.543283:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356480 00000100:00100000:2.0:1788876759.543298:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532356992:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.543324:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:1.0:1788876759.543333:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.543392:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532356480:12345-0@lo:400:kworker.0 Request processed in 61us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876759.543407:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00080000:1.0:1788876759.543423:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876759.543443:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.543467:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.543493:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876759.543815:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532356224:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.543841:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532355840 00000100:00100000:2.0:1788876759.543845:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532355840 00000100:00100000:2.0:1788876759.543875:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1788876759.543882:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532355840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.543930:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532355840:12345-0@lo:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.543937:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1788876759.543969:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532356480:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.544001:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357120 00000100:00100000:2.0:1788876759.544005:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357120 00000100:00100000:2.0:1788876759.544037:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1788876759.544044:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532357120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876759.544063:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876759.544380:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532357120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 335us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.544387:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1788876759.544428:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532357120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876759.544474:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532356608:0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.550399:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356352 00000100:00100000:3.0:1788876759.550418:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356352 00000100:00100000:2.0:1788876759.552578:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1788876759.552642:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532356736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.552780:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532356736:12345-0@lo:400:kworker.0 Request processed in 188us (9814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.552788:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1788876759.554849:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1788876759.554882:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532356352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876759.555293:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532356352:12345-0@lo:400:kworker.0 Request processed in 430us (11797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876759.555302:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1788876759.555702:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.557011:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.557030:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532356864:0@lo:400:kworker.0 00000100:00100000:1.0:1788876759.557109:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876759.557153:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532355328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876759.557191:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532355840:0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.557306:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532356864 00000100:00100000:2.0:1788876759.557315:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532356864 00000100:00100000:2.0:1788876759.557527:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1788876759.557540:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532356864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876759.557648:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532356864:12345-0@lo:400:kworker.0 Request processed in 112us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876759.557657:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00080000:1.0:1788876759.557724:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876759.558187:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532356864:0@lo:400:kworker.0 00010000:00010000:2.0:1788876759.916209:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876760.041710:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532357376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876760.041828:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876760.041884:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876760.041891:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532357248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876760.041917:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876760.042033:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357376 00000100:00100000:3.0:1788876760.042044:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357376 00000100:00100000:3.0:1788876760.042109:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357248 00000100:00100000:3.0:1788876760.042113:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357248 00000100:00100000:3.0:1788876760.042145:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1788876760.042156:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532357376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876760.042189:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876760.042252:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532357376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876760.042272:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1788876760.042295:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1788876760.042302:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532357248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876760.042314:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876760.042342:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532357248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876760.042349:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1788876760.042413:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532357248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876760.042431:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532357376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876760.749768:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876760.749819:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876760.749856:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876760.749910:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876760.749951:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876760.750069:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260416 00000100:00100000:3.0:1788876760.750085:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260416 00000100:00100000:3.0:1788876760.750173:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1788876760.750188:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511260416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876760.750291:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511260416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 106us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876760.750302:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1788876760.750873:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260928 00000100:00100000:2.0:1788876760.750882:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260928 00000100:00100000:2.0:1788876760.750944:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260800 00000100:00100000:2.0:1788876760.750949:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260800 00000100:00100000:2.0:1788876760.750987:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1256 00000100:00100000:2.0:1788876760.750999:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511260928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876760.751062:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511260928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876760.751074:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1256 00000100:00100000:2.0:1788876760.751094:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1257 00000100:00100000:2.0:1788876760.751105:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511260800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876760.751147:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511260800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876760.751155:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1257 00000100:00100000:1.0:1788876760.751507:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260672 00000100:00100000:1.0:1788876760.751513:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260672 00000100:00100000:1.0:1788876760.751556:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511260544 00000100:00100000:1.0:1788876760.751559:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511260544 00000100:00100000:1.0:1788876760.751594:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1689 00000100:00100000:1.0:1788876760.751638:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511260672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876760.751675:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511260672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 75us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876760.751681:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1689 00000100:00100000:1.0:1788876760.751695:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1690 00000100:00100000:1.0:1788876760.751701:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511260544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876760.751724:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511260544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876760.751730:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1690 00010000:00010000:0.0:1788876760.937982:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876761.960895:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876762.993305:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876763.625434:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876763.625457:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532357504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876763.625525:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876763.626221:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357504 00000100:00100000:0.0:1788876763.626240:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357504 00000100:00100000:0.0:1788876763.626315:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788876763.626327:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532357504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876763.626358:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876763.626408:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532357504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876763.626415:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1788876763.626513:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532357504:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788876763.627442:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876764.010483:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876764.648761:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532357632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876764.648834:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.649047:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357632 00000100:00100000:1.0:1788876764.649056:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357632 00000100:00100000:1.0:1788876764.649104:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1788876764.649113:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532357632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876764.649160:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876764.649213:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532357632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.649220:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1788876764.649249:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876764.649259:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532357760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876764.649289:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.649320:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357760 00000100:00100000:1.0:1788876764.649325:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357760 00000100:00100000:1.0:1788876764.649349:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788876764.649355:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532357760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876764.649374:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876764.649408:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532357760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.649413:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1788876764.649453:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532357760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876764.649485:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532357632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876764.650742:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876764.650769:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532357888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876764.650815:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876764.650855:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532357888 00000100:00100000:2.0:1788876764.650860:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532357888 00000100:00100000:2.0:1788876764.650903:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1788876764.650911:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532357888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876764.650933:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876764.650970:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532357888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876764.650977:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1788876764.651013:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532357888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876764.651421:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876764.653478:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532358400:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653537:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.653566:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532358912:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653590:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.653644:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788876764.653651:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532358272:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653683:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.653701:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532358784:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653722:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.653749:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358400 00000100:00100000:1.0:1788876764.653766:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358400 00000100:00100000:1.0:1788876764.653811:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358272 00000100:00100000:1.0:1788876764.653814:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358272 00000100:00100000:1.0:1788876764.653830:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358784 00000100:00100000:1.0:1788876764.653833:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358784 00000100:00100000:1.0:1788876764.653848:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1788876764.653854:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532358400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653897:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532358400:12345-0@lo:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.653904:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1788876764.653923:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:1.0:1788876764.653929:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532358272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.653954:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532358272:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.653959:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:1.0:1788876764.653972:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1788876764.653978:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532358784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654001:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532358784:12345-0@lo:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654007:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1788876764.654027:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358912 00000100:00100000:1.0:1788876764.654031:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358912 00000100:00100000:1.0:1788876764.654058:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788876764.654064:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532358912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654092:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532358912:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654098:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00080000:1.0:1788876764.654142:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876764.654146:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876764.654148:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876764.654171:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532358144:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654195:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654212:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532358656:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654248:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654265:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532359168:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654283:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654297:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788876764.654302:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532358016:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654326:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654351:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532358528:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654372:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654389:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532359040:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654411:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876764.654436:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358016 00000100:00100000:1.0:1788876764.654440:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358016 00000100:00100000:1.0:1788876764.654467:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788876764.654474:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532358016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654507:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532358016:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654513:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788876764.654540:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358528 00000100:00100000:1.0:1788876764.654544:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358528 00000100:00100000:1.0:1788876764.654562:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359040 00000100:00100000:1.0:1788876764.654565:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359040 00000100:00100000:1.0:1788876764.654588:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1788876764.654594:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654638:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532358528:12345-0@lo:400:kworker.0 Request processed in 45us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654644:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1788876764.654654:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1788876764.654660:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532359040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654686:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532359040:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654692:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1788876764.654720:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358144 00000100:00100000:1.0:1788876764.654724:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358144 00000100:00100000:1.0:1788876764.654743:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532358656 00000100:00100000:1.0:1788876764.654746:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532358656 00000100:00100000:1.0:1788876764.654760:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359168 00000100:00100000:1.0:1788876764.654764:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359168 00000100:00100000:1.0:1788876764.654777:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1788876764.654782:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654812:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532358144:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654818:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1788876764.654829:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:1.0:1788876764.654834:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532358656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654857:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532358656:12345-0@lo:400:kworker.0 Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654861:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:1.0:1788876764.654870:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:1.0:1788876764.654874:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532359168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654897:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532359168:12345-0@lo:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876764.654903:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00080000:1.0:1788876764.654921:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876764.654924:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876764.654963:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532358272:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654973:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532358784:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654982:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532358400:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.654991:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532358912:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655025:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532358016:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655034:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532358528:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655044:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532359040:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655052:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efeced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532358144:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655060:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532358656:0@lo:400:kworker.0 00000100:00100000:1.0:1788876764.655068:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532359168:0@lo:400:kworker.0 00010000:00010000:0.0:1788876765.043266:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876765.161266:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532359296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876765.161862:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532359424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876765.161918:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876765.162042:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359424 00000100:00100000:0.0:1788876765.162052:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359424 00000100:00100000:0.0:1788876765.162134:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1788876765.162153:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532359424:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876765.162159:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876765.162199:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359296 00002000:00000024:0.0:1788876765.162204:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876765.162205:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359296 00000100:00100000:3.0:1788876765.162247:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788876765.162255:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532359296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876765.162274:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876765.162320:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532359296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876765.162328:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788876765.162394:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532359296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876765.162544:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532359424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 396us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876765.162556:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788876765.163053:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532359424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876765.881151:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876765.881206:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876765.881247:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876765.881268:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876765.881298:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876765.881333:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261312 00000100:00100000:0.0:1788876765.881342:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261312 00000100:00100000:0.0:1788876765.881399:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261184 00000100:00100000:0.0:1788876765.881402:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261184 00000100:00100000:0.0:1788876765.881427:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1697 00000100:00100000:0.0:1788876765.881437:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511261312:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876765.881504:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511261312:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876765.881516:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1697 00000100:00100000:0.0:1788876765.881533:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1698 00000100:00100000:0.0:1788876765.881540:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2395:x1875771511261184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876765.881562:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2395:x1875771511261184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876765.881569:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1698 00000100:00100000:0.0:1788876765.881586:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261568 00000100:00100000:0.0:1788876765.881590:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261568 00000100:00100000:2.0:1788876765.882025:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261056 00000100:00100000:2.0:1788876765.882031:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261056 00000100:00100000:2.0:1788876765.882077:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1788876765.882089:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511261056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876765.882137:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511261056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876765.882148:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00080000:2.0:1788876765.882240:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876765.882247:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876765.882251:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876765.882265:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261440 00000100:00100000:2.0:1788876765.882271:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261440 00000100:00100000:2.0:1788876765.882360:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1261 00000100:00100000:2.0:1788876765.882373:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511261440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876765.883117:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511261440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 744us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876765.883129:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1261 00000100:00080000:2.0:1788876765.883179:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876765.887652:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1262 00000100:00100000:0.0:1788876765.896048:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511261568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876765.896160:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511261568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 138us (14911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876765.896171:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1262 00010000:00010000:2.0:1788876766.058518:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876766.749061:0:48042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 7: mkdir |X| contained create ====== 10:12:45 (1788876765) 00000100:00100000:0.0:1788876766.852235:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876766.852312:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261696 00000100:00100000:2.0:1788876766.852321:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261696 00000100:00100000:2.0:1788876766.852378:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2513 00000100:00100000:2.0:1788876766.852388:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36918:x1875771511261696:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876766.852407:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876766.852429:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af3db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488ef expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852486:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852503:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852517:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852530:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852536:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852543:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852596:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852643:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852650:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852655:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876766.852659:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852667:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852679:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:2.0:1788876766.852682:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876766.852686:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852692:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af3e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852704:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852710:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852716:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852721:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876766.852723:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852729:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852736:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13f4518c00) 00010000:00010000:2.0:1788876766.852738:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876766.852740:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852746:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af3e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852777:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af3db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488ef expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852793:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:2.0:1788876766.852795:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876766.852799:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af3db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488ef expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876766.852807:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefec00, rc 0) 00000100:00100000:2.0:1788876766.853049:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36918:x1875771511261696:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 661us (820us total) trans 0 rc 301/301 00000100:00100000:2.0:1788876766.853057:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2513 00000100:00100000:2.0:1788876766.869592:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876766.869767:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511261952 00000100:00100000:1.0:1788876766.869777:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511261952 00000100:00100000:1.0:1788876766.869820:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2514 00000100:00100000:1.0:1788876766.869831:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36918:x1875771511261952:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:1.0:1788876766.869884:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876766.869911:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34600/0xf5bf0f7e313af3bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488e1 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.869930:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c66cf900) 00010000:00010000:1.0:1788876766.869940:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876766.870010:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.870023:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.870034:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.870051:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.870059:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.870066:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871272:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871287:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871296:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876766.871311:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c33fc7b6 reply state 000000009b5b8a7a transno 77309411329 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871322:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871329:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13d27b4f00) 00010000:00010000:1.0:1788876766.871332:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876766.871335:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788876766.871341:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00010000:00010000:1.0:1788876766.871348:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871355:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871363:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871370:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876766.871374:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871384:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871394:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4600) 00010000:00010000:1.0:1788876766.871396:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876766.871400:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871407:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34800/0xf5bf0f7e313af3f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876766.871421:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c33fc7b6 reply state 000000009b5b8a7a transno 77309411329 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871430:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876766.871436:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13d27b4000) 00010000:00010000:1.0:1788876766.871439:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876766.871441:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788876766.871522:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36918:x1875771511261952:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 1691us (1936us total) trans 77309411329 rc 0/0 00000100:00100000:1.0:1788876766.871531:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2514 00010000:00010000:0.0:1788876767.085124:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788876767.746873:0:47215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 77309411329 is committed 00010000:00010000:2.0:1788876767.746910:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746925:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746934:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746940:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876767.746945:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746955:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746976:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13d27b4000) 00010000:00010000:2.0:1788876767.746979:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876767.746986:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.746992:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34000/0xf5bf0f7e313af3f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747014:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747020:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747025:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747030:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876767.747032:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747037:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747043:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13d27b4f00) 00010000:00010000:2.0:1788876767.747045:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876767.747048:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876767.747053:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35800/0xf5bf0f7e313af3fe lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876767.821465:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876767.821579:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262080 00000100:00100000:3.0:1788876767.821589:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262080 00000100:00100000:3.0:1788876767.821729:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2515 00000100:00100000:3.0:1788876767.821741:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:36927:x1875771511262080:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1788876767.821767:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876767.821790:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca800/0xf5bf0f7e313af405 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488f6 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.821856:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.821870:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.821881:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876767.822050:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876767.822055:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876767.822080:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.822105:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca800/0xf5bf0f7e313af405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488f6 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.822121:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488f6 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876767.822128:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729d00) 00010000:00010000:3.0:1788876767.822131:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876767.822135:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb1cb200, rc 0) 00000100:00100000:3.0:1788876767.822193:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36927:x1875771511262080:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 455us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876767.822208:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2515 00000100:00080000:2.0:1788876767.823355:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876767.825492:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876767.825566:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262208 00000100:00100000:0.0:1788876767.825575:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262208 00000100:00100000:0.0:1788876767.825668:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2516 00000100:00100000:0.0:1788876767.825679:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36927:x1875771511262208:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:0.0:1788876767.825716:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:0.0:1788876767.825783:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36927:x1875771511262208:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876767.825791:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2516 00000100:00100000:0.0:1788876767.833954:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876767.834062:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262336 00000100:00100000:1.0:1788876767.834072:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262336 00000100:00100000:1.0:1788876767.834141:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2517 00000100:00100000:1.0:1788876767.834151:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:36927:x1875771511262336:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876767.834186:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00080000:3.0:1788876767.834271:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876767.847800:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:36927:x1875771511262336:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 13637us (13842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876767.847816:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2517 00000100:00100000:3.0:1788876767.859518:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876767.859671:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262464 00000100:00100000:0.0:1788876767.859681:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262464 00000100:00100000:0.0:1788876767.859740:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1014 00000100:00100000:0.0:1788876767.859751:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36927:x1875771511262464:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876767.859784:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876767.859846:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36927:x1875771511262464:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876767.859853:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1014 00000100:00080000:3.0:1788876767.860309:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876767.881005:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876767.881174:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262592 00000100:00100000:1.0:1788876767.881184:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262592 00000100:00100000:1.0:1788876767.881263:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1015 00000100:00100000:1.0:1788876767.881272:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36927:x1875771511262592:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876767.881302:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876767.881360:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36927:x1875771511262592:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 90us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876767.881368:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1015 00000100:00080000:3.0:1788876767.881418:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876768.010313:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876768.013793:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262848 00000100:00100000:2.0:1788876768.013810:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262848 00000100:00100000:2.0:1788876768.013938:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2518 00000100:00100000:2.0:1788876768.013950:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:36934:x1875771511262848:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:2.0:1788876768.014024:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876768.014056:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1cb200/0xf5bf0f7e313af40c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488f6 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014073:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729d00) 00010000:00010000:2.0:1788876768.014084:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876768.014160:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014174:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014183:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014195:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014212:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014219:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.014590:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015035:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015043:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015049:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876768.015054:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015063:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015074:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518c00) 00010000:00010000:2.0:1788876768.015076:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876768.015080:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015086:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af413 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876768.015103:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad66d750 reply state 00000000a13ea12d transno 77309411330 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015115:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.015121:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f4518400) 00010000:00010000:2.0:1788876768.015123:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876768.015126:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876768.015246:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36934:x1875771511262848:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1296us (4941us total) trans 77309411330 rc 0/0 00000100:00100000:2.0:1788876768.015255:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2518 00000100:00100000:1.0:1788876768.047085:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876768.047222:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262976 00000100:00100000:2.0:1788876768.047231:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262976 00000100:00100000:2.0:1788876768.047290:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2519 00000100:00100000:2.0:1788876768.047300:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:36937:x1875771511262976:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876768.047323:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876768.047347:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370488fd expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047414:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047430:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047441:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876768.047485:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876768.047489:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876768.047510:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047536:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488fd expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047552:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488fd expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.047566:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518c00) 00010000:00010000:2.0:1788876768.047569:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876768.047572:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff600, rc 0) 00000100:00100000:2.0:1788876768.048727:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:36937:x1875771511262976:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1422us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876768.048736:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2519 00000100:00100000:3.0:1788876768.058826:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876768.058876:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263104 00000100:00100000:0.0:1788876768.058887:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263104 00000100:00100000:0.0:1788876768.058941:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2520 00000100:00100000:0.0:1788876768.058950:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:36937:x1875771511263104:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876768.058970:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876768.058992:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587200/0xf5bf0f7e313af42f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048904 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059109:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059129:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059142:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059159:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059167:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059174:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059285:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059294:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059301:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876768.059359:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10d:0x0]: returning size 0 00000004:00200000:1.0:1788876768.059363:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876768.059391:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059405:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059414:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059421:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059432:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059437:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876768.059442:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059450:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059463:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518c00) 00010000:00010000:1.0:1788876768.059466:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876768.059472:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059479:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059491:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059498:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059504:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059509:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876768.059512:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059522:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059530:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f4518400) 00010000:00010000:1.0:1788876768.059532:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876768.059535:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059540:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af43d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059570:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587200/0xf5bf0f7e313af42f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048904 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059585:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048904 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876768.059593:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10d:0x0].0x0 (ffff8a13c4c77600) 00010000:00010000:1.0:1788876768.059595:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788876768.059597:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35600, rc 0) 00000100:00100000:1.0:1788876768.059709:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:36937:x1875771511263104:12345-192.168.203.11@tcp:101:rm.0 Request processed in 760us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876768.059718:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2520 00000100:00100000:1.0:1788876768.064378:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876768.064458:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263360 00000100:00100000:2.0:1788876768.064467:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263360 00000100:00100000:2.0:1788876768.064517:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2521 00000100:00100000:2.0:1788876768.064525:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:36937:x1875771511263360:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876768.064573:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876768.064596:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313af444 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048904 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064636:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10d:0x0].0x0 (ffff8a13c4c77600) 00010000:00010000:2.0:1788876768.064651:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313af428 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488fd expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064659:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518c00) 00010000:00010000:2.0:1788876768.064664:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876768.064686:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064698:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064707:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064717:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064725:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064731:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064809:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064817:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.064823:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065268:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065278:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065285:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065293:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065300:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065306:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065317:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876768.065333:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065339:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065345:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065351:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefec00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876768.065355:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065362:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065369:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10d:0x0].0x0 (ffff8a13f4518100) 00010000:00010000:2.0:1788876768.065372:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876768.065375:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065381:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefec00/0xf5bf0f7e313af459 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065393:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065427:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065433:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065438:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876768.065441:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065446:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065453:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518700) 00010000:00010000:2.0:1788876768.065455:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876768.065457:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065462:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af44b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876768.065473:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0cc70f7 reply state 00000000b019d1c2 transno 77309411331 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065482:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876768.065488:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f4518400) 00010000:00010000:2.0:1788876768.065490:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876768.065492:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876768.065556:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:36937:x1875771511263360:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1030us (1186us total) trans 77309411331 rc 0/0 00000100:00100000:2.0:1788876768.065563:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2521 00010000:00010000:0.0:1788876768.067329:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876768.067342:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876768.067351:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876768.067355:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876768.067365:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876768.067380:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10d:0x0].0x0 (ffff8a13f4518100) 00010000:00010000:0.0:1788876768.067384:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876768.067389:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876768.067395:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af460 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x10d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876768.067417:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876768.067418:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876768.067420:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876768.104902:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876768.745287:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876768.745324:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532359552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876768.745391:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876768.746047:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359552 00000100:00100000:0.0:1788876768.746059:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359552 00000100:00080000:3.0:1788876768.746182:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876768.747312:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1788876768.747325:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532359552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876768.747351:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876768.747421:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532359552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876768.747427:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1788876768.747519:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532359552:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876769.134469:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876769.772562:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532359808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772652:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772691:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532360320:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772713:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772726:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532360832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772741:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772752:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532361344:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772766:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772782:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788876769.772787:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532360192:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772803:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772815:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532360704:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772828:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772839:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532361216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772853:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772873:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532359936:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772891:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772905:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532360448:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772922:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772935:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532360960:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.772953:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.772969:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876769.772987:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.773008:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788876769.773013:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532360064:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.773032:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.773042:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532360576:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.773060:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.773077:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.773096:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.773115:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532361600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876769.773134:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.773166:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359808 00000100:00100000:2.0:1788876769.773173:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359808 00000100:00100000:2.0:1788876769.773227:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788876769.773236:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532359808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.773285:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532359808:12345-0@lo:400:kworker.0 Request processed in 50us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.773293:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788876769.773325:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360320 00000100:00100000:2.0:1788876769.773329:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360320 00000100:00100000:2.0:1788876769.773363:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360832 00000100:00100000:2.0:1788876769.773366:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360832 00000100:00100000:2.0:1788876769.773379:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361344 00000100:00100000:2.0:1788876769.773382:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361344 00000100:00100000:2.0:1788876769.773391:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360704 00000100:00100000:2.0:1788876769.773394:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360704 00000100:00100000:2.0:1788876769.773406:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360448 00000100:00100000:2.0:1788876769.773408:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360448 00000100:00100000:2.0:1788876769.773419:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360064 00000100:00100000:2.0:1788876769.773422:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360064 00000100:00100000:2.0:1788876769.773433:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1788876769.773439:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532360320:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876769.773454:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfccd500 x1875771532360320/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1788876780 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.773487:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532360320:12345-0@lo:400:kworker.0 Request processed in 48us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.773494:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1788876769.773505:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1788876769.773511:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532360832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.773539:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532360832:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.773545:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1788876769.773555:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1788876769.773560:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532361344:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876769.773574:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfccc700 x1875771532361344/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1788876780 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.773598:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532361344:12345-0@lo:400:kworker.0 Request processed in 38us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.773621:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1788876769.773633:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1788876769.773639:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532360704:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876769.773648:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfccf100 x1875771532360704/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1788876780 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.773673:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532360704:12345-0@lo:400:kworker.0 Request processed in 35us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776235:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1788876769.776275:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:2.0:1788876769.776290:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532360448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776392:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532360448:12345-0@lo:400:kworker.0 Request processed in 108us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776398:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:2.0:1788876769.776413:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1788876769.776421:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532360064:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876769.776434:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfccdf80 x1875771532360064/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1788876780 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.776463:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532360064:12345-0@lo:400:kworker.0 Request processed in 43us (3429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776469:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1788876769.776501:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360192 00000100:00100000:2.0:1788876769.776508:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360192 00000100:00100000:2.0:1788876769.776548:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361216 00000100:00100000:2.0:1788876769.776551:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361216 00000100:00100000:2.0:1788876769.776568:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360576 00000100:00100000:2.0:1788876769.776571:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360576 00000100:00100000:2.0:1788876769.776587:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361088 00000100:00100000:2.0:1788876769.776590:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361088 00000100:00100000:2.0:1788876769.776628:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788876769.776635:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532360192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776669:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532360192:12345-0@lo:400:kworker.0 Request processed in 34us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776675:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788876769.776686:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788876769.776692:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532361216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776717:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532361216:12345-0@lo:400:kworker.0 Request processed in 26us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776723:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788876769.776732:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1788876769.776738:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532360576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776762:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532360576:12345-0@lo:400:kworker.0 Request processed in 25us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776767:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1788876769.776777:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1788876769.776783:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776807:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361088:12345-0@lo:400:kworker.0 Request processed in 24us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776812:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1788876769.776838:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359936 00000100:00100000:2.0:1788876769.776842:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359936 00000100:00100000:2.0:1788876769.776859:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532360960 00000100:00100000:2.0:1788876769.776862:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532360960 00000100:00100000:2.0:1788876769.776871:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361472 00000100:00100000:2.0:1788876769.776873:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361472 00000100:00100000:2.0:1788876769.776882:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1788876769.776888:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532359936:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876769.776903:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfcce680 x1875771532359936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:165/0 lens 224/224 e 0 to 0 dl 1788876780 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.776938:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532359936:12345-0@lo:400:kworker.0 Request processed in 49us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776944:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1788876769.776955:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1788876769.776961:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532360960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.776989:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532360960:12345-0@lo:400:kworker.0 Request processed in 28us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.776994:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1788876769.777005:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1788876769.777010:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876769.777051:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876769.777086:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.777093:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1788876769.777135:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361600 00000100:00100000:2.0:1788876769.777139:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361600 00000100:00100000:2.0:1788876769.777164:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1788876769.777170:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532361600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876769.777196:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876769.777227:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532361600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.777233:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:2.0:1788876769.777254:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876769.777258:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876769.777260:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876769.777263:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876769.777297:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532359680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876769.777343:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876769.777380:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532359680 00000100:00100000:2.0:1788876769.777384:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532359680 00000100:00100000:2.0:1788876769.777403:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1788876769.777408:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532359680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876769.777425:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00010000:00000080:2.0:1788876769.777435:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac99880 x1875771532359680/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:165/0 lens 224/368 e 0 to 0 dl 1788876780 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876769.777466:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532359680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876769.777473:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1788876769.777512:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532359680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876769.777541:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532360192:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777553:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532360704:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777563:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532361216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777573:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532359808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777584:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532360320:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777594:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532360832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876769.777624:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532361344:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780499:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780517:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532360576:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780529:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361088:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780550:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532361600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876769.780562:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532359936:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780574:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532360448:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780585:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532360960:0@lo:400:kworker.0 00000100:00100000:0.0:1788876769.780598:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788876770.154423:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876770.281898:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876770.281995:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876770.282350:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876770.282388:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876770.282877:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361728 00000100:00100000:0.0:1788876770.282888:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361728 00000100:00100000:0.0:1788876770.282948:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361856 00000100:00100000:0.0:1788876770.282952:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361856 00000100:00100000:0.0:1788876770.282978:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1788876770.282991:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532361728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876770.283034:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876770.283043:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1788876770.283066:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876770.283097:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876770.283118:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532361728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876770.283127:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1788876770.283337:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876770.284303:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532361856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876770.285589:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532361856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2523us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876770.285616:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1788876770.990724:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876770.990772:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876770.990805:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876770.990834:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876770.990861:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876770.990890:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263744 00000100:00100000:3.0:1788876770.990910:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263744 00000100:00100000:3.0:1788876770.990965:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263616 00000100:00100000:3.0:1788876770.990968:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263616 00000100:00100000:3.0:1788876770.990993:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1705 00000100:00100000:3.0:1788876770.991003:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511263744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876770.991083:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511263744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876770.991091:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1705 00000100:00100000:3.0:1788876770.991108:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1706 00000100:00100000:3.0:1788876770.991115:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511263616:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:3.0:1788876770.991132:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad1c700 x1875771511263616/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:166/0 lens 224/224 e 0 to 0 dl 1788876781 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876770.991154:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511263616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876770.991160:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1706 00000100:00100000:3.0:1788876770.991187:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264000 00000100:00100000:3.0:1788876770.991191:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264000 00000100:00100000:3.0:1788876770.991216:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263872 00000100:00100000:3.0:1788876770.991218:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263872 00000100:00100000:1.0:1788876770.991231:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1267 00000100:00100000:2.0:1788876770.991278:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263488 00000100:00100000:2.0:1788876770.991282:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263488 00000100:00100000:2.0:1788876770.991323:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1788876770.991331:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511263488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876770.991356:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511263488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876770.991361:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788876770.991422:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511264000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876770.991463:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511264000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 224us (656us total) trans 0 rc 0/0 00000100:00080000:2.0:1788876770.995412:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876770.995427:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876770.995432:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876770.995436:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876771.000766:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1268 00000100:00100000:3.0:1788876771.000787:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511263872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876771.000873:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511263872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 95us (10010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876771.000881:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1268 00000100:00100000:1.0:1788876771.002733:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1267 00010000:00010000:0.0:1788876771.181034:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876772.203406:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876773.225630:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876773.872058:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532361984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876773.872128:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876773.873517:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532361984 00000100:00100000:0.0:1788876773.873528:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532361984 00000100:00100000:0.0:1788876773.873589:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1788876773.873598:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532361984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876773.873642:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876773.873700:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532361984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876773.873707:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1788876773.873753:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532361984:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788876773.879710:0:47215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 77309411331 is committed 00010000:00010000:3.0:1788876773.879738:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879748:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879756:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879762:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876773.879767:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879774:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879790:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f4518400) 00010000:00010000:3.0:1788876773.879793:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876773.879798:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879804:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313af41a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879821:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879826:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879831:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879835:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876773.879837:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879842:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879847:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f4518400) 00010000:00010000:3.0:1788876773.879849:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876773.879852:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876773.879857:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe400/0xf5bf0f7e313af452 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788876773.883765:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788876774.250178:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788876774.793079:0:48437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1788876774.873890:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876774.873966:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264128 00000100:00100000:3.0:1788876774.873978:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264128 00000100:00100000:3.0:1788876774.874087:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2522 00000100:00100000:3.0:1788876774.874098:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37005:x1875771511264128:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:3.0:1788876774.874119:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876774.874140:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca800/0xf5bf0f7e313af467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704890b expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788876774.874187:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788876774.874217:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876774.874243:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876774.874270:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876774.874312:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876774.874316:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876774.874350:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876774.874377:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca800/0xf5bf0f7e313af467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704890b expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876774.874398:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704890b expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876774.874406:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:3.0:1788876774.874409:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876774.874412:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb1ca400, rc 0) 00010000:00000080:3.0:1788876774.874419:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfcd8380 x1875771511264128/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:170/0 lens 576/688 e 0 to 0 dl 1788876785 ref 1 fl Interpret:/600/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788876774.874483:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37005:x1875771511264128:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 387us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.874491:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2522 00000100:00100000:1.0:1788876774.880836:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876774.886118:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264256 00000100:00100000:2.0:1788876774.886134:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264256 00000100:00100000:2.0:1788876774.886218:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2523 00000100:00100000:2.0:1788876774.886230:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0b02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37005:x1875771511264256:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:2.0:1788876774.886249:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876774.886286:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313af475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048912 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886350:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886371:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886383:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886399:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886406:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886413:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886501:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886510:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886518:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876774.886550:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00000004:00200000:2.0:1788876774.886554:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876774.886571:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886585:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886595:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886622:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886628:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876774.886632:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886640:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886652:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e1729200) 00010000:00010000:2.0:1788876774.886655:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876774.886660:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886667:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff200/0xf5bf0f7e313af47c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886681:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886975:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886982:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886988:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876774.886992:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.886999:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.887008:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13f4518800) 00010000:00010000:2.0:1788876774.887011:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876774.887014:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.887021:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe600/0xf5bf0f7e313af483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.887051:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe200/0xf5bf0f7e313af475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048912 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.887064:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048912 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876774.887072:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:2.0:1788876774.887074:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788876774.887077:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff400, rc 0) 00010000:00000080:2.0:1788876774.887084:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13d0b02450 x1875771511264256/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:170/0 lens 592/688 e 0 to 0 dl 1788876785 ref 1 fl Interpret:/600/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876774.887197:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0b02450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37005:x1875771511264256:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 968us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.887205:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2523 00000100:00100000:2.0:1788876774.889436:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532362112:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889494:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889547:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532362624:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889572:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889593:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532363136:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889635:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889655:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532363648:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889675:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889765:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788876774.889772:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532362240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889823:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889841:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532362752:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889862:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889878:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532363264:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889897:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889924:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532362368:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889945:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889959:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532362880:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.889981:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.889997:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532363392:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.890014:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.890030:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788876774.890035:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532362496:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.890055:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.890085:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532363008:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.890105:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.890116:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532363520:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.890134:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.890439:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362624 00000100:00100000:2.0:1788876774.890446:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362624 00000100:00100000:2.0:1788876774.890533:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363136 00000100:00100000:2.0:1788876774.890537:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363136 00000100:00100000:3.0:1788876774.890692:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532363776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876774.890721:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876774.890751:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362240 00000100:00100000:3.0:1788876774.890755:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362240 00000100:00100000:3.0:1788876774.890776:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363264 00000100:00100000:3.0:1788876774.890779:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363264 00000100:00100000:3.0:1788876774.890788:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363776 00000100:00100000:3.0:1788876774.890790:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363776 00000100:00100000:3.0:1788876774.890801:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1788876774.890809:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532362240:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876774.890833:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb124700 x1875771532362240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/224 e 0 to 0 dl 1788876785 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876774.890869:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532362240:12345-0@lo:400:kworker.0 Request processed in 60us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.890880:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1788876774.890896:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1788876774.890902:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532363264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.890930:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532363264:12345-0@lo:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.890936:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1788876774.890947:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788876774.890953:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532363776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876774.890975:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00010000:00000080:3.0:1788876774.890987:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad1c380 x1875771532363776/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/368 e 0 to 0 dl 1788876785 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876774.891017:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532363776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.891022:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788876774.891058:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532363776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876774.891082:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532362240:0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.891090:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532363264:0@lo:400:kworker.0 00000100:00080000:1.0:1788876774.891214:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876774.891219:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876774.891858:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363648 00000100:00100000:3.0:1788876774.891864:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363648 00000100:00100000:3.0:1788876774.891886:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362752 00000100:00100000:3.0:1788876774.891889:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362752 00000100:00100000:3.0:1788876774.891909:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362368 00000100:00100000:3.0:1788876774.891912:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362368 00000100:00100000:3.0:1788876774.891920:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363008 00000100:00100000:3.0:1788876774.891922:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363008 00000100:00100000:3.0:1788876774.891935:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1788876774.891941:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532362624:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876774.891955:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac9b100 x1875771532362624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:170/0 lens 224/224 e 0 to 0 dl 1788876785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876774.891994:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532362624:12345-0@lo:400:kworker.0 Request processed in 53us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.892000:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1788876774.892012:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1788876774.892019:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532363648:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876774.892028:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb124000 x1875771532363648/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:170/0 lens 224/224 e 0 to 0 dl 1788876785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876774.892052:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532363648:12345-0@lo:400:kworker.0 Request processed in 35us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.892058:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:3.0:1788876774.892069:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:3.0:1788876774.892074:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.892099:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532362752:12345-0@lo:400:kworker.0 Request processed in 25us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.892104:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:3.0:1788876774.892116:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:3.0:1788876774.892122:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532362368:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876774.892131:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb124e00 x1875771532362368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:170/0 lens 224/224 e 0 to 0 dl 1788876785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876774.892172:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532362368:12345-0@lo:400:kworker.0 Request processed in 49us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.892181:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:3.0:1788876774.892194:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:3.0:1788876774.892201:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532363008:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876774.892211:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad75180 x1875771532363008/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:170/0 lens 224/224 e 0 to 0 dl 1788876785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876774.892222:0:47221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362112 00000100:00100000:0.0:1788876774.892229:0:47221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362112 00000100:00100000:3.0:1788876774.892240:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532363008:12345-0@lo:400:kworker.0 Request processed in 38us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876774.892247:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:0.0:1788876774.892265:0:47221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788876774.892274:0:47221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532362112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876774.892315:0:47221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532362112:12345-0@lo:400:kworker.0 Request processed in 41us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876774.892323:0:47221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788876774.892415:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876774.892426:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532363904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876774.892456:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876774.892486:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363904 00000100:00100000:0.0:1788876774.892490:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363904 00000100:00100000:0.0:1788876774.892548:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1788876774.892556:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532363904:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876774.893794:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876774.893800:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876774.893803:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:0.0:1788876774.893904:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876774.893965:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532363904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1408us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876774.893974:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1788876774.894028:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532363904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876774.894522:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532362752:0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.894533:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.894544:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532362624:0@lo:400:kworker.0 00000100:00100000:3.0:1788876774.894555:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532363648:0@lo:400:kworker.0 00000100:00100000:0.0:1788876774.894918:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876774.894945:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264512 00000100:00100000:0.0:1788876774.894951:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264512 00000100:00100000:0.0:1788876774.894989:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2524 00000100:00100000:0.0:1788876774.894998:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37005:x1875771511264512:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:0.0:1788876774.895100:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895128:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895141:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895166:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895174:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895180:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876774.895486:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:2.0:1788876774.895496:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532363136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.895551:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532363136:12345-0@lo:400:kworker.0 Request processed in 56us (5914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.895558:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:2.0:1788876774.895580:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362880 00000100:00100000:2.0:1788876774.895584:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362880 00000100:00100000:2.0:1788876774.895623:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363392 00000100:00100000:2.0:1788876774.895627:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363392 00010000:00010000:0.0:1788876774.895942:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895951:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895958:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895964:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876774.895968:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895976:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.895988:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:0.0:1788876774.895991:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876774.895997:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.896004:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af491 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876774.896014:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f47579ca reply state 0000000075669972 transno 77309411332 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.896025:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876774.896032:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13f35d9800) 00010000:00010000:0.0:1788876774.896035:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876774.896037:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1788876774.896062:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb258000 x1875771511264512/t77309411332(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:170/0 lens 520/448 e 0 to 0 dl 1788876785 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876774.898207:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:37005:x1875771511264512:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1115us (1197us total) trans 77309411332 rc 0/0 00000100:00100000:0.0:1788876774.898229:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2524 00000100:00080000:1.0:1788876774.900478:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876774.900767:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532362496 00000100:00100000:2.0:1788876774.900776:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532362496 00000100:00100000:2.0:1788876774.900805:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532363520 00000100:00100000:2.0:1788876774.900808:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532363520 00000100:00080000:1.0:1788876774.900855:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876774.901226:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1788876774.901239:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532362880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.901333:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532362880:12345-0@lo:400:kworker.0 Request processed in 98us (11351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.901340:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1788876774.901355:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788876774.901362:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532363392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.901390:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532363392:12345-0@lo:400:kworker.0 Request processed in 29us (11376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.901397:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1788876774.901407:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1788876774.901412:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532362496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.901435:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532362496:12345-0@lo:400:kworker.0 Request processed in 23us (11378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.901440:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1788876774.901449:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1788876774.901455:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532363520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.901481:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532363520:12345-0@lo:400:kworker.0 Request processed in 26us (11346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.901487:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1788876774.909907:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532363136:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.909958:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532362496:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.909969:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532363008:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.909980:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532363520:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.909991:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532362368:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.910002:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532362880:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.910011:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532363392:0@lo:400:kworker.0 00000100:00100000:2.0:1788876774.910031:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876774.910040:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532364032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876774.910096:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876774.910140:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364032 00000100:00100000:2.0:1788876774.910163:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364032 00000100:00100000:2.0:1788876774.910206:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1788876774.910215:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532364032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876774.910246:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876774.910665:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532364032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 450us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876774.910674:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1788876774.913402:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532364032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788876775.272822:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876775.404992:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876775.405012:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876775.405079:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876775.405124:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364160 00000100:00100000:3.0:1788876775.405131:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364160 00000100:00100000:3.0:1788876775.405197:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1788876775.405207:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532364160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876775.405234:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876775.405291:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532364160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876775.405299:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1788876775.405345:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876775.405857:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876775.405886:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876775.405951:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364288 00000100:00100000:0.0:1788876775.405956:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364288 00000100:00100000:0.0:1788876775.405990:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1788876775.405997:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532364288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876775.406010:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876775.406047:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532364288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876775.406053:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1788876775.406081:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876776.110846:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876776.110888:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876776.110916:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876776.110936:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876776.110971:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876776.111002:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265024 00000100:00100000:3.0:1788876776.111012:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265024 00000100:00100000:3.0:1788876776.111072:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265152 00000100:00100000:3.0:1788876776.111076:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265152 00000100:00100000:3.0:1788876776.111103:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1273 00000100:00100000:3.0:1788876776.111113:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511265024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876776.111192:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511265024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876776.111200:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1273 00000100:00100000:3.0:1788876776.111217:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1274 00000100:00100000:3.0:1788876776.111224:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511265152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876776.111246:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511265152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876776.111253:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1274 00000100:00100000:3.0:1788876776.111269:0:47226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264640 00000100:00100000:3.0:1788876776.111272:0:47226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264640 00000100:00100000:3.0:1788876776.111296:0:47226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1788876776.111302:0:47226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511264640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876776.111325:0:47226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511264640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876776.111336:0:47226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1788876776.111447:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264768 00000100:00100000:0.0:1788876776.111452:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264768 00000100:00100000:0.0:1788876776.111480:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264896 00000100:00100000:0.0:1788876776.111483:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264896 00000100:00100000:0.0:1788876776.111503:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1713 00000100:00100000:0.0:1788876776.111511:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2398:x1875771511264768:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:0.0:1788876776.111529:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad1ce00 x1875771511264768/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:172/0 lens 224/224 e 0 to 0 dl 1788876787 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876776.111576:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1714 00000100:00100000:3.0:1788876776.111585:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511264896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1788876776.112467:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876776.112472:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876776.112475:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876776.112478:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876776.114518:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2398:x1875771511264768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2999us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876776.114838:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1713 00000100:00100000:3.0:1788876776.114987:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511264896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3402us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876776.114996:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1714 00010000:00010000:0.0:1788876776.298918:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788876776.845784:0:48534:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788876776.845945:0:48534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.845960:0:48534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.845968:0:48534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.845975:0:48534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.845998:0:48534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788876776.846004:0:48534:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788876776.846032:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876776.846036:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788876776.846042:0:48534:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788876776.846065:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788876776.846150:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532364416:0@lo:39:umount.0 00000100:00100000:2.0:1788876776.846214:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876776.847111:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876776.847123:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876776.847155:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876776.847162:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876776.847177:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876776.847187:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876776.847194:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788876776.847198:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788876776.847201:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788876776.847243:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876776.847253:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788876776.847289:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876776.847298:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220c00/0xf5bf0f7e313af09a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0a1 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876776.847316:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876776.847318:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876776.847320:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876776.848078:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532364544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876776.849096:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876776.849399:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364544 00000100:00100000:1.0:1788876776.849409:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364544 00000100:00100000:1.0:1788876776.850183:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788876776.850195:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532364544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876776.850212:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876776.850232:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313af0a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af09a expref: 24 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.850246:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876776.850310:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532364544:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876776.850321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788876776.850388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532364544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876776.850544:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364416 00000100:00100000:2.0:1788876776.850550:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364416 00000100:00100000:2.0:1788876776.850596:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1788876776.850631:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532364416:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788876776.850654:0:6541:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af1b9 00000100:00080000:2.0:1788876776.850670:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fd000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788876776.850699:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa644a80 x1875771532364416/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:172/0 lens 224/224 e 0 to 0 dl 1788876787 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876776.850740:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532364416:12345-0@lo:39:umount.0 Request processed in 111us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876776.850746:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000020:00000080:2.0:1788876776.850754:0:6541:0:(genops.c:885:class_export_put()) final put ffff8a12c49fb800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788876776.850788:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876776.850798:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876776.850888:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c49fd000 for lustre-MDT0000 00000100:00080000:2.0:1788876776.850939:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876776.850949:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532364416:0@lo:39:umount.0 00000100:00080000:3.0:1788876776.851323:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876776.851329:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788876776.851336:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788876776.853111:0:48534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853131:0:48534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853152:0:48534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853161:0:48534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853251:0:48534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876776.853262:0:48534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853271:0:48534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853278:0:48534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876776.853285:0:48534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.856889:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876776.856906:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.856921:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220400 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876776.856927:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.856939:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876776.856948:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876776.856955:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876776.856958:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788876776.857010:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857020:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876776.857080:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857090:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220400/0xf5bf0f7e313aefb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefba expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857108:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876776.857116:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857124:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876776.857127:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857149:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876776.857158:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876776.857164:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876776.857167:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788876776.857183:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857189:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876776.857214:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.857224:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876776.857227:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876776.857229:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876776.857252:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532364800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876776.857487:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532364672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876776.858387:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876776.858471:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364672 00000100:00100000:1.0:1788876776.858481:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364672 00000100:00100000:1.0:1788876776.858548:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788876776.858559:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3663:x1875771532364672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876776.858572:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876776.858589:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313aefba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aefb3 expref: 23 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.858617:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876776.858651:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3663:x1875771532364672:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876776.858658:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788876776.858694:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532364672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876776.858811:0:48534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788876776.858819:0:48534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313af0bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af0c4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876776.858832:0:48534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788876776.860092:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876776.860194:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364800 00000100:00100000:2.0:1788876776.860203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364800 00000100:00100000:2.0:1788876776.860258:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788876776.860270:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3664:x1875771532364800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876776.860411:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876776.860433:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486000/0xf5bf0f7e313af0c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af0bd expref: 22 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.860451:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876776.860501:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3664:x1875771532364800:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876776.860511:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788876776.860587:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532364800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876776.862038:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876776.862156:0:48534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862173:0:48534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862181:0:48534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862190:0:48534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862274:0:48534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876776.862300:0:48534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862310:0:48534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862318:0:48534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876776.862327:0:48534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865123:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876776.865145:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865156:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876776.865160:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865170:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876776.865177:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876776.865183:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788876776.865186:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788876776.865189:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788876776.865228:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865235:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876776.865272:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865288:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72600/0xf5bf0f7e313af08c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af093 expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865301:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876776.865305:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865311:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876776.865313:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865319:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876776.865325:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876776.865330:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788876776.865332:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788876776.865347:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865355:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876776.865380:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865391:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876776.865393:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876776.865396:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876776.865408:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876776.865432:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532365056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876776.865514:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876776.865580:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365056 00000100:00100000:1.0:1788876776.865587:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365056 00000100:00100000:1.0:1788876776.865659:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788876776.865668:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3663:x1875771532365056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876776.865680:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876776.865699:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fad52200/0xf5bf0f7e313aefac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aefa5 expref: 21 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.865715:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876776.865757:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3663:x1875771532365056:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876776.865764:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788876776.865798:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532365056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876776.865921:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532364928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876776.865952:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876776.866014:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532364928 00000100:00100000:1.0:1788876776.866018:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532364928 00000100:00100000:1.0:1788876776.866197:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788876776.866210:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3665:x1875771532364928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876776.866222:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876776.866238:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313af093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af08c expref: 20 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.866251:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876776.866316:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3665:x1875771532364928:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876776.866327:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788876776.866403:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532364928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876776.866573:0:48534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788876776.866581:0:48534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313aefa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aefac expref: -99 pid: 47214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876776.866594:0:48534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788876776.866617:0:48534:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788876776.866620:0:48534:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788876776.866659:0:48534:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788876776.866664:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788876776.866668:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788876776.866673:0:48534:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:2.0:1788876776.868282:0:48534:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00010000:00010000:0.0:1788876776.868548:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788876776.868916:0:47215:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 77309411332 is committed 00000020:00000080:2.0:1788876776.869076:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1788876776.869088:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d060f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876776.869096:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a12c49fc000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876776.869102:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0608000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876776.869112:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13fd3b1000 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 8 (0 0 2) 0 0 0 1: ffff8a12c55fb000 77309411332 stale:0 00000020:00080000:2.0:1788876776.869118:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13fd3b4000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788876776.869124:0:48534:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has exports, disconnecting them 00000020:00080000:2.0:1788876776.869130:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d060f800), last request at 1788876774 00000020:00000080:2.0:1788876776.869151:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af1ab 00000100:00080000:2.0:1788876776.869164:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13c72a2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876776.869193:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d060f800): rc 0 00000020:00000080:2.0:1788876776.869198:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13d060f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788876776.869212:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a12c49fc000), last request at 1788876774 00000020:00000080:2.0:1788876776.869217:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af1b2 00000100:00080000:2.0:1788876776.869226:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a12c49f9800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788876776.869250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d060f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876776.869308:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c72a2000 for lustre-MDT0000 00000020:00080000:2.0:1788876776.869333:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c49fc000): rc 0 00000020:00000080:2.0:1788876776.869337:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a12c49fc000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788876776.869348:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d0608000), last request at 1788876744 00000020:00000080:2.0:1788876776.869352:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af1a4 00000100:00080000:2.0:1788876776.869358:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13d060c000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788876776.869376:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876776.869418:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c49f9800 for lustre-MDT0000 00000020:00080000:2.0:1788876776.869441:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d0608000): rc 0 00000020:00000080:2.0:1788876776.869444:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13d0608000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788876776.869456:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13fd3b1000), last request at 1788876776 00000020:00000080:2.0:1788876776.869468:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af00e 00000020:00010000:2.0:1788876776.869484:0:48534:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13fd3b1000: total 1 00000100:00080000:2.0:1788876776.869490:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13d15bb000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788876776.869505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0608000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876776.869543:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d060c000 for lustre-MDT0000 00000020:00080000:2.0:1788876776.869590:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13fd3b1000): rc 0 00000020:00080000:2.0:1788876776.869594:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13fd3b4000), last request at 1788876738 00000020:00000080:2.0:1788876776.869597:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af007 00000100:00080000:2.0:1788876776.869623:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13f4441000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876776.869629:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13fd3b4000): rc 0 00000020:00000080:2.0:1788876776.869631:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13fd3b4000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1788876776.869641:0:48534:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa62081f43ae0 00000020:00000080:2.0:1788876776.869653:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fd3b4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876776.869686:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f4441000 for lustre-MDT0000 00000100:00080000:2.0:1788876776.869706:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876776.869710:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788876776.870487:0:48534:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788876776.870527:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a12c5f36000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788876776.870575:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365184:0@lo:39:umount.0 00000100:00100000:2.0:1788876776.870661:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876776.870813:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876776.870817:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934858 gen 3 00000004:00080000:2.0:1788876776.870830:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788876776.870896:0:48534:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788876776.870907:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788876776.870917:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876776.870919:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967566 gen 3 00000004:00080000:2.0:1788876776.870925:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876776.870991:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365312:0@lo:9:umount.0 00000100:00100000:2.0:1788876776.871019:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876776.871067:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365312 00000100:00100000:2.0:1788876776.871077:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365312 00000100:00100000:2.0:1788876776.871160:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1788876776.871169:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532365312:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876776.871191:0:8456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af069 00000100:00080000:2.0:1788876776.871197:0:8456:0:(import.c:65:import_set_state_nolock()) ffff8a13f53b7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876776.871227:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934858 00000100:00100000:2.0:1788876776.871393:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532365312:12345-0@lo:9:umount.0 Request processed in 222us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876776.871403:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00080000:2.0:1788876776.871461:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876776.871474:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876776.871477:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876776.871481:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365312:0@lo:9:umount.0 00000100:00080000:2.0:1788876776.871514:0:48534:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788876776.871531:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13d212a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788876776.871558:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365440:0@lo:9:umount.0 00000100:00100000:2.0:1788876776.871585:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876776.871656:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365440 00000100:00100000:2.0:1788876776.871662:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365440 00000100:00100000:2.0:1788876776.871703:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1788876776.871713:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532365440:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876776.871731:0:17045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af077 00000100:00080000:2.0:1788876776.871738:0:17045:0:(import.c:65:import_set_state_nolock()) ffff8a13ff3da800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876776.871756:0:17045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967566 00000100:00100000:2.0:1788876776.871878:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532365440:12345-0@lo:9:umount.0 Request processed in 165us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876776.871888:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00080000:2.0:1788876776.871915:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d212a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876776.871919:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876776.871921:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876776.871923:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365440:0@lo:9:umount.0 00000020:00080000:2.0:1788876776.871977:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has no exports 00000100:00100000:3.0:1788876776.872372:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365184 00000100:00100000:3.0:1788876776.872382:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365184 00000100:00100000:3.0:1788876776.872441:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:3.0:1788876776.872452:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532365184:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788876776.872476:0:6544:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af04d 00000100:00080000:3.0:1788876776.872484:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788876776.872498:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788876776.872651:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532365184:12345-0@lo:39:umount.0 Request processed in 202us (1990us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788876776.872657:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00010000:00010000:1.0:1788876776.872739:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872751:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872759:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872766:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876776.872770:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872777:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872793:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13f35d9800) 00010000:00010000:1.0:1788876776.872796:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876776.872801:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872807:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587e00/0xf5bf0f7e313af498 lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788876776.872836:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13fd3b1000: total 0 00010000:00010000:1.0:1788876776.872873:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13fd3b1000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788876776.872901:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eb1ca400/0xf5bf0f7e313af46e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704890b expref: 3 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872922:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff400/0xf5bf0f7e313af48a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048912 expref: 2 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876776.872934:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13fd3b1000, canceled 2 locks, left on hash table 0. 00000100:00080000:3.0:1788876776.873774:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876776.873780:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788876776.873788:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876776.876765:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876776.878364:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c5f36000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876776.878384:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532365184:0@lo:39:umount.0 00000020:00080000:2.0:1788876776.878925:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has no exports 00000020:00000080:1.0:1788876776.933446:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13fd3b1000/f0204769-56bd-4f5c-ab97-74c450c9e072 00000020:00000080:3.0:1788876776.935474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fd3b1000/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:3.0:1788876776.939755:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d15bb000 for lustre-MDT0000 00010000:00010000:0.0:1788876776.939857:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876776.939861:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876776.939863:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876776.981429:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af023 00000020:00000080:2.0:1788876776.981448:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a12c22f3000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788876776.981534:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788876776.981860:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876776.981873:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876776.981879:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a13f5270000) has no exports 00000020:00000080:3.0:1788876776.982029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c22f3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788876776.982525:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af01c 00000020:00000080:2.0:1788876776.982535:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13ff3df000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876776.982630:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876776.982639:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788876776.982642:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13ff3de800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788876776.982644:0:48534:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3de800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788876776.982654:0:48534:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876776.982816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788876776.983009:0:48534:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efe3e060 - data ffff8a13ee841af8/ffff8a13c79a5800 00000020:01000000:2.0:1788876776.983303:0:48534:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cff91780 - data ffff8a13f03d95e8/ffff8a12c26a9400 00000100:00080000:2.0:1788876777.055202:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876777.055213:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788876777.055229:0:48534:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13fa646a00 x1875771532365184/t4294967325(4294967325) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876786 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876777.055268:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788876777.059395:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876777.059404:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934858 gen 4 00000004:00080000:2.0:1788876777.059436:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876777.059439:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788876777.059911:0:47233:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788876777.059916:0:47233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x48:0x0] index 1 count 1 00000040:00080000:0.0:1788876777.059925:0:47233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 18 count 2 00000100:00080000:2.0:1788876777.067951:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876777.067960:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967566 gen 4 00000004:00080000:2.0:1788876777.067977:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876777.067980:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788876777.068438:0:47235:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788876777.068444:0:47235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4a:0x0] index 1 count 1 00000040:00080000:0.0:1788876777.068456:0:47235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 18 count 2 00000020:00000080:2.0:1788876777.069833:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aefdd 00000020:00000080:2.0:1788876777.069843:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13fa7af000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876777.070708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7af000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876777.070964:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeff2 00000020:00000080:2.0:1788876777.070971:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13c511f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788876777.070988:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788876777.070994:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876777.071003:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876777.071008:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c25ecd40) has no exports 00000020:00000080:0.0:1788876777.071954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788876777.072084:0:48534:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788876777.072096:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af070 00000020:00000080:2.0:1788876777.072105:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f4447000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788876777.072238:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788876777.072249:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876777.072265:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788876777.072270:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c5e399c0) has no exports 00000020:00000080:2.0:1788876777.072282:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af062 00000020:00000080:2.0:1788876777.072288:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13d212a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876777.072765:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4447000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788876777.072772:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d212a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788876777.073067:0:48534:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788876777.073071:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876777.073076:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967566 gen 5 00000004:00080000:2.0:1788876777.073081:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876777.073084:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876777.073162:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876777.073171:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876777.073178:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af054 00000020:00000080:2.0:1788876777.073183:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a12c5f35000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876777.076879:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d212a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788876777.076898:0:36:0:(genops.c:885:class_export_put()) final put ffff8a12c5f30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876777.076902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f30800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788876777.076911:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788876777.080318:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788876777.080353:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876777.080366:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788876777.080371:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c5e3b380) has no exports 00000020:00000080:2.0:1788876777.080381:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af046 00000020:00000080:2.0:1788876777.080388:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f4439000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876777.080416:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f35000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788876777.085071:0:48534:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788876777.085079:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876777.085084:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934858 gen 5 00000004:00080000:2.0:1788876777.085090:0:48534:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876777.085094:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876777.086292:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4439000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876777.089883:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876777.089901:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788876777.089917:0:48534:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788876777.089925:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af038 00000020:00000080:2.0:1788876777.089934:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a12c5f33800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876777.091741:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c36e6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788876777.091758:0:36:0:(genops.c:885:class_export_put()) final put ffff8a12c5f31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876777.091761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788876777.091771:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788876777.094808:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788876777.094823:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876777.094835:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788876777.094840:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a12c201cd40) has no exports 00000020:00000080:2.0:1788876777.094850:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af031 00000020:00000080:2.0:1788876777.094860:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a12c5f34000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876777.094886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f33800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788876777.102823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f34000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788876777.103734:0:48534:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788876777.103740:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788876777.103744:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788876777.103752:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876777.103813:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876777.103824:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876777.103852:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876777.103856:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876777.103860:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f07ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876777.103864:0:48534:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788876777.103870:0:48534:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876777.103983:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aeff9 00000020:00000080:0.0:1788876777.103991:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13c511b000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788876777.103995:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788876777.104000:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876777.104006:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788876777.104010:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c25e8000) has no exports 00000020:00000080:0.0:1788876777.104030:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876777.104033:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788876777.104038:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af000 00000020:00000080:0.0:1788876777.104041:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13c511c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788876777.104048:0:48534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13ff33b000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788876777.104051:0:48534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13ff33b000 3 00000020:01000004:0.0:1788876777.104056:0:48534:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13ff33b000 from lustre-MDT0000 00000020:00000080:0.0:1788876777.104071:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876777.104074:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788876777.104077:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13fa7a8000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788876777.104079:0:48534:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7a8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788876777.104086:0:48534:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1788876777.104259:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c5f36000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788876777.104272:0:36:0:(genops.c:885:class_export_put()) final put ffff8a12c5f37800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876777.104276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f37800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788876777.104292:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876777.104367:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788876777.104373:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13f5236000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788876777.104376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f5236000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788876777.104380:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788876777.104422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788876777.104746:0:48534:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788876777.104751:0:48534:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788876777.104755:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788876777.104760:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876777.104765:0:48534:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788876777.104776:0:48534:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f07ae800 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876777.104785:0:48534:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f07a9800 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876777.104791:0:48534:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c25e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788876777.104799:0:48534:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13f07ae800), last request at 1788876740 00000020:00000080:0.0:1788876777.104831:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af181 00000020:00010000:0.0:1788876777.104839:0:48534:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f07ae800: total 0 00000100:00080000:0.0:1788876777.104844:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13c8696800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876777.104866:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13f07ae800): rc 0 00000020:00080000:0.0:1788876777.104870:0:48534:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13f07a9800), last request at 1788876738 00000020:00000080:0.0:1788876777.104915:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aef9e 00000020:00010000:0.0:1788876777.104919:0:48534:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f07a9800: total 0 00000100:00080000:0.0:1788876777.104922:0:48534:0:(import.c:65:import_set_state_nolock()) ffff8a13f07a8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876777.104931:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f07a9800): rc 0 00000020:00080000:0.0:1788876777.104936:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c25e99c0) has no exports 00000020:00010000:0.0:1788876777.104944:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f07ae800: total 0 00010000:00010000:0.0:1788876777.104948:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876777.104978:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f07ae800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788876777.105009:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313af18f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488cc expref: 5 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105024:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fad52c00/0xf5bf0f7e313af19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488da expref: 4 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105038:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313af196 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488d3 expref: 3 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105055:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220600/0xf5bf0f7e313af188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370488c5 expref: 2 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105068:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f07ae800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788876777.105104:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13f07ae800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:0.0:1788876777.105120:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f07a9800: total 1 00010000:00010000:2.0:1788876777.105286:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876777.105300:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ae800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:2.0:1788876777.105341:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c8696800 for MGS 00010000:00010000:0.0:1788876777.105563:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f07a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788876777.105593:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221400/0xf5bf0f7e313af134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af12d expref: 14 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105776:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73400/0xf5bf0f7e313af142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af13b expref: 13 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105786:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313af0d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af0cb expref: 12 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105795:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313af0e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af0d9 expref: 11 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105808:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313af15e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af157 expref: 10 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105819:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fad52400/0xf5bf0f7e313af0ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af0e7 expref: 9 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105829:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313af150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af149 expref: 8 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105841:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313af10a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af103 expref: 7 pid: 47226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105850:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73c00/0xf5bf0f7e313af16c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af165 expref: 6 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105860:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220000/0xf5bf0f7e313af0fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af0f5 expref: 5 pid: 47219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105869:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487400/0xf5bf0f7e313af17a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af173 expref: 4 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105879:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313af118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af111 expref: 3 pid: 47221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105889:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72800/0xf5bf0f7e313af126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af11f expref: 2 pid: 47222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876777.105899:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f07a9800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788876777.105914:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13f07a9800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00010000:00010000:0.0:1788876777.105920:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876777.105922:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876777.105925:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876777.106015:0:47221:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13ff528400:47221] 1 exiting: rc = 0 00000100:00100000:0.0:1788876777.106181:0:47219:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13ff528e00:47219] 0 exiting: rc = 1 00000020:00000080:2.0:1788876777.106324:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07a9800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:2.0:1788876777.106374:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07a8800 for MGS 00000100:00100000:3.0:1788876777.108819:0:47226:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8a13ef16e600:47226] 3 exiting: rc = 0 00000100:00100000:2.0:1788876777.109698:0:47222:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13ff528c00:47222] 2 exiting: rc = 0 00000100:00100000:0.0:1788876777.112909:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112920:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112926:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112932:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112937:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112942:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112947:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112953:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112959:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112965:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112970:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112976:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112982:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112987:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.112993:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113004:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113010:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113016:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113021:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113027:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113036:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113046:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113054:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113063:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113073:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113083:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113092:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113102:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113111:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113122:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113149:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113158:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113164:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113170:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113175:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113181:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113187:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113192:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113198:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113204:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113209:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113215:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113224:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113230:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113235:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113240:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113245:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113251:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113256:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113262:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113268:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113273:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113278:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113284:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113289:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113294:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113299:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113304:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113310:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113315:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113319:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113325:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113330:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876777.113336:0:48534:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788876777.118151:0:48534:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cff91180 - data ffff8a13ee81fca8/ffff8a13efe26000 00000020:01000000:0.0:1788876777.118313:0:48534:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cff919c0 - data ffff8a13f000c0d8/ffff8a13efde0000 00000020:00000080:0.0:1788876777.118767:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aef97 00000020:00000080:0.0:1788876777.118776:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f07ae000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876777.118795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788876777.118808:0:48534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13ff33b000 from MGS, refs=2 00000020:01000004:0.0:1788876777.118812:0:48534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13ff33b000 2 00000020:01000004:0.0:1788876777.118815:0:48534:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13ff33b000 from MGS 00000020:00000080:0.0:1788876777.118834:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876777.118840:0:48534:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788876777.118843:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f07a8000/MGS 00000020:00000080:0.0:1788876777.118845:0:48534:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07a8000/MGS for MGS 00000020:01000000:0.0:1788876777.118851:0:48534:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788876777.118918:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788876777.118922:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876777.118931:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788876777.118938:0:48534:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a13f07a9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876777.118944:0:48534:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a13f5274d40) has exports, disconnecting them 00000020:00080000:0.0:1788876777.118949:0:48534:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a13f07a9000), last request at 1788876738 00000020:00000080:0.0:1788876777.118953:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af0af 00000020:00080000:0.0:1788876777.118963:0:48534:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f07a9000): rc 0 00000020:00000080:0.0:1788876777.118967:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f07a9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788876777.118991:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07a9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788876777.132676:0:48534:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788876777.132685:0:48534:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876777.132689:0:48534:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876777.132696:0:48534:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876777.132855:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876777.132867:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788876777.132874:0:48534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13ff33b000 1 00000020:00000080:2.0:1788876777.132881:0:48534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aef89 00000020:00000080:2.0:1788876777.132889:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13f07ad000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788876777.132893:0:48534:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788876777.132901:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876777.132905:0:48534:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876777.132908:0:48534:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c5e38000) has no exports 00000020:00000080:0.0:1788876777.141157:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff363000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788876777.141172:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13ff361000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788876777.141175:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff361000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788876777.141181:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788876777.141281:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788876777.473484:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876777.508549:0:48534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876777.508563:0:48534:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788876777.508568:0:48534:0:(genops.c:885:class_export_put()) final put ffff8a13c3007800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876777.508572:0:48534:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3007800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788876777.508585:0:48534:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788876777.510411:0:48534:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13ff33d800 00000020:02000400:2.0:1788876777.510513:0:48534:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788876778.538737:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876778.986431:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532365568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876778.986598:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876778.986649:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365568 00000100:00100000:0.0:1788876778.986659:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365568 00000100:00100000:0.0:1788876778.986739:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1788876778.986750:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532365568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876778.986790:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876778.986849:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532365568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876778.986858:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:0.0:1788876778.986882:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876778.986906:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532365568:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876779.563184:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876780.010323:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532365696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876780.010420:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876780.010634:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365696 00000100:00100000:0.0:1788876780.010646:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365696 00000100:00100000:0.0:1788876780.010704:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1788876780.010714:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3664:x1875771532365696:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788876780.010723:0:13623:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876780.010777:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3664:x1875771532365696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (356us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876780.010791:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:02020000:0.0:1788876780.010844:0:3664:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788876780.013093:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532365824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876780.013200:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.020707:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365824 00000100:00100000:1.0:1788876780.020728:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365824 00000100:00100000:1.0:1788876780.020845:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1788876780.020858:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532365824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876780.020902:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876780.021016:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532365824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876780.021024:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1788876780.021098:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532365824:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788876780.021443:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876780.025003:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532365952:0@lo:400:kworker.0 00000400:00000100:2.0:1788876780.025080:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532365952 offset 0 length 224: 4 00000100:00100000:2.0:1788876780.025136:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532366464:0@lo:400:kworker.0 00000100:00100000:2.0:1788876780.025176:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876780.025228:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788876780.025236:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532366080:0@lo:400:kworker.0 00000100:00100000:2.0:1788876780.025269:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876780.025294:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532366592:0@lo:400:kworker.0 00000100:00100000:2.0:1788876780.025319:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876780.025362:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366464 00000100:00100000:2.0:1788876780.025373:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366464 00000100:00100000:2.0:1788876780.025451:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1788876780.025463:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532366464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876780.025525:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532366464:12345-0@lo:400:kworker.0 Request processed in 65us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876780.025533:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00080000:2.0:1788876780.025558:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876780.025598:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532366464:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.025907:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532366336:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.025945:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.025973:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788876780.025980:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.026003:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.026022:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532366720:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.026043:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.026070:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366080 00000100:00100000:1.0:1788876780.026075:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366080 00000100:00100000:1.0:1788876780.026097:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366592 00000100:00100000:1.0:1788876780.026101:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366592 00000100:00100000:1.0:1788876780.026126:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366336 00000100:00100000:1.0:1788876780.026129:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366336 00000100:00100000:1.0:1788876780.026153:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366208 00000100:00100000:1.0:1788876780.026156:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366208 00000100:00100000:1.0:1788876780.026162:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366720 00000100:00100000:1.0:1788876780.026164:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366720 00000100:00100000:1.0:1788876780.026180:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:1.0:1788876780.026187:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532366336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.026242:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532366336:12345-0@lo:400:kworker.0 Request processed in 56us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876780.026249:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:1.0:1788876780.026263:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:1.0:1788876780.026270:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532366720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.026298:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532366720:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876780.026303:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:1.0:1788876780.026314:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1788876780.026318:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532366080:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876780.026323:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876780.026355:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532366080:12345-0@lo:400:kworker.0 Request processed in 36us (1087us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876780.026362:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1788876780.026373:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1788876780.026377:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532366592:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876780.026382:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876780.026406:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532366592:12345-0@lo:400:kworker.0 Request processed in 27us (1087us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876780.026411:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1788876780.026422:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:1.0:1788876780.026426:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3665:x1875771532366208:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876780.026430:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876780.026449:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3665:x1875771532366208:12345-0@lo:400:kworker.0 Request processed in 21us (446us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876780.026454:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00080000:1.0:1788876780.026477:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876780.026502:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788876780.026507:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788876780.026511:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788876780.026517:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876780.026521:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1732 00000100:00080000:1.0:1788876780.026529:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876780.026561:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcda680 x1875771532366848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876780.026585:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532366080:0@lo:400:kworker.0 00000100:00080000:1.0:1788876780.026597:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788876780.026626:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788876780.026630:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788876780.026633:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876780.026646:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1732 00000100:00080000:1.0:1788876780.026650:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876780.026663:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcd8a80 x1875771532366976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876780.026674:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532366592:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.026699:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532366848:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788876780.026727:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.026747:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532366976:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788876780.026767:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.027353:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366848 00000100:00100000:1.0:1788876780.027361:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366848 00000100:00100000:1.0:1788876780.027392:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532366976 00000100:00100000:1.0:1788876780.027395:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532366976 00000100:00100000:1.0:1788876780.027407:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1788876780.027414:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532366848:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788876780.027438:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876780.027487:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532366848:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 73us (758us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876780.027494:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1788876780.027509:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1788876780.027513:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532366976:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1788876780.027521:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876780.027546:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532366976:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (778us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876780.027551:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00080000:1.0:1788876780.027585:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876780.027591:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876780.027594:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532366848:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788876780.027635:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876780.027699:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876780.027703:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532366976:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788876780.027743:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788876780.027747:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788876780.027751:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788876780.027755:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876780.027760:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1732 00000100:00080000:1.0:1788876780.027765:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876780.027867:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfcd8a80 x1875771532367104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876780.027887:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.027910:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532366720:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.027924:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532366336:0@lo:400:kworker.0 00000100:00100000:1.0:1788876780.027951:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532367104:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788876780.027983:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876780.028012:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367104 00000100:00100000:1.0:1788876780.028016:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367104 00000100:00100000:1.0:1788876780.028036:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:1.0:1788876780.028041:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532367104:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788876780.028050:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876780.028087:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532367104:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 45us (103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876780.028093:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00080000:1.0:1788876780.028137:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876780.028142:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876780.028145:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532367104:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788876780.033322:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876780.033333:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876780.033338:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876780.033347:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876780.033352:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1732 00000100:00080000:0.0:1788876780.033364:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876780.033439:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb258e00 x1875771532367232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876780.033503:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532367232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788876780.033592:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876780.033694:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367232 00000100:00100000:0.0:1788876780.033703:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367232 00000100:00100000:0.0:1788876780.033746:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1788876780.033755:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532367232:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788876780.033783:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876780.033834:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532367232:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 78us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876780.033843:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00080000:0.0:1788876780.033902:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876780.033907:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876780.033911:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532367232:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788876780.584978:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876781.229720:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876781.229784:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788876781.229813:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511265280 offset 0 length 224: 4 00000100:00100000:0.0:1788876781.229832:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876781.229875:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876781.229917:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265664 00000100:00100000:0.0:1788876781.229929:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265664 00000100:00100000:0.0:1788876781.230001:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265792 00000100:00100000:0.0:1788876781.230136:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265792 00000100:00100000:3.0:1788876781.230179:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1276 00000100:00100000:3.0:1788876781.230206:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511265664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876781.230233:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265408 00000100:00100000:1.0:1788876781.230241:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265408 00000100:00100000:1.0:1788876781.230277:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265536 00000100:00100000:1.0:1788876781.230281:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265536 00000100:00100000:3.0:1788876781.230306:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511265664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876781.230377:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1717 00000100:00100000:2.0:1788876781.230392:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511265536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876781.230455:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511265536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876781.230462:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1717 00000100:00100000:2.0:1788876781.230484:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2532 00000100:00100000:2.0:1788876781.230489:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875771511265408:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:2.0:1788876781.230496:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:2.0:1788876781.230520:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875771511265408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (816us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788876781.230526:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2532 00000100:00080000:1.0:1788876781.233099:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876781.233121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876781.233125:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876781.238963:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1277 00000100:00100000:0.0:1788876781.239000:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511265792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876781.240256:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511265792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1272us (10375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876781.240268:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1277 00000100:00100000:3.0:1788876781.241901:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1276 00000100:00100000:0.0:1788876781.257884:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876781.258190:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511265920 00000100:00100000:2.0:1788876781.258201:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511265920 00000100:00100000:2.0:1788876781.258349:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2533 00000100:00100000:2.0:1788876781.258356:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511265920:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788876781.258378:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876781.258441:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511265920:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 Request processed in 83us (564us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876781.258449:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2533 00010000:00010000:0.0:1788876781.610086:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876782.635067:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788876783.083161:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876783.083171:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13ff3dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876783.085829:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788876783.085911:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff3da800 for lustre-OST0001 00000001:00100000:2.0:1788876783.086192:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788876783.086207:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967325 is committed 00000020:00000080:2.0:1788876783.086211:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a13ff37c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876783.086622:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788876783.086666:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff37b800 for lustre-MDT0001 00000001:00100000:0.0:1788876783.087998:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876783.088004:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13d2129800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876783.088084:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d2129800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788876783.088140:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f53b7000 for lustre-OST0000 00010000:00010000:0.0:1788876783.656850:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876784.104882:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876784.104898:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532367360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876784.104968:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876784.105027:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367360 00000100:00100000:1.0:1788876784.105036:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367360 00000100:00080000:2.0:1788876784.105074:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876784.105110:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1788876784.105120:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532367360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876784.105147:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876784.105201:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532367360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876784.105209:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1788876784.105932:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532367360:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876784.682255:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876785.128914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876785.128921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876785.128924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876785.128933:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1767 00000100:00080000:2.0:1788876785.128940:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876785.128947:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876785.128969:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb149500 x1875771532367616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876785.128984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876785.128988:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876785.128989:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876785.128992:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1767 00000100:00080000:2.0:1788876785.128995:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876785.128998:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876785.129008:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb148700 x1875771532367744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876785.129022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876785.129025:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876785.129027:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876785.129030:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1767 00000100:00080000:2.0:1788876785.129033:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876785.129036:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876785.129045:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb148e00 x1875771532368000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876785.129071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876785.129074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876785.129075:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876785.129089:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1767 00000100:00080000:2.0:1788876785.129092:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876785.129095:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876785.129104:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb14bb80 x1875771532368384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876785.129203:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532367872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876785.129244:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532368128:0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.129303:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532368256:0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.130417:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.130502:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532367488:0@lo:400:kworker.0 00000400:00000100:1.0:1788876785.130526:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532367488 offset 0 length 224: 4 00000100:00100000:1.0:1788876785.130545:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532368512:0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.130567:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.130589:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876785.130595:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532368640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876785.130643:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.130672:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368640 00000100:00100000:1.0:1788876785.130679:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368640 00000100:00100000:1.0:1788876785.130728:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1788876785.130736:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532368640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876785.130765:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876785.130937:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532368640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876785.130945:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1788876785.130972:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368512 00000100:00100000:1.0:1788876785.130976:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368512 00000100:00100000:1.0:1788876785.131004:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1788876785.131010:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532368512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.131106:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532368512:12345-0@lo:400:kworker.0 Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876785.131113:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1788876785.131157:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532368640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876785.131285:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532368512:0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.131327:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532367616:0@lo:38:kworker.0 00000100:00100000:1.0:1788876785.131355:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.131374:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532367744:0@lo:38:kworker.0 00000100:00100000:1.0:1788876785.131394:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.131409:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532368000:0@lo:38:kworker.0 00000100:00100000:1.0:1788876785.131428:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.131442:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532368384:0@lo:38:kworker.0 00000100:00100000:1.0:1788876785.131461:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876785.131486:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367616 00000100:00100000:1.0:1788876785.131490:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367616 00000100:00100000:1.0:1788876785.131510:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1788876785.131515:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532367616:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876785.131531:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876785.131562:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532367616:12345-0@lo:38:kworker.0 Request processed in 46us (206us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876785.131569:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1788876785.131587:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367744 00000100:00100000:1.0:1788876785.131590:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367744 00000100:00100000:1.0:1788876785.135984:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368000 00000100:00100000:1.0:1788876785.136000:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368000 00000100:00100000:1.0:1788876785.136038:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368384 00000100:00100000:1.0:1788876785.136041:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368384 00000100:00100000:1.0:1788876785.136056:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:1.0:1788876785.136064:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532367744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876785.136309:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876785.136385:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532367744:12345-0@lo:38:kworker.0 Request processed in 320us (4988us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876785.136394:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:1.0:1788876785.136410:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1788876785.136415:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532368000:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876785.136424:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876785.136451:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532368000:12345-0@lo:38:kworker.0 Request processed in 35us (5021us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876785.136458:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1788876785.136468:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1788876785.136472:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532368384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876785.136482:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876785.136503:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532368384:12345-0@lo:38:kworker.0 Request processed in 30us (5041us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876785.136509:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00080000:1.0:1788876785.136561:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876785.136566:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876785.136570:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532367616:0@lo:38:kworker.0 00000100:00080000:1.0:1788876785.136580:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876785.136583:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876785.136585:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532367744:0@lo:38:kworker.0 00000100:00080000:1.0:1788876785.136594:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876785.136597:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876785.136628:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532368000:0@lo:38:kworker.0 00000100:00080000:1.0:1788876785.136640:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876785.136643:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876785.136646:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532368384:0@lo:38:kworker.0 00000100:00100000:2.0:1788876785.136811:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368256 00000100:00100000:2.0:1788876785.136816:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368256 00000100:00100000:2.0:1788876785.136851:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788876785.136859:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532368256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876785.136907:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532368256:12345-0@lo:400:kworker.0 Request processed in 49us (6492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876785.136913:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00080000:2.0:1788876785.136932:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876785.136938:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876785.136961:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532368256:0@lo:400:kworker.0 00000100:00100000:0.0:1788876785.139472:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876785.139513:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876785.139655:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532367872 00000100:00100000:2.0:1788876785.139666:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532367872 00000100:00100000:2.0:1788876785.139725:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1788876785.139736:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532367872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876785.139938:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532367872:12345-0@lo:400:kworker.0 Request processed in 203us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876785.139946:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1788876785.140287:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532367872:0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.140520:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368128 00000100:00100000:1.0:1788876785.140526:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368128 00000100:00100000:1.0:1788876785.140579:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:1.0:1788876785.140587:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532368128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876785.140673:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532368128:12345-0@lo:400:kworker.0 Request processed in 87us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876785.140679:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:0.0:1788876785.140829:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532368128:0@lo:400:kworker.0 00000100:00080000:2.0:1788876785.140982:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876785.709161:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876786.351049:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876786.351100:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788876786.351126:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511266048 offset 0 length 224: 4 00000100:00100000:0.0:1788876786.351147:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876786.351229:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266304 00000100:00100000:1.0:1788876786.351240:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266304 00000100:00100000:1.0:1788876786.351313:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1720 00000100:00100000:1.0:1788876786.351324:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511266304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876786.351392:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511266304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876786.351400:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1720 00000100:00080000:0.0:1788876786.351558:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876786.352501:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266560 00000100:00100000:2.0:1788876786.352509:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266560 00000100:00100000:2.0:1788876786.352575:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266432 00000100:00100000:2.0:1788876786.352579:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266432 00000100:00080000:0.0:1788876786.352649:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876786.352653:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876786.352682:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1280 00000100:00100000:0.0:1788876786.352692:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511266560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876786.352784:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1281 00000100:00100000:2.0:1788876786.352793:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511266432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876786.355355:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876786.355472:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266176 00000100:00100000:3.0:1788876786.355479:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266176 00000100:00100000:3.0:1788876786.355515:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2537 00000100:00100000:3.0:1788876786.355522:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511266176:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788876786.355547:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876786.355599:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511266176:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 75us (249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876786.355625:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2537 00000100:00100000:0.0:1788876786.356205:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511266560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3512us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876786.356216:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1280 00000100:00100000:2.0:1788876786.358823:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511266432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6020us (7663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876786.358838:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1281 00010000:00010000:0.0:1788876786.732726:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876787.757580:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876788.776913:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876789.225783:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876789.231953:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532368768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876789.232103:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876789.232363:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368768 00000100:00100000:3.0:1788876789.232374:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368768 00000100:00100000:3.0:1788876789.232469:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1788876789.232484:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532368768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876789.232527:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876789.232599:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532368768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876789.232632:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1788876789.233852:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532368768:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876789.233946:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876789.802441:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876790.249873:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876790.249897:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532368896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876790.250005:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.250203:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532368896 00000100:00100000:1.0:1788876790.250214:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532368896 00000100:00100000:1.0:1788876790.250287:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1788876790.250298:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532368896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876790.250332:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876790.250390:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532368896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876790.250398:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1788876790.250448:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532368896:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876790.250712:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876790.250717:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876790.250721:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876790.250728:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1773 00000100:00080000:1.0:1788876790.250734:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876790.250740:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876790.250767:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa647100 x1875771532369152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876790.250787:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876790.250791:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876790.250793:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876790.250797:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1773 00000100:00080000:1.0:1788876790.250800:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876790.250804:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876790.250816:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa645f80 x1875771532369280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876790.250826:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876790.250830:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876790.250832:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876790.250835:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1773 00000100:00080000:1.0:1788876790.250838:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876790.250842:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876790.250853:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb148a80 x1875771532369408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876790.250881:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876790.250885:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876790.250887:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876790.250891:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1773 00000100:00080000:1.0:1788876790.250894:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788876790.250897:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876790.250909:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb148000 x1875771532369792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876790.250941:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532369152:0@lo:38:kworker.0 00000100:00100000:1.0:1788876790.250993:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251028:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532369280:0@lo:38:kworker.0 00000100:00100000:1.0:1788876790.251066:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251086:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532369408:0@lo:38:kworker.0 00000100:00100000:1.0:1788876790.251109:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251128:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532369792:0@lo:38:kworker.0 00000100:00100000:1.0:1788876790.251149:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251187:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369152 00000100:00100000:1.0:1788876790.251192:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369152 00000100:00100000:1.0:1788876790.251217:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1788876790.251224:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532369152:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876790.251248:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876790.251289:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532369152:12345-0@lo:38:kworker.0 Request processed in 64us (295us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876790.251296:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:1.0:1788876790.251316:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369280 00000100:00100000:1.0:1788876790.251319:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369280 00000100:00100000:1.0:1788876790.251335:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369408 00000100:00100000:1.0:1788876790.251338:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369408 00000100:00100000:1.0:1788876790.251348:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369792 00000100:00100000:1.0:1788876790.251350:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369792 00000100:00100000:1.0:1788876790.251360:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1788876790.251365:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876790.251375:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876790.251401:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369280:12345-0@lo:38:kworker.0 Request processed in 35us (334us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876790.251407:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1788876790.251418:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1788876790.251422:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369408:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876790.251431:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876790.251450:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369408:12345-0@lo:38:kworker.0 Request processed in 27us (340us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876790.251456:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1788876790.251466:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1788876790.251470:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876790.251478:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876790.251497:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532369792:12345-0@lo:38:kworker.0 Request processed in 25us (347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876790.251503:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00080000:1.0:1788876790.251536:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876790.251542:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876790.251545:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532369152:0@lo:38:kworker.0 00000100:00080000:1.0:1788876790.251554:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876790.251558:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876790.251561:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532369280:0@lo:38:kworker.0 00000100:00080000:1.0:1788876790.251568:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876790.251571:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876790.251574:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532369408:0@lo:38:kworker.0 00000100:00080000:1.0:1788876790.251582:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876790.251585:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876790.251588:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532369792:0@lo:38:kworker.0 00000100:00100000:1.0:1788876790.251655:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532369664:0@lo:400:kworker.0 00000100:00100000:1.0:1788876790.251686:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251709:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876790.251715:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532369920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876790.251737:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876790.251760:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369920 00000100:00100000:1.0:1788876790.251763:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369920 00000100:00100000:1.0:1788876790.251796:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:1.0:1788876790.251802:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532369920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876790.251840:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532369920:12345-0@lo:400:kworker.0 Request processed in 38us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876790.251847:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:1.0:1788876790.251874:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532369920:0@lo:400:kworker.0 00000100:00100000:3.0:1788876790.252117:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788876790.252153:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876790.252182:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876790.252188:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532369024:0@lo:400:kworker.0 00000400:00000100:3.0:1788876790.252208:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532369024 offset 0 length 224: 4 00000100:00100000:3.0:1788876790.252239:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369536 00000100:00100000:3.0:1788876790.252243:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369536 00000100:00100000:3.0:1788876790.252278:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:3.0:1788876790.252285:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876790.252322:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532369536:12345-0@lo:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876790.252329:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:3.0:1788876790.252358:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532369664 00000100:00100000:3.0:1788876790.252361:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532369664 00000100:00100000:3.0:1788876790.252384:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788876790.252390:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532369664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876790.252423:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532369664:12345-0@lo:400:kworker.0 Request processed in 33us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876790.252430:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788876790.252456:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532369536:0@lo:400:kworker.0 00000100:00100000:1.0:1788876790.252538:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532369664:0@lo:400:kworker.0 00000100:00080000:0.0:1788876790.252733:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876790.252740:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788876790.828504:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876791.476213:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876791.476288:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266816 00000100:00100000:0.0:1788876791.476302:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266816 00000100:00100000:0.0:1788876791.476362:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2541 00000100:00100000:0.0:1788876791.476372:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511266816:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876791.476406:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876791.476491:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511266816:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 118us (297us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876791.476499:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2541 00000400:00000100:0.0:1788876791.478294:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511266688 offset 0 length 224: 4 00000100:00100000:0.0:1788876791.478331:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876791.478367:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876791.478396:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876791.478427:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511266944 00000100:00100000:0.0:1788876791.478438:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511266944 00000100:00100000:0.0:1788876791.478513:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1723 00000100:00100000:0.0:1788876791.478525:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511266944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876791.478640:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511266944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876791.478649:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1723 00000100:00100000:0.0:1788876791.478681:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267072 00000100:00100000:0.0:1788876791.478684:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267072 00000100:00100000:0.0:1788876791.478719:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267200 00000100:00100000:0.0:1788876791.478722:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267200 00000100:00100000:0.0:1788876791.478759:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1283 00000100:00100000:0.0:1788876791.478767:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876791.479057:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1284 00000100:00100000:1.0:1788876791.479068:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876791.479101:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876791.479109:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1284 00000100:00100000:0.0:1788876791.480072:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1303us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876791.480082:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1283 00000100:00080000:0.0:1788876791.480114:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876791.480121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876791.480125:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876791.848710:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876792.879054:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876793.903883:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876794.348771:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876794.348800:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532370048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876794.354795:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876794.354956:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370048 00000100:00100000:1.0:1788876794.354973:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370048 00000100:00100000:1.0:1788876794.355086:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1788876794.355098:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532370048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876794.355145:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876794.355243:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532370048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (6344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876794.355252:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:1.0:1788876794.355277:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876794.358463:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532370048:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876794.921741:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876795.376379:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876795.376388:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876795.376393:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876795.376403:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1778 00000100:00080000:3.0:1788876795.376411:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876795.376421:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876795.376453:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac98e00 x1875771532370304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876795.376476:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876795.376480:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876795.376482:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876795.376485:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1778 00000100:00080000:3.0:1788876795.376488:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876795.376492:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876795.376505:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac9b480 x1875771532370432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876795.376543:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876795.376548:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876795.376550:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876795.376554:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1778 00000100:00080000:3.0:1788876795.376557:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876795.376562:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876795.376579:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99180 x1875771532370688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876795.376631:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876795.376634:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876795.376636:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876795.376640:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1778 00000100:00080000:3.0:1788876795.376642:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876795.376647:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876795.376659:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99f80 x1875771532371072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876795.379036:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532370944:0@lo:400:kworker.0 00000100:00100000:0.0:1788876795.379133:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876795.379216:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788876795.379224:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532370176:0@lo:400:kworker.0 00000400:00000100:0.0:1788876795.379247:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532370176 offset 0 length 224: 4 00000100:00100000:0.0:1788876795.379269:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532371200:0@lo:400:kworker.0 00000100:00100000:0.0:1788876795.379299:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876795.379339:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371200 00000100:00100000:0.0:1788876795.379348:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371200 00000100:00100000:0.0:1788876795.379416:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:0.0:1788876795.379426:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532371200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876795.379488:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532371200:12345-0@lo:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876795.379495:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00080000:0.0:1788876795.379518:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876795.379568:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532371200:0@lo:400:kworker.0 00000100:00100000:1.0:1788876795.379770:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532370304:0@lo:38:kworker.0 00000100:00100000:1.0:1788876795.379809:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876795.379833:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532370432:0@lo:38:kworker.0 00000100:00100000:1.0:1788876795.379856:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876795.379875:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532370688:0@lo:38:kworker.0 00000100:00100000:1.0:1788876795.379896:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876795.379912:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532371072:0@lo:38:kworker.0 00000100:00100000:1.0:1788876795.379933:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876795.380310:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370304 00000100:00100000:1.0:1788876795.380316:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370304 00000100:00100000:1.0:1788876795.380344:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1788876795.380350:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532370304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876795.380372:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876795.380415:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532370304:12345-0@lo:38:kworker.0 Request processed in 65us (606us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876795.380422:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1788876795.380441:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370432 00000100:00100000:1.0:1788876795.380445:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370432 00000100:00100000:1.0:1788876795.380463:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370688 00000100:00100000:1.0:1788876795.380466:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370688 00000100:00100000:1.0:1788876795.380477:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371072 00000100:00100000:1.0:1788876795.380480:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371072 00000100:00100000:1.0:1788876795.380491:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1788876795.380496:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532370432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876795.380506:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876795.380532:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532370432:12345-0@lo:38:kworker.0 Request processed in 35us (676us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876795.380538:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1788876795.380551:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1788876795.380554:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532370688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876795.380563:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876795.380586:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532370688:12345-0@lo:38:kworker.0 Request processed in 31us (689us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876795.380592:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1788876795.380634:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1788876795.380638:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532371072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876795.380647:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876795.380673:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532371072:12345-0@lo:38:kworker.0 Request processed in 33us (738us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876795.380682:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00080000:1.0:1788876795.380726:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876795.380732:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876795.380736:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532370304:0@lo:38:kworker.0 00000100:00080000:1.0:1788876795.380745:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876795.380749:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876795.380752:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532370432:0@lo:38:kworker.0 00000100:00080000:1.0:1788876795.380760:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876795.380763:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876795.380766:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532370688:0@lo:38:kworker.0 00000100:00080000:1.0:1788876795.380773:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876795.380776:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876795.380778:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532371072:0@lo:38:kworker.0 00000100:00100000:2.0:1788876795.381173:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532370560:0@lo:400:kworker.0 00000100:00100000:2.0:1788876795.381224:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876795.381296:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532371328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876795.381324:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876795.381356:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876795.381364:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532370816:0@lo:400:kworker.0 00000100:00100000:2.0:1788876795.381390:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876795.384290:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371328 00000100:00100000:1.0:1788876795.384311:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371328 00000100:00100000:1.0:1788876795.384405:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1788876795.384418:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532371328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876795.384464:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876795.384574:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532371328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876795.384581:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1788876795.384638:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370816 00000100:00100000:1.0:1788876795.384643:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370816 00000100:00100000:1.0:1788876795.384677:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:1.0:1788876795.384685:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532370816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876795.384727:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532370816:12345-0@lo:400:kworker.0 Request processed in 43us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876795.384733:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:1.0:1788876795.384790:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532370816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876795.384815:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532371328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876795.384874:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876795.384882:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876795.385121:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370944 00000100:00100000:0.0:1788876795.385128:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370944 00000100:00100000:0.0:1788876795.385179:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532370560 00000100:00100000:0.0:1788876795.385183:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532370560 00000100:00100000:0.0:1788876795.385210:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1788876795.385220:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532370944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876795.385278:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532370944:12345-0@lo:400:kworker.0 Request processed in 61us (6145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876795.385284:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1788876795.385295:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1788876795.385300:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532370560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876795.385328:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532370560:12345-0@lo:400:kworker.0 Request processed in 28us (4105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876795.385333:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1788876795.385374:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532370944:0@lo:400:kworker.0 00000100:00100000:1.0:1788876795.385591:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532370560:0@lo:400:kworker.0 00010000:00010000:1.0:1788876795.945722:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788876796.398049:0:3662:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876780/real 1788876780] req@ffff8a13fa646a00 x1875771532365952/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876796 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876796.398086:0:3662:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13fa646a00 x1875771532365952/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876796 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876796.398096:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788876796.398100:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788876796.398103:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788876796.398106:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788876796.398110:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fa646a00 x1875771532365952/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876796 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876796.398118:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13eb14b800 x1875771532367488/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876801 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876796.398126:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fa644380 x1875771532369024/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876806 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876796.398149:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fac98000 x1875771532370176/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788876796.398162:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788876796.398165:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788876796.398167:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788876796.398169:0:3662:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788876796.398200:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532370176:0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.398209:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532367488:0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.398213:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532365952:0@lo:400:kworker.0 00000100:00080000:1.0:1788876796.398254:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876796.398259:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788876796.398262:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876796.398267:0:24072:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1726 00000100:00080000:1.0:1788876796.398278:0:24072:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876796.398327:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978380 x1875771532371456/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876796.398357:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876796.398362:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876796.398364:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876796.398367:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1783 00000100:00080000:1.0:1788876796.398371:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876796.398375:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876796.398394:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979880 x1875771532371584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876796.398403:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876796.398407:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876796.398409:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876796.398412:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1783 00000100:00080000:1.0:1788876796.398415:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876796.398418:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876796.398429:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979f80 x1875771532371712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876796.398437:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532371456:0@lo:250:kworker.0 00000100:00080000:1.0:1788876796.398457:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876796.398461:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876796.398462:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876796.398465:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1783 00000100:00080000:1.0:1788876796.398467:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876796.398471:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876796.398480:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb14b800 x1875771532371968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1788876796.398494:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532371456 offset 0 length 520: 4 00000100:00080000:1.0:1788876796.398504:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876796.398507:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876796.398508:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876796.398511:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1783 00000100:00080000:1.0:1788876796.398513:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876796.398516:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876796.398527:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb14bb80 x1875771532372352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876796.398537:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532371584:0@lo:38:kworker.0 00000100:00100000:1.0:1788876796.398555:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788876796.398572:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876796.398583:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876796.398597:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532371712:0@lo:38:kworker.0 00000100:00100000:1.0:1788876796.398625:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876796.398631:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532372480:0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.398651:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876796.398679:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372480 00000100:00100000:0.0:1788876796.398687:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372480 00000100:00100000:1.0:1788876796.398691:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371584 00000100:00100000:1.0:1788876796.398694:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371584 00000100:00100000:0.0:1788876796.398738:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:0.0:1788876796.398749:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532372480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.398796:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1788876796.398802:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532371584:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788876796.398804:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532372480:12345-0@lo:400:kworker.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876796.398811:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00010000:00020000:1.0:1788876796.398820:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876796.398854:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532371584:12345-0@lo:38:kworker.0 Request processed in 52us (282us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876796.398860:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1788876796.398882:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371840 00000100:00100000:1.0:1788876796.398886:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371840 00000100:00100000:1.0:1788876796.398917:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788876796.398924:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532371840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.398955:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532371840:12345-0@lo:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876796.398961:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788876796.398978:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876796.399013:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532371968:0@lo:38:kworker.0 00000100:00100000:1.0:1788876796.399035:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876796.399051:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532372352:0@lo:38:kworker.0 00000100:00100000:1.0:1788876796.399073:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876796.399101:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371712 00000100:00080000:1.0:1788876796.399104:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788876796.399105:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371712 00000100:00080000:1.0:1788876796.399108:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876796.399112:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532371584:0@lo:38:kworker.0 00000100:00100000:0.0:1788876796.399123:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532371968 00000100:00100000:0.0:1788876796.399126:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532371968 00000100:00100000:0.0:1788876796.399135:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372352 00000100:00100000:0.0:1788876796.399137:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372352 00000100:00100000:1.0:1788876796.399138:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1788876796.399143:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532371712:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788876796.399146:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1788876796.399149:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532371968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876796.399154:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1788876796.399157:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876796.399183:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532371712:12345-0@lo:38:kworker.0 Request processed in 38us (204us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876796.399190:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1788876796.399202:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:1.0:1788876796.399206:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532372352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876796.399216:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876796.399225:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532372224:0@lo:400:kworker.0 00000100:00100000:2.0:1788876796.399256:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876796.399281:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532369024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876796.399295:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876796.399300:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532372096:0@lo:400:kworker.0 00000100:00100000:2.0:1788876796.399323:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876796.399344:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372224 00000100:00100000:2.0:1788876796.399348:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372224 00000100:00100000:2.0:1788876796.399397:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788876796.399404:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532372224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876796.399438:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532372224:12345-0@lo:400:kworker.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876796.399444:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788876796.399474:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532372224:0@lo:400:kworker.0 00000100:00100000:0.0:1788876796.405820:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532371968:12345-0@lo:38:kworker.0 Request processed in 6652us (6768us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876796.405838:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1788876796.406156:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372096 00000100:00100000:0.0:1788876796.406168:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372096 00000100:00100000:0.0:1788876796.406221:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1788876796.406230:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532372096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876796.406330:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532372096:12345-0@lo:400:kworker.0 Request processed in 102us (7006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876796.406338:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:2.0:1788876796.406761:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532372096:0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.406974:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532372352:12345-0@lo:38:kworker.0 Request processed in 7763us (7897us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876796.406985:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00080000:1.0:1788876796.407048:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876796.407096:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532372480:0@lo:400:kworker.0 00000100:00100000:1.0:1788876796.407115:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532371840:0@lo:400:kworker.0 00000100:00080000:1.0:1788876796.407158:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876796.407165:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876796.407168:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532371712:0@lo:38:kworker.0 00000100:00080000:1.0:1788876796.407181:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876796.407184:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876796.407187:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532371968:0@lo:38:kworker.0 00000100:00080000:1.0:1788876796.407199:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876796.407202:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876796.407206:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532372352:0@lo:38:kworker.0 00000100:00100000:0.0:1788876796.594931:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788876796.594976:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511267968 offset 0 length 520: 4 00000100:00100000:0.0:1788876796.595009:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876796.595032:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876796.595055:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876796.595460:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267456 00000100:00100000:1.0:1788876796.595473:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267456 00000100:00100000:1.0:1788876796.595519:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267584 00000100:00100000:1.0:1788876796.595522:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267584 00000100:00100000:1.0:1788876796.595571:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1728 00000100:00100000:1.0:1788876796.595583:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511267584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1788876796.597513:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876796.597554:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2548 00000100:00100000:0.0:1788876796.597565:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511267456:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876796.597594:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876796.597704:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511267456:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 138us (2786us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876796.597712:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2548 00000100:00100000:0.0:1788876796.597748:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267712 00000100:00100000:0.0:1788876796.597755:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267712 00000100:00100000:0.0:1788876796.597806:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511267840 00000100:00100000:0.0:1788876796.597809:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511267840 00000100:00100000:0.0:1788876796.597831:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1289 00000100:00100000:0.0:1788876796.597837:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876796.597876:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876796.597883:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1289 00000100:00100000:0.0:1788876796.597896:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1290 00000100:00100000:0.0:1788876796.597902:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876796.597929:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511267840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876796.597936:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1290 00000100:00080000:0.0:1788876796.598096:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876796.598100:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876796.599435:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511267584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3845us (4391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876796.599450:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1728 00010000:00010000:3.0:1788876796.969506:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876798.005184:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876799.024313:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876799.466075:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532372608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876799.466193:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876799.466347:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372608 00000100:00100000:0.0:1788876799.466359:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372608 00000100:00100000:0.0:1788876799.466453:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1788876799.466752:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532372608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876799.466794:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876799.466912:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532372608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876799.466922:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:2.0:1788876799.467000:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876799.467044:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532372608:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788876800.041005:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876800.490044:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876800.490073:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532372736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876800.490174:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876800.493326:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372736 00000100:00100000:1.0:1788876800.493347:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372736 00000100:00100000:1.0:1788876800.493428:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1788876800.493439:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532372736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876800.493482:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876800.493589:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532372736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876800.497844:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00080000:1.0:1788876800.497905:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876800.498005:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532372736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876801.064783:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876801.515709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876801.515726:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788876801.515729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876801.515734:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876801.515740:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876801.515752:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1784 00000100:00080000:3.0:1788876801.515758:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876801.515767:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876801.515819:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac9ad80 x1875771532372864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876801.515854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876801.515859:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876801.515861:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876801.515865:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1784 00000100:00080000:3.0:1788876801.515868:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876801.515872:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876801.515885:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac98000 x1875771532372992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876801.515924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876801.515928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876801.515930:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876801.515933:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1784 00000100:00080000:3.0:1788876801.515935:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876801.515939:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876801.515950:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99500 x1875771532373248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876801.515999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876801.516003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876801.516004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876801.516008:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1784 00000100:00080000:3.0:1788876801.516010:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876801.516014:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876801.516024:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99180 x1875771532373632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876801.516066:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532373120:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516163:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876801.516237:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876801.516244:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532373760:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516276:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876801.516319:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532373504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516345:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876801.516363:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876801.516368:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532373376:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516388:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876801.516417:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373760 00000100:00100000:3.0:1788876801.516425:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373760 00000100:00100000:3.0:1788876801.516483:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373376 00000100:00100000:3.0:1788876801.516486:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373376 00000100:00100000:3.0:1788876801.516513:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1788876801.516522:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532373760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516580:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532373760:12345-0@lo:400:kworker.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876801.516588:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1788876801.516638:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:3.0:1788876801.516645:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532373376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516677:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532373376:12345-0@lo:400:kworker.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876801.516683:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:3.0:1788876801.516701:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373120 00000100:00100000:3.0:1788876801.516704:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373120 00000100:00100000:3.0:1788876801.516727:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373504 00000100:00100000:3.0:1788876801.516730:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373504 00000100:00100000:3.0:1788876801.516750:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1788876801.516756:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532373120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516787:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532373120:12345-0@lo:400:kworker.0 Request processed in 31us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876801.516794:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1788876801.516804:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1788876801.516810:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532373504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516833:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532373504:12345-0@lo:400:kworker.0 Request processed in 23us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876801.516838:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00080000:3.0:1788876801.516857:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876801.516863:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876801.516924:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532373376:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516936:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532373504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516983:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532373760:0@lo:400:kworker.0 00000100:00100000:3.0:1788876801.516995:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532373120:0@lo:400:kworker.0 00000100:00100000:2.0:1788876801.517165:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532372864:0@lo:38:kworker.0 00000100:00100000:2.0:1788876801.517212:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876801.517255:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532372992:0@lo:38:kworker.0 00000100:00100000:2.0:1788876801.517281:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876801.517296:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532373248:0@lo:38:kworker.0 00000100:00100000:2.0:1788876801.517316:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876801.517329:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532373632:0@lo:38:kworker.0 00000100:00100000:2.0:1788876801.517351:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876801.522020:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372864 00000100:00100000:3.0:1788876801.522043:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372864 00000100:00100000:3.0:1788876801.522111:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1788876801.522122:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532372864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876801.522152:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876801.522269:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532372864:12345-0@lo:38:kworker.0 Request processed in 147us (5056us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876801.522277:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1788876801.522310:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532372992 00000100:00100000:3.0:1788876801.522314:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532372992 00000100:00100000:3.0:1788876801.522337:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373248 00000100:00100000:3.0:1788876801.522341:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373248 00000100:00100000:3.0:1788876801.522355:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373632 00000100:00100000:3.0:1788876801.522357:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373632 00000100:00100000:3.0:1788876801.522367:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1788876801.522372:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532372992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876801.522381:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876801.522411:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532372992:12345-0@lo:38:kworker.0 Request processed in 38us (5129us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876801.522418:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:2.0:1788876801.523840:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876801.523853:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876801.523859:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532372864:0@lo:38:kworker.0 00000100:00080000:2.0:1788876801.523873:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876801.523877:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876801.523880:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532372992:0@lo:38:kworker.0 00000100:00100000:3.0:1788876801.524056:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1788876801.524066:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532373248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876801.524086:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876801.524178:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532373248:12345-0@lo:38:kworker.0 Request processed in 112us (6860us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876801.524186:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1788876801.524203:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1788876801.524209:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532373632:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876801.524219:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876801.524247:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532373632:12345-0@lo:38:kworker.0 Request processed in 37us (6895us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876801.524253:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00080000:2.0:1788876801.525522:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876801.525535:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876801.525540:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532373248:0@lo:38:kworker.0 00000100:00080000:2.0:1788876801.525559:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876801.525562:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876801.525565:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532373632:0@lo:38:kworker.0 00000100:00100000:0.0:1788876801.745548:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876801.745623:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268096 00000100:00100000:0.0:1788876801.745636:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268096 00000100:00100000:0.0:1788876801.745695:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2552 00000100:00100000:0.0:1788876801.745704:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511268096:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876801.745733:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876801.745814:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511268096:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 109us (281us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876801.745823:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2552 00000100:00100000:0.0:1788876801.745872:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876801.746035:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876801.746065:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876801.746087:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268224 00000100:00100000:0.0:1788876801.746092:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268224 00000100:00100000:0.0:1788876801.746150:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1731 00000100:00100000:0.0:1788876801.746158:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511268224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876801.746213:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511268224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876801.746220:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1731 00000100:00100000:0.0:1788876801.746240:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268480 00000100:00100000:0.0:1788876801.746244:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268480 00000100:00100000:0.0:1788876801.746275:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268352 00000100:00100000:0.0:1788876801.746278:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268352 00000100:00100000:0.0:1788876801.746299:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1293 00000100:00100000:0.0:1788876801.746304:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511268480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876801.746332:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511268480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876801.746338:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1293 00000100:00100000:0.0:1788876801.746349:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1294 00000100:00100000:0.0:1788876801.746355:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511268352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876801.746379:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511268352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876801.746385:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1294 00000100:00080000:0.0:1788876801.746407:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876801.746411:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876801.746414:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876802.088709:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876803.122636:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876804.139504:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876804.589053:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532373888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876804.589129:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876804.594157:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532373888 00000100:00100000:2.0:1788876804.594171:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532373888 00000100:00100000:2.0:1788876804.594261:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1788876804.594274:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532373888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876804.594314:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00080000:1.0:1788876804.596532:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876804.602039:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532373888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7758us (12900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876804.602054:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1788876804.608551:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532373888:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876805.163235:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876805.611808:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532374016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876805.611882:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876805.611977:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374016 00000100:00100000:3.0:1788876805.611986:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374016 00000100:00100000:3.0:1788876805.612039:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1788876805.612048:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532374016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876805.612076:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876805.612119:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532374016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876805.612126:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:3.0:1788876805.612147:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876805.612182:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532374016:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1788876806.152556:0:49156:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788876806.152562:0:49156:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788876806.152565:0:49156:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788876806.153040:0:49156:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a12c354d000 00000020:01000004:2.0:1788876806.153057:0:49156:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788876806.153070:0:49156:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788876806.153084:0:49156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c5e38000) 00000020:00000080:2.0:1788876806.153100:0:49156:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788876806.184820:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788876806.363625:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.370825:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788876806.372115:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788876806.372518:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788876806.376123:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788876806.376632:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788876806.377039:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.377271:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.377517:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788876806.377754:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.377992:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788876806.378278:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.378471:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.378715:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.387372:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788876806.388377:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.388632:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.388907:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.389492:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.389759:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.390006:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.390213:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.390417:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.390643:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.391004:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.391205:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788876806.391400:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788876806.391590:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.395127:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.395726:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.395946:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.396160:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.396421:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.396692:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.396885:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.397773:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.398033:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788876806.398287:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.398482:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.398760:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788876806.402068:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788876806.403391:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788876806.403736:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788876806.403983:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788876806.404223:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788876806.404455:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788876806.404701:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788876806.406770:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788876806.407136:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788876806.407327:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788876806.409527:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788876806.410078:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788876806.410294:0:49156:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788876806.411872:0:49156:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788876806.412145:0:49156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788876806.412153:0:49156:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788876806.412166:0:49156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af4a6 00000020:01000004:1.0:1788876806.412174:0:49156:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788876806.412186:0:49156:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788876806.412192:0:49156:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a12c354d000 from MGS 00000020:01000004:1.0:1788876806.412195:0:49156:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788876806.412205:0:49156:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c25e99c0) 00000020:00000080:1.0:1788876806.412216:0:49156:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788876806.412278:0:49156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c354d000 from MGS, refs=2 00080000:01000000:1.0:1788876806.412283:0:49156:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788876806.412289:0:49156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af4b4 00010000:00010000:1.0:1788876806.417742:0:49156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1788876806.430113:0:49156:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788876806.437726:0:49160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788876806.438501:0:49156:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788876806.438599:0:49156:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788876806.439955:0:49156:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788876806.440203:0:49156:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788876806.440377:0:49156:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788876806.440384:0:49156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788876806.453937:0:49156:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788876806.453954:0:49156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788876806.456321:0:49156:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788876806.456337:0:49156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788876806.457736:0:49156:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788876806.457777:0:49156:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788876806.457779:0:49156:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788876806.457783:0:49156:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788876806.457788:0:49156:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 39, was 0): CONNECTING 00000100:00100000:1.0:1788876806.457794:0:49156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788876806.633821:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876806.633832:0:24072:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788876806.633834:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876806.633837:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876806.633841:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876806.633849:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1789 00000100:00080000:2.0:1788876806.633854:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876806.633861:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876806.633913:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48ed80 x1875771532374144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876806.633943:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876806.633947:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876806.633949:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876806.633952:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1789 00000100:00080000:2.0:1788876806.633954:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876806.633958:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876806.633974:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48e680 x1875771532374272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876806.634018:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876806.634021:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876806.634023:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876806.634026:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1789 00000100:00080000:2.0:1788876806.634028:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876806.634031:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876806.634043:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532374528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876806.634074:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876806.634077:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876806.634078:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876806.634081:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1789 00000100:00080000:2.0:1788876806.634083:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876806.634086:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876806.634095:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48ce00 x1875771532374912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876806.634127:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532374656:0@lo:400:kworker.0 00000100:00100000:2.0:1788876806.634198:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876806.634254:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876806.634261:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532374784:0@lo:400:kworker.0 00000100:00100000:2.0:1788876806.634285:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876806.634329:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374656 00000100:00100000:2.0:1788876806.634337:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374656 00000100:00100000:0.0:1788876806.634542:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532375040:0@lo:400:kworker.0 00000100:00100000:0.0:1788876806.634573:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.634623:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876806.634630:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532374400:0@lo:400:kworker.0 00000100:00100000:0.0:1788876806.634654:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.634683:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375040 00000100:00100000:0.0:1788876806.634687:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375040 00000100:00100000:2.0:1788876806.634771:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1788876806.634781:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532374656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876806.634833:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532374656:12345-0@lo:400:kworker.0 Request processed in 54us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.634840:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1788876806.634864:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374784 00000100:00100000:2.0:1788876806.634868:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374784 00000100:00100000:1.0:1788876806.635015:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876796/real 1788876796] req@ffff8a13e7978380 x1875771532371456/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876806 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876806.635035:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13e7978380 x1875771532371456/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876806 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876806.635050:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532374144:0@lo:38:kworker.0 00000100:00100000:1.0:1788876806.635080:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.635107:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532374272:0@lo:38:kworker.0 00000100:00100000:1.0:1788876806.635128:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.635145:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532374528:0@lo:38:kworker.0 00000100:00100000:1.0:1788876806.635163:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.635178:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532374912:0@lo:38:kworker.0 00000100:00100000:1.0:1788876806.635195:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876806.635209:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.635221:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788876806.635227:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532371456:0@lo:250:kworker.0 00000100:00100000:1.0:1788876806.635255:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374400 00000100:00100000:1.0:1788876806.635259:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374400 00000100:00100000:1.0:1788876806.635285:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1788876806.635292:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532374400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876806.635341:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532374400:12345-0@lo:400:kworker.0 Request processed in 50us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876806.635348:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1788876806.635374:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374144 00000100:00100000:1.0:1788876806.635378:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374144 00000100:00100000:1.0:1788876806.635396:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1788876806.635401:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532374144:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876806.635419:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876806.635451:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532374144:12345-0@lo:38:kworker.0 Request processed in 48us (370us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876806.635458:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1788876806.635473:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374272 00000100:00100000:1.0:1788876806.635477:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374272 00000100:00100000:1.0:1788876806.635490:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374528 00000100:00100000:1.0:1788876806.635493:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374528 00000100:00100000:1.0:1788876806.635499:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532374912 00000100:00100000:1.0:1788876806.635501:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532374912 00000100:00100000:1.0:1788876806.635509:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1788876806.635513:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876806.635523:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876806.635545:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374272:12345-0@lo:38:kworker.0 Request processed in 31us (416us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876806.635551:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1788876806.635560:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1788876806.635564:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374528:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876806.635573:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876806.635592:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374528:12345-0@lo:38:kworker.0 Request processed in 26us (428us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876806.635597:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1788876806.635623:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1788876806.635627:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876806.635637:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876806.635660:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532374912:12345-0@lo:38:kworker.0 Request processed in 31us (463us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876806.635665:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:1.0:1788876806.635711:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532374400:0@lo:400:kworker.0 00000100:00080000:1.0:1788876806.635738:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.635742:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876806.635745:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532374144:0@lo:38:kworker.0 00000100:00080000:1.0:1788876806.635752:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.635755:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876806.635757:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532374272:0@lo:38:kworker.0 00000100:00080000:1.0:1788876806.635764:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.635767:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876806.635770:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532374528:0@lo:38:kworker.0 00000100:00080000:1.0:1788876806.635776:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.635779:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876806.635782:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532374912:0@lo:38:kworker.0 00000100:00080000:1.0:1788876806.635804:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876806.635808:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788876806.635811:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876806.635814:0:24072:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1784 00000100:00080000:1.0:1788876806.635817:0:24072:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788876806.635821:0:24072:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876806.635840:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4674380 x1875771532375168/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:1.0:1788876806.635871:0:3661:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a13f4674380 x1875771532375168/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876806.638791:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:0.0:1788876806.638805:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876806.638980:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532375040:12345-0@lo:400:kworker.0 Request processed in 177us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.638988:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:0.0:1788876806.639045:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532375040:0@lo:400:kworker.0 10000000:01000000:0.0:1788876806.639101:0:49156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788876806.639118:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639128:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639134:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788876806.639147:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639156:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221200/0xf5bf0f7e313af157 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af15e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639184:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639191:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639197:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639202:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639206:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73800/0xf5bf0f7e313af0cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af0d2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639215:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639220:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639225:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639237:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639241:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220200/0xf5bf0f7e313af0d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af0e0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639251:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639257:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639261:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639274:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639277:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313af0f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af0fc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639290:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639296:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639300:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639489:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639495:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487000/0xf5bf0f7e313af103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af10a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639505:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639511:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639515:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639532:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639536:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313af11f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af126 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639544:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639551:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639555:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639569:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639572:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1486e00/0xf5bf0f7e313af13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af142 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639582:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639588:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639593:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639644:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639649:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fad52800/0xf5bf0f7e313af173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af17a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639670:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639677:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639682:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639689:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639692:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fad52e00/0xf5bf0f7e313af12d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af134 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639712:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639719:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639728:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788876806.639734:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639738:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313af149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af150 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639754:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639761:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639766:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876806.639772:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639776:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313af0e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af0ee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639784:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639790:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639795:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876806.639808:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639813:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313af111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af118 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.639822:0:49156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876806.639832:0:49156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.639837:0:49156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788876806.639849:0:49156:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788876806.639853:0:49156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fad53800/0xf5bf0f7e313af165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af16c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876806.640121:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532374656:0@lo:400:kworker.0 00000100:00100000:2.0:1788876806.640176:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1788876806.640185:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532374784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876806.640235:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532374784:12345-0@lo:400:kworker.0 Request processed in 52us (5949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.640242:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1788876806.640265:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532374784:0@lo:400:kworker.0 00000100:00080000:3.0:1788876806.653913:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876806.653932:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876806.669249:0:49156:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 40, was 0): CONNECTING 00000100:00080000:0.0:1788876806.669261:0:49156:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1788876806.670989:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876806.671019:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1788876806.671070:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:0:1875771532375168:0@lo:250:kworker.0 00000100:00080000:3.0:1788876806.671104:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876806.671109:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788876806.671112:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876806.671117:0:24072:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1794 00000100:00080000:3.0:1788876806.671122:0:24072:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876806.671129:0:24072:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876806.671164:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c365b800 x1875771532375296/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876806.673971:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532375296:0@lo:250:kworker.0 00000100:00100000:1.0:1788876806.674054:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876806.674216:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375296 00000100:00100000:3.0:1788876806.674225:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375296 00000100:00100000:3.0:1788876806.674265:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788876806.674273:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532375296:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1788876806.674298:0:49161:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 1794 last 0 00000020:00000080:3.0:1788876806.674327:0:49161:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313af4bb 00000100:00080000:3.0:1788876806.674464:0:49161:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876806.674531:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532375296:12345-0@lo:250:kworker.0 Request processed in 257us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.674539:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788876806.674679:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 19 00000100:00080000:2.0:1788876806.674690:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1788876806.674697:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788876806.674702:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788876806.674706:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788876806.674708:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788876806.674725:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788876806.674730:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532375296:0@lo:250:kworker.0 00000020:01000000:3.0:1788876806.674901:0:24072:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:3.0:1788876806.674919:0:24072:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1788876806.674931:0:24072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788876806.674933:0:24072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788876806.674934:0:24072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876806.674936:0:24072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876806.674937:0:24072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876806.674938:0:24072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876806.674939:0:24072:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876806.674941:0:24072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876806.674942:0:24072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788876806.674986:0:24072:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788876806.674996:0:24072:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1788876806.674997:0:24072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788876806.674998:0:24072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788876806.674999:0:24072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876806.675000:0:24072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876806.675001:0:24072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876806.675002:0:24072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876806.675004:0:24072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788876806.675005:0:24072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876806.675006:0:24072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788876806.675024:0:24072:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1788876806.675029:0:24072:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1788876806.675030:0:24072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1788876806.675032:0:24072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788876806.675033:0:24072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876806.675034:0:24072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876806.675035:0:24072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876806.675036:0:24072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876806.675037:0:24072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788876806.675038:0:24072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876806.675039:0:24072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1788876806.675050:0:24072:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1788876806.675076:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876806.675086:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532375424:0@lo:253:kworker.0 00000100:00100000:3.0:1788876806.675122:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876806.675152:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532375680:0@lo:253:kworker.0 00000100:00100000:3.0:1788876806.675176:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876806.675191:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876806.675197:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532375552:0@lo:253:kworker.0 00000100:00100000:3.0:1788876806.675219:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876806.675250:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375424 00000100:00100000:3.0:1788876806.675254:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375424 00000100:00100000:3.0:1788876806.675274:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375680 00000100:00100000:3.0:1788876806.675277:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375680 00000100:00100000:3.0:1788876806.675286:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375552 00000100:00100000:3.0:1788876806.675288:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375552 00000100:00100000:3.0:1788876806.675298:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788876806.675305:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3664:x1875771532375424:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788876806.675325:0:49161:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788876806.675421:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788876806.675429:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3663:x1875771532375680:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788876806.675444:0:49164:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:0.0:1788876806.675647:0:49156:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1788876806.675659:0:49156:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788876806.675693:0:49156:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788876806.675698:0:49156:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788876806.675797:0:49156:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788876806.675824:0:49156:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788876806.675828:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788876806.675829:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876806.675830:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.675831:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.675833:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.675834:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.675835:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876806.675836:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876806.675838:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.675839:0:49156:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876806.675842:0:49156:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788876806.675844:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788876806.675845:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876806.675846:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.675847:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.675849:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.675850:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.675851:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876806.675852:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876806.675853:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.675854:0:49156:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788876806.675868:0:49156:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788876806.675878:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532375808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788876806.675933:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.675950:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876806.676274:0:49163:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788876806.676282:0:49163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788876806.678190:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375808 00000100:00100000:0.0:1788876806.678201:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375808 00000100:00100000:1.0:1788876806.678438:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788876806.678449:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532375552:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788876806.678476:0:49166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:2.0:1788876806.678737:0:49165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788876806.678886:0:49161:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 75 20000000:01000000:0.0:1788876806.682019:0:49167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788876806.682028:0:49167:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788876806.682032:0:49167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788876806.682035:0:49167:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788876806.682215:0:49167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788876806.686830:0:49161:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788876806.686866:0:49161:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788876806.690777:0:49161:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788876806.690797:0:49161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788876806.691027:0:49165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876806.691032:0:49165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876806.691058:0:49165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691076:0:49165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876806.691086:0:49165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055620s 00010000:00010000:1.0:1788876806.691092:0:49165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691099:0:49165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691108:0:49165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691119:0:49165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691126:0:49165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876806.691131:0:49165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691140:0:49165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691151:0:49165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691160:0:49165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.691167:0:49165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788876806.691346:0:49164:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788876806.691681:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532375424:12345-0@lo:253:kworker.0 Request processed in 16372us (16554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.691691:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788876806.691730:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788876806.691742:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:49156:x1875771532375808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788876806.691783:0:49161:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788876806.691786:0:49161:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788876806.691789:0:49161:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788876806.691795:0:49161:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1788876806.691968:0:3664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876806.691972:0:3664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788876806.691973:0:3664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.691975:0:3664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.691976:0:3664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.691978:0:3664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.691979:0:3664:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876806.691981:0:3664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.691982:0:3664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876806.691986:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532375424:0@lo:253:kworker.0 20000000:01000000:2.0:1788876806.697436:0:49164:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788876806.697448:0:49164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788876806.697905:0:49166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788876806.698012:0:49165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876806.698017:0:49165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876806.698036:0:49165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698053:0:49165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876806.698062:0:49165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055620s 00010000:00010000:1.0:1788876806.698067:0:49165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698076:0:49165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698084:0:49165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698093:0:49165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698100:0:49165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876806.698105:0:49165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698113:0:49165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698126:0:49165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698135:0:49165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.698142:0:49165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34000/0xf5bf0f7e313af4c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876806.698360:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3663:x1875771532375680:12345-0@lo:253:kworker.0 Request processed in 22927us (23178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.698371:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788876806.698474:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876806.698478:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788876806.698479:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.698480:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.698482:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.698483:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.698485:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876806.698486:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.698488:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876806.698492:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532375680:0@lo:253:kworker.0 00000100:00100000:0.0:1788876806.698777:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532375808:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788876806.698789:0:49156:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788876806.698791:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788876806.698793:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788876806.698794:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.698795:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.698797:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.698798:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.698799:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876806.698801:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788876806.698802:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.698803:0:49156:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788876806.698823:0:49156:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a12c354d000 from lustre-MDT0000 10000000:01000000:0.0:1788876806.698852:0:49156:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788876806.698855:0:49156:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788876806.698863:0:49156:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a12c354d000 10000000:01000000:0.0:1788876806.698867:0:49156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788876806.698871:0:49156:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a12c354d000 10000000:01000000:0.0:1788876806.698874:0:49156:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788876806.698877:0:49156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a12c354d000 from 1 10000000:01000000:0.0:1788876806.698881:0:49156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788876806.698922:0:49156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.698941:0:49156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.698950:0:49156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876806.698974:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532375936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788876806.701882:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.701958:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876806.702952:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532375936 00000100:00100000:0.0:1788876806.702968:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532375936 00000100:00100000:0.0:1788876806.703022:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788876806.703032:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:49156:x1875771532375936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876806.703050:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876806.703070:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400587e00/0xf5bf0f7e313af4d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af4d0 expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.703097:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400587e00/0xf5bf0f7e313af4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af4d0 expref: 8 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.703110:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400587e00/0xf5bf0f7e313af4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af4d0 expref: 8 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.703120:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400587e00, rc 0) 00000100:00100000:0.0:1788876806.703176:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49156:x1875771532375936:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.703183:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788876806.703428:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532375936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876806.703445:0:49156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.703454:0:49156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876806.703470:0:49156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788876806.703489:0:49156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.703496:0:49156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876806.703503:0:49156:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788876806.703508:0:49156:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788876806.703514:0:49156:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a12c354d000 10000000:01000000:1.0:1788876806.703516:0:49156:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788876806.703520:0:49156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788876806.703522:0:49156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788876806.703546:0:49156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.703552:0:49156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.703560:0:49156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876806.703578:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788876806.703642:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.703680:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876806.703835:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376064 00000100:00100000:2.0:1788876806.703841:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376064 00000100:00100000:2.0:1788876806.703869:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788876806.703877:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fb8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49156:x1875771532376064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876806.703897:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876806.703909:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313af4e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af4de expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.703933:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313af4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af4de expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.703942:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313af4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af4de expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.703949:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeffe00, rc 0) 00000100:00100000:2.0:1788876806.703981:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fb8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532376064:12345-0@lo:101:mount.lustre.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.703988:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788876806.704189:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876806.704202:0:49156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.704211:0:49156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876806.704265:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876806.704293:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.704320:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876806.704506:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376192 00000100:00100000:2.0:1788876806.704511:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376192 00000100:00100000:2.0:1788876806.704533:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788876806.704540:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fb8df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532376192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876806.704707:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fb8df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532376192:12345-0@lo:501:mount.lustre.0 Request processed in 167us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.704715:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788876806.705098:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876806.705134:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876806.705185:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.705204:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876806.705298:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376320 00000100:00100000:2.0:1788876806.705303:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376320 00000100:00100000:2.0:1788876806.705332:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788876806.705340:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532376320:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1788876806.706000:0:49166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788876806.706018:0:49166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788876806.706175:0:49165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788876806.706181:0:49165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788876806.706204:0:49165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706220:0:49165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788876806.706230:0:49165:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055620s 00010000:00010000:0.0:1788876806.706236:0:49165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706243:0:49165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706255:0:49165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706262:0:49165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706269:0:49165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876806.706274:0:49165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706283:0:49165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706296:0:49165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706305:0:49165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.706313:0:49165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400587000/0xf5bf0f7e313af4ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876806.706446:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3663:x1875771532375552:12345-0@lo:253:kworker.0 Request processed in 27996us (31222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876806.706453:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788876806.706490:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532376320:12345-0@lo:503:mount.lustre.0 Request processed in 1150us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.706501:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788876806.706502:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532376320:0@lo:503:mount.lustre.0 00000020:01000004:0.0:1788876806.706587:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876806.706589:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788876806.706591:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876806.706592:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876806.706593:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876806.706594:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876806.706596:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876806.706597:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876806.706628:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876806.706632:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532375552:0@lo:253:kworker.0 00000100:00100000:3.0:1788876806.706822:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49156:x1875771532375808:12345-0@lo:253:mount.lustre.0 Request processed in 15082us (30894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.706830:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788876806.707064:0:49168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49168:1875771532376448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876806.707109:0:49168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.707145:0:49168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876806.707192:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376448 00000100:00100000:3.0:1788876806.707198:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376448 00000100:00100000:3.0:1788876806.707236:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788876806.707244:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49168:x1875771532376448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876806.709167:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49168:x1875771532376448:12345-0@lo:502:llog_process_th.0 Request processed in 1917us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.709181:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788876806.709276:0:49168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49168:1875771532376448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876806.709317:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876806.709329:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.709331:0:49168:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788876806.709336:0:49168:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788876806.709339:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876806.709354:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c201cd40) 00000020:00000080:0.0:1788876806.709378:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788876806.709384:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788876806.709468:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788876806.709475:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af4fa 00000020:00000080:0.0:1788876806.709763:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788876806.709768:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876806.709772:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.709774:0:49168:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788876806.709776:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876806.709780:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.709782:0:49168:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788876806.709785:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876806.709791:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c20199c0) 00000020:00000080:0.0:1788876806.709804:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788876806.709807:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788876806.709809:0:49168:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788876806.709812:0:49168:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788876806.709818:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788876806.709858:0:49168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c354d000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788876806.709868:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c201b380) 00000020:00000080:0.0:1788876806.709878:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788876806.709934:0:49168:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788876806.709941:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af50f 00000020:00000080:0.0:1788876806.710028:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788876806.710034:0:49168:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788876806.710037:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313af516 00080000:01000000:0.0:1788876806.710042:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788876806.710044:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af51d 00000100:00100000:0.0:1788876806.831037:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876806.831079:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876806.831097:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876806.831122:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876806.831142:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876806.831172:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268864 00000100:00100000:0.0:1788876806.831182:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268864 00000100:00100000:0.0:1788876806.831233:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268736 00000100:00100000:0.0:1788876806.831236:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268736 00000100:00100000:0.0:1788876806.831253:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1734 00000100:00100000:0.0:1788876806.831263:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511268864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876806.831331:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511268864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.831338:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1734 00000100:00100000:0.0:1788876806.831356:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2556 00000100:00100000:0.0:1788876806.831360:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511268736:12345-192.168.203.11@tcp:38:kworker.0 00010000:02000000:0.0:1788876806.831375:0:8722:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.11@tcp (not set up) 00000100:00080000:1.0:1788876806.832028:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876806.833525:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269120 00000100:00100000:2.0:1788876806.833537:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269120 00000100:00100000:2.0:1788876806.833629:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268992 00000100:00100000:2.0:1788876806.833633:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268992 00000100:00100000:2.0:1788876806.833663:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1297 00000100:00100000:2.0:1788876806.833673:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511269120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876806.833749:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511269120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 77us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.833756:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1297 00000100:00100000:2.0:1788876806.833772:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1298 00000100:00100000:2.0:1788876806.833779:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511268992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876806.833804:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511268992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.833810:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1298 00000100:00100000:2.0:1788876806.833834:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511268608 00000100:00100000:2.0:1788876806.833838:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511268608 00000100:00100000:2.0:1788876806.833859:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1788876806.833864:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1875771511268608:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:2.0:1788876806.833900:0:49164:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 1794 last 0 00000020:00000080:2.0:1788876806.833936:0:49164:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313af524 00000100:00080000:2.0:1788876806.834072:0:49164:0:(import.c:65:import_set_state_nolock()) ffff8a13c5ffc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876806.834101:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511268608:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 236us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.834108:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:1.0:1788876806.834259:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876806.834264:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876806.839599:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511268736:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 8227us (8446us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876806.841876:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2556 00010000:00010000:3.0:1788876806.853969:0:49168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788876806.854101:0:49168:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 77309411328 lx: 0 gen 1 00000001:00080000:3.0:1788876806.854147:0:49168:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 73014444038 srv lr: 77309411328 lx: 0 gen 4 00000001:00000004:3.0:1788876806.854170:0:49168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 19, last_transno is 77309411328 00000001:00080000:3.0:1788876806.854265:0:49168:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788876806.854318:0:49168:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13eb223f00: xid 1875771511261952, transno 77309411329, client gen 4, slot idx 0 00000001:00080000:3.0:1788876806.854328:0:49168:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13eb223840: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:3.0:1788876806.854332:0:49168:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13eb223180: xid 1875771511250688, transno 73014444038, client gen 4, slot idx 2 00000001:00080000:3.0:1788876806.854337:0:49168:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13eb223cc0: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:3.0:1788876806.854791:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a13f5274d40) 00000020:00000080:3.0:1788876806.854809:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788876806.854878:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788876806.854885:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af540 00000020:00000080:3.0:1788876806.866655:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876806.883558:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313af547 00000020:00000080:3.0:1788876806.884127:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788876806.884143:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876806.884151:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.884154:0:49168:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788876806.884158:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788876806.884161:0:49168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788876806.884163:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788876806.884164:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788876806.884166:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788876806.884169:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.884170:0:49168:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788876806.884173:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876806.884179:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.884180:0:49168:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788876806.884185:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788876806.884237:0:49168:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788876806.884253:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876806.884256:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.884257:0:49168:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788876806.884260:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876806.884263:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.884264:0:49168:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788876806.884267:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788876806.884273:0:49168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1788876806.884304:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876806.884325:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a13f5270000) 00000020:00000080:3.0:1788876806.884347:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788876806.884352:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788876806.884423:0:49168:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788876806.884430:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788876806.884438:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af555 00010000:00080000:3.0:1788876806.884480:0:49168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13d060c000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1788876806.893015:0:49168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788876806.895039:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876806.895058:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788876806.895109:0:49168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788876806.895134:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af55c 00000100:00080000:3.0:1788876806.895149:0:49168:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788876806.895156:0:49168:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a13d060c000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876806.895204:0:49168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3658a80 x1875771532376576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876806.895275:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532376576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788876806.895373:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788876806.895459:0:49168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788876806.895470:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376576 00000100:00100000:0.0:1788876806.895486:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376576 00000100:00100000:0.0:1788876806.895540:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1788876806.895550:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532376576:12345-0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788876806.895562:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876806.895569:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.895571:0:49168:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788876806.895575:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788876806.895578:0:49168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788876806.895580:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788876806.895582:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00010000:00080000:0.0:1788876806.895584:0:6545:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1794 last 0 00000020:01000000:3.0:1788876806.895586:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788876806.895593:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.895597:0:49168:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788876806.895628:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788876806.895645:0:49168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788876806.895651:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876806.895653:0:49168:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788876806.895659:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788876806.895664:0:49168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:0.0:1788876806.895666:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af563 00000004:00100000:0.0:1788876806.895690:0:6545:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:3.0:1788876806.895695:0:49168:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788876806.895700:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876806.895718:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a13f4538000) 00000020:00000080:3.0:1788876806.895742:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788876806.895749:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:0.0:1788876806.895804:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a12c62db000 : changing import state from RECOVER to FULL 00000004:00080000:3.0:1788876806.895837:0:49168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788876806.895848:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788876806.895857:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af571 00010000:00080000:3.0:1788876806.895897:0:49168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13f3692800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1788876806.898139:0:49168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:3.0:1788876806.899522:0:49168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788876806.899558:0:49168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788876806.900059:0:49168:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 17, last_idx 18 00000040:00080000:1.0:1788876806.904161:0:49168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876806.904204:0:49168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].19, 64 off9408 00000100:00100000:0.0:1788876806.905359:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532376576:12345-0@lo:38:llog_process_th.0 Request processed in 9790us (9964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.905365:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788876806.905377:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00080000:2.0:1788876806.905384:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788876806.905397:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788876806.905406:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788876806.905411:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d060c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788876806.905439:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532376576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788876806.905939:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876806.905956:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532376704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876806.906046:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876806.906171:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376704 00000100:00100000:3.0:1788876806.906180:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376704 00000100:00100000:3.0:1788876806.906243:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1788876806.906254:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532376704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876806.906299:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876806.906351:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532376704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.906357:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1788876806.909042:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532376704:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788876806.912214:0:49168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].1, 64 off8256 00000040:00080000:2.0:1788876806.912825:0:49174:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 19 synced_idx: 0 lgh_last_idx: 19 00000040:00080000:2.0:1788876806.912831:0:49174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x48:0x0] at index 18 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788876806.913093:0:49174:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 18, last_idx 19 00000040:00080000:2.0:1788876806.913118:0:49174:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x48:0x0] at index 18 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1788876806.913284:0:49174:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 19 synced_idx: 19 lgh_last_idx: 19 00000040:00080000:2.0:1788876806.913288:0:49174:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788876806.934067:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876806.934090:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788876806.934154:0:49168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788876806.934183:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af578 00000100:00080000:0.0:1788876806.934197:0:49168:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788876806.934206:0:49168:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13f3692800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876806.934254:0:49168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa781880 x1875771532376832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876806.934284:0:49168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788876806.934356:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876806.934361:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.934363:0:49168:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788876806.934366:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788876806.934369:0:49168:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788876806.934371:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876806.934373:0:49168:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876806.934374:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788876806.934377:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.934378:0:49168:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788876806.934382:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788876806.934386:0:49168:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788876806.934390:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876806.934392:0:49168:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788876806.934395:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788876806.934400:0:49168:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1788876806.934440:0:49168:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788876806.934443:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876806.934461:0:49168:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c4e33380) 00000020:00000080:0.0:1788876806.934485:0:49168:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788876806.934490:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788876806.934569:0:49168:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788876806.934577:0:49168:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788876806.934584:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313af586 00000100:00100000:2.0:1788876806.935100:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532376832:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788876806.935198:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.935485:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376832 00000100:00100000:0.0:1788876806.935495:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376832 00000100:00100000:0.0:1788876806.935570:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1788876806.935580:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3661:x1875771532376832:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788876806.939292:0:43959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1794 last 0 00000020:00000080:0.0:1788876806.939356:0:43959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af58d 00002000:00100000:0.0:1788876806.939381:0:43959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ff37b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788876806.939386:0:43959:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788876806.939390:0:43959:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788876806.939510:0:43959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788876806.939548:0:43959:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876806.940955:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532376832:12345-0@lo:8:llog_process_th.0 Request processed in 5361us (5743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.940972:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1788876806.941206:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788876806.941224:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788876806.941241:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788876806.941254:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788876806.941259:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f3692800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788876806.941280:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788876806.941289:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532376832:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788876806.941341:0:49174:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788876806.942758:0:49174:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1794838152449ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788876806.942772:0:49174:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788876806.945902:0:49157:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788876806.946065:0:49168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ff37c800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:2.0:1788876806.946108:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532376960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876806.946207:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.946276:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532376960 00000100:00100000:1.0:1788876806.946287:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532376960 00000100:00100000:1.0:1788876806.946995:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1788876806.947008:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532376960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876806.947044:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876806.947117:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532376960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876806.947124:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1788876806.947598:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532376960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788876806.947948:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876806.948309:0:49168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788876806.948599:0:49168:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788876806.948642:0:49168:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788876806.949154:0:49168:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 17, last_idx 18 00000040:00080000:1.0:1788876806.950331:0:49168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876806.950367:0:49168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].19, 64 off9408 00000040:00080000:1.0:1788876806.950999:0:49168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4e:0x0].1, 64 off8256 00000040:00080000:2.0:1788876806.953335:0:49176:0:(llog.c:805:llog_process_thread()) index: 18, lh_last_idx: 19 synced_idx: 0 lgh_last_idx: 19 00000040:00080000:2.0:1788876806.953345:0:49176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4a:0x0] at index 18 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788876806.953589:0:49176:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 18, last_idx 19 00000040:00080000:2.0:1788876806.953668:0:49176:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4a:0x0] at index 18 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1788876806.955050:0:49176:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 19 synced_idx: 19 lgh_last_idx: 19 00000040:00080000:2.0:1788876806.955062:0:49176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788876806.957304:0:49168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876806.957324:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876806.957385:0:49168:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788876806.957420:0:49168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af594 00000100:00080000:2.0:1788876806.957435:0:49168:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876806.957445:0:49168:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13ff37c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876806.957499:0:49168:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb148000 x1875771532377088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876806.957544:0:49168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788876806.957640:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876806.957645:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876806.957647:0:49168:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788876806.957650:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876806.957654:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876806.957656:0:49168:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788876806.957658:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788876806.957660:0:49168:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788876806.957663:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876806.957665:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876806.957667:0:49168:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788876806.957669:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876806.957671:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876806.957672:0:49168:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788876806.957676:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788876806.957716:0:49168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49168:1875771532377216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876806.957955:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532377088:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788876806.958059:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.958167:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377088 00000100:00100000:0.0:1788876806.958175:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377088 00000100:00100000:0.0:1788876806.958215:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1788876806.958224:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3661:x1875771532377088:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788876806.958258:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1794 last 0 00000020:00000080:0.0:1788876806.958298:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313af59b 00002000:00100000:0.0:1788876806.958315:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ff37f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788876806.958320:0:8453:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788876806.958324:0:8453:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788876806.958419:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788876806.958451:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a13d0bc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876806.958512:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532377088:12345-0@lo:8:llog_process_th.0 Request processed in 286us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.958521:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1788876806.958579:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788876806.958590:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788876806.958598:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788876806.958637:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788876806.958639:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788876806.958652:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788876806.958658:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532377088:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788876806.958742:0:49176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788876806.958886:0:49176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1794854283064ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788876806.958894:0:49176:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788876806.961402:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532377344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876806.962646:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.962736:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377344 00000100:00100000:0.0:1788876806.962746:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377344 00000100:00100000:0.0:1788876806.965080:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1788876806.965099:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532377344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876806.965150:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788876806.965177:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876806.965257:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532377344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.965264:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1788876806.965523:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532377344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876806.967395:0:49168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876806.967473:0:49168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c6b60000 going to sleep for 11 seconds 00000100:00100000:3.0:1788876806.967483:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377216 00000100:00100000:3.0:1788876806.967510:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377216 00000100:00100000:3.0:1788876806.967577:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788876806.967588:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49168:x1875771532377216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876806.967993:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49168:x1875771532377216:12345-0@lo:502:llog_process_th.0 Request processed in 405us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.968003:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788876806.968219:0:49168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49168:1875771532377216:0@lo:502:llog_process_th.0 00000004:00080000:0.0:1788876806.968237:0:49157:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:1.0:1788876806.968272:0:49168:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876806.968283:0:49168:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876806.968286:0:49168:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788876806.968292:0:49168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788876806.968576:0:49156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788876806.968622:0:49156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788876806.968647:0:49156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.968661:0:49156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876806.968671:0:49156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a12c354d000 from 1 10000000:01000000:0.0:1788876806.968674:0:49156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876806.968712:0:49156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.968721:0:49156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.968732:0:49156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876806.968757:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788876806.968814:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.968840:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e1768900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876806.970037:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377472 00000100:00100000:2.0:1788876806.970051:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377472 00000100:00100000:2.0:1788876806.970118:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788876806.970129:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:49156:x1875771532377472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876806.970146:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876806.970167:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af5a2 expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.970202:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.970214:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876806.970225:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefee00, rc 0) 00000100:00100000:2.0:1788876806.970291:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532377472:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.970298:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788876806.970889:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876806.970932:0:49156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.970945:0:49156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876806.971861:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377600:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788876806.973349:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876806.973453:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e1768900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876806.977045:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377600 00000100:00100000:2.0:1788876806.977067:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377600 00000100:00100000:2.0:1788876806.977149:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788876806.977161:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532377600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788876806.977197:0:49161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788876806.977231:0:49161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788876806.977236:0:49161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788876806.977240:0:49161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788876806.977243:0:49161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 78 00000100:00100000:2.0:1788876806.977412:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532377600:12345-0@lo:256:mount.lustre.0 Request processed in 253us (4069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876806.977422:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788876806.978038:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377600:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788876806.979099:0:49156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788876806.979130:0:49156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876806.979145:0:49156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876806.982105:0:49156:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a12c354d000 from 1 10000000:01000000:1.0:1788876806.982119:0:49156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876806.982186:0:49156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.982204:0:49156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.982218:0:49156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876806.982249:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788876806.982342:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.984644:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788876806.988285:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377728 00000100:00100000:3.0:1788876806.988305:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377728 00000100:00100000:3.0:1788876806.988678:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788876806.988691:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:49156:x1875771532377728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876806.988717:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876806.988749:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eb1cae00/0xf5bf0f7e313af5b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af5b0 expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876806.988797:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eb1cae00/0xf5bf0f7e313af5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5b0 expref: 10 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876806.988811:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eb1cae00/0xf5bf0f7e313af5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5b0 expref: 10 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876806.988822:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb1cae00, rc 0) 00000100:00100000:3.0:1788876806.989094:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532377728:12345-0@lo:101:mount.lustre.0 Request processed in 405us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876806.989102:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788876806.989259:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876806.989283:0:49156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876806.989294:0:49156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876806.989402:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876806.989457:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.991179:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876806.994392:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377856 00000100:00100000:0.0:1788876806.994413:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377856 00000100:00100000:0.0:1788876806.994588:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788876806.994613:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532377856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876806.995691:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532377856:12345-0@lo:501:mount.lustre.0 Request processed in 1087us (6242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.995705:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788876806.996296:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876806.996383:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876806.996907:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876806.997062:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788876806.997416:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532377984 00000100:00100000:0.0:1788876806.997424:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532377984 00000100:00100000:0.0:1788876806.997491:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788876806.997501:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efe1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532377984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876806.998211:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efe1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532377984:12345-0@lo:503:mount.lustre.0 Request processed in 708us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876806.998221:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788876806.998333:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532377984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876807.001796:0:49178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49178:1875771532378112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876807.001937:0:49178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876807.001994:0:49178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876807.003427:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378112 00000100:00100000:0.0:1788876807.003455:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378112 00000100:00100000:0.0:1788876807.003538:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788876807.003552:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efe1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49178:x1875771532378112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876807.004559:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efe1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49178:x1875771532378112:12345-0@lo:502:llog_process_th.0 Request processed in 1003us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876807.004572:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788876807.009086:0:49178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49178:1875771532378112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876807.009195:0:49178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876807.009214:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876807.009217:0:49178:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788876807.009225:0:49178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a12c354d000 00000020:00000080:1.0:1788876807.009229:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788876807.009239:0:49178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876807.009242:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876807.009244:0:49178:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788876807.009247:0:49178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876807.009249:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876807.009251:0:49178:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788876807.009254:0:49178:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a12c354d000 00000020:00000080:1.0:1788876807.009256:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788876807.009375:0:49178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49178:1875771532378240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876807.011706:0:49178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876807.012003:0:49178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876807.018053:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378240 00000100:00100000:2.0:1788876807.018073:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378240 00000100:00100000:2.0:1788876807.018149:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788876807.018160:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49178:x1875771532378240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876807.018386:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49178:x1875771532378240:12345-0@lo:502:llog_process_th.0 Request processed in 227us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.018394:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788876807.019416:0:49178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49178:1875771532378240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876807.020640:0:49178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876807.020656:0:49178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876807.020660:0:49178:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788876807.020665:0:49178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788876807.021218:0:49156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1788876807.021254:0:49156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788876807.021280:0:49156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.021295:0:49156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876807.021367:0:49156:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788876807.021371:0:49156:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a12c354d000 10000000:01000000:0.0:1788876807.021375:0:49156:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a12c354d000 10000000:01000000:0.0:1788876807.021380:0:49156:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788876807.021388:0:49156:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a12c354d000 from 1 10000000:01000000:0.0:1788876807.021391:0:49156:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788876807.021438:0:49156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.023613:0:49156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.023633:0:49156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876807.023672:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788876807.023773:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.023825:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876807.024038:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378368 00000100:00100000:2.0:1788876807.024052:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378368 00000100:00100000:2.0:1788876807.024128:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876807.024140:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:49156:x1875771532378368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876807.024159:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876807.024183:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313af5c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af5be expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876807.024218:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313af5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5be expref: 11 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876807.024240:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313af5c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5be expref: 11 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876807.024252:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefea00, rc 0) 00000100:00100000:2.0:1788876807.024314:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532378368:12345-0@lo:101:mount.lustre.0 Request processed in 175us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.024322:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788876807.025731:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876807.025786:0:49156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.025804:0:49156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876807.026226:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876807.026318:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.026381:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876807.026563:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378496 00000100:00100000:2.0:1788876807.026573:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378496 00000100:00100000:2.0:1788876807.026670:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788876807.026681:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532378496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876807.027080:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532378496:12345-0@lo:501:mount.lustre.0 Request processed in 399us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.027089:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788876807.027592:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876807.027673:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876807.028092:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.028150:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876807.028898:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378624 00000100:00100000:2.0:1788876807.028919:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378624 00000100:00100000:2.0:1788876807.029000:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788876807.029011:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c4847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532378624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876807.029179:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c4847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532378624:12345-0@lo:503:mount.lustre.0 Request processed in 170us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.029188:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788876807.032012:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532378624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876807.034175:0:49180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532378752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876807.034283:0:49180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876807.034341:0:49180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d34bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876807.034474:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378752 00000100:00100000:0.0:1788876807.034483:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378752 00000100:00100000:0.0:1788876807.034533:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788876807.034543:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532378752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876807.034728:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c7940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532378752:12345-0@lo:502:llog_process_th.0 Request processed in 185us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876807.034737:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788876807.034950:0:49180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532378752:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788876807.035036:0:49180:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788876807.035057:0:49180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c3f64d40) 00000020:00000080:3.0:1788876807.035088:0:49180:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788876807.035277:0:49180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a12c354d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788876807.035282:0:49180:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c354d000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788876807.035305:0:49180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c354d000 4 00010000:00080000:3.0:1788876807.035367:0:49180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c36e5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1788876807.037449:0:49180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788876807.043519:0:49180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788876807.043617:0:49180:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788876807.043645:0:49180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313af5d3 00000100:00080000:3.0:1788876807.043667:0:49180:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788876807.043677:0:49180:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a12c36e5800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876807.043741:0:49180:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3659180 x1875771532378880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876807.043784:0:49180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788876807.043842:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532378880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876807.043964:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876807.044661:0:49180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532379008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876807.044761:0:49180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876807.044819:0:49180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d34bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876807.044828:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379008 00000100:00100000:1.0:1788876807.044843:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379008 00000100:00100000:0.0:1788876807.044939:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532378880 00000100:00100000:0.0:1788876807.044948:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532378880 00000100:00100000:0.0:1788876807.044997:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1788876807.045010:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532378880:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876807.045051:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788876807.045070:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c7943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532379008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876807.045100:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532378880:12345-0@lo:38:llog_process_th.0 Request processed in 89us (1134us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876807.045110:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1788876807.045260:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c7943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532379008:12345-0@lo:502:llog_process_th.0 Request processed in 197us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876807.045271:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788876807.045526:0:49180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532379008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876807.045595:0:49180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532379136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876807.045674:0:49180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876807.045705:0:49180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13cfd01300 going to sleep for 11 seconds 00000100:00100000:0.0:1788876807.045721:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379136 00000100:00100000:0.0:1788876807.045729:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379136 00000100:00100000:0.0:1788876807.045786:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788876807.045797:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c7940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532379136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876807.045906:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788876807.045914:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876807.045919:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788876807.045931:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532378880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876807.046111:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c7940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49180:x1875771532379136:12345-0@lo:502:llog_process_th.0 Request processed in 314us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876807.046121:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788876807.046137:0:49180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49180:1875771532379136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788876807.046170:0:49180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788876807.046412:0:49156:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788876807.046439:0:49156:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788876807.046492:0:49156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.046505:0:49156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788876807.046559:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788876807.046562:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788876807.046563:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876807.046564:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876807.046566:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876807.046567:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876807.046569:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876807.046570:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788876807.046572:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876807.046573:0:49156:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788876807.046577:0:49156:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788876807.046580:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788876807.046581:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788876807.046583:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876807.046585:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876807.046587:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876807.046588:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876807.046590:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876807.046591:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788876807.046592:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876807.046594:0:49156:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788876807.046647:0:49156:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788876807.046658:0:49156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532379264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788876807.046707:0:49156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876807.046739:0:49156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4853240 going to sleep for 11 seconds 00000100:00100000:3.0:1788876807.046973:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379264 00000100:00100000:3.0:1788876807.046980:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379264 00000100:00100000:3.0:1788876807.047103:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788876807.047113:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532379264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788876807.047138:0:49166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788876807.047153:0:49166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788876807.057199:0:49166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788876807.057225:0:49166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788876807.066626:0:49165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788876807.068903:0:49165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788876807.068963:0:49165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.068990:0:49165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 11 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.069000:0:49165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.069071:0:49165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 11 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876807.069093:0:49165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 11 pid: 49163 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876807.069112:0:49165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:49165:1875771532379392:0@lo:104: 00000100:00100000:0.0:1788876807.069211:0:49165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.069291:0:49165:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876807.082249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379392 00000100:00100000:1.0:1788876807.082270:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379392 00000100:00100000:1.0:1788876807.082355:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788876807.082368:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:49165:x1875771532379392:12345-0@lo:104: 00010000:00010000:1.0:1788876807.082388:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082490:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788876807.082497:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:49165:x1875771532379392:12345-0@lo:104: Request processed in 132us (13286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876807.082504:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:1.0:1788876807.082525:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876807.082532:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082539:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876807.082544:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082552:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876807.082565:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876807.082571:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788876807.082627:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082635:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876807.082655:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082663:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a1400587000/0xf5bf0f7e313af5a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313af5a9 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.082684:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876807.082686:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876807.082687:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876807.083701:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532379520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876807.083912:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876807.083994:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379520 00000100:00100000:1.0:1788876807.084000:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379520 00010000:00010000:1.0:1788876807.085121:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 12 pid: 49163 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876807.085158:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788876807.085171:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:3663:x1875771532379520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876807.085185:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876807.085190:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 12 pid: 49163 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085203:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 12 pid: 49163 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085224:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085234:0:9553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876807.085250:0:9553:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016351387s 00010000:00010000:1.0:1788876807.085255:0:9553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085262:0:9553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085269:0:9553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085275:0:9553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085281:0:9553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876807.085286:0:9553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085294:0:9553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085303:0:9553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.085313:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876807.086768:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:3663:x1875771532379520:12345-0@lo:103:ldlm_bl.0 Request processed in 1595us (2848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876807.086782:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788876807.086857:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532379520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876807.094022:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:49156:x1875771532379264:12345-0@lo:253:mount.lustre.0 Request processed in 46898us (47300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.094044:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788876807.094680:0:49156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:49156:1875771532379264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788876807.094699:0:49156:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788876807.094703:0:49156:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788876807.094705:0:49156:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788876807.094706:0:49156:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876807.094707:0:49156:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876807.094709:0:49156:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876807.094710:0:49156:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876807.094712:0:49156:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876807.094713:0:49156:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788876807.094715:0:49156:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876807.094717:0:49156:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788876807.094737:0:49156:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788876807.095871:0:49165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313af5a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313af5a2 expref: 10 pid: 49163 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876807.095898:0:49165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:49165:1875771532379392:0@lo:104: 00010000:00010000:1.0:1788876807.095917:0:49165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.095935:0:49165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.095941:0:49165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876807.095948:0:49165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400587600/0xf5bf0f7e313af5da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 49165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788876807.125599:0:49156:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:2.0:1788876807.140190:0:49156:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788876807.140444:0:49186:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:1.0:1788876807.140449:0:49186:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:2.0:1788876807.152198:0:49187:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788876807.152280:0:49156:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788876807.153105:0:49188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788876807.153214:0:49188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876807.153271:0:49188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876807.153571:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379648 00000100:00100000:0.0:1788876807.153584:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379648 00000100:00100000:0.0:1788876807.153689:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1788876807.153702:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.153852:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 152us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876807.153861:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1788876807.153969:0:49188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379648:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788876807.154020:0:49188:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788876807.154035:0:49156:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788876807.154087:0:49156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788876807.154191:0:49188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.154236:0:49188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.154272:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379776 00000100:00100000:0.0:1788876807.154276:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379776 00000100:00100000:0.0:1788876807.154299:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1788876807.154306:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.154407:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876807.154414:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1788876807.154434:0:49188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eeff4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876807.154449:0:49188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379776:0@lo:1000:lod0000_rec0001.0 00000004:00000080:3.0:1788876807.154591:0:49156:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788876807.154630:0:49156:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788876807.154676:0:49156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788876807.155767:0:49156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788876807.156339:0:49156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788876807.156377:0:49156:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788876807.156504:0:49156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788876807.157894:0:49188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.157991:0:49188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.158039:0:49188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c72966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876807.158070:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532379904 00000100:00100000:1.0:1788876807.158088:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532379904 00000100:00100000:1.0:1788876807.158178:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1788876807.158196:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788876807.158355:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532379904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 164us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876807.158364:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1788876807.158675:0:49188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532379904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.158777:0:49188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532380032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876807.159132:0:49188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876807.159160:0:49188:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876807.159556:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380032 00000100:00100000:1.0:1788876807.159570:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380032 00000100:00100000:1.0:1788876807.159685:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1788876807.159698:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532380032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788876807.160074:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:49188:x1875771532380032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 378us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876807.160083:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1788876807.161689:0:49188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:49188:1875771532380032:0@lo:1000:lod0000_rec0001.0 00080000:10000000:3.0:1788876807.168267:0:49156:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x46:0x0] (8/32) registered 00000040:00080000:0.0:1788876807.174022:0:49188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788876807.174387:0:49188:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00010000:00080000:1.0:1788876807.175967:0:49156:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 77309411329 00010000:00080000:1.0:1788876807.177117:0:49189:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 49189 00010000:02000000:1.0:1788876807.177175:0:49189:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1788876807.177180:0:49189:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788876807.177185:0:49189:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000040:00080000:2.0:1788876807.177806:0:49187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000020:01000004:3.0:1788876807.178092:0:49156:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788876807.178119:0:49156:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788876807.178145:0:49156:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788876807.178171:0:49156:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000004:00080000:2.0:1788876807.178450:0:49187:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788876807.178457:0:49187:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1788876807.178736:0:49189:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:3.0:1788876807.179737:0:49156:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788876807.180282:0:49156:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788876807.240416:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876807.917486:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876807.917557:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269248 00000100:00100000:3.0:1788876807.917569:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269248 00000100:00100000:3.0:1788876807.917675:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1788876807.917687:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511269248:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876807.917706:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876807.917729:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eb1ca800/0xf5bf0f7e313af5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048919 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.917769:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eb1ca800/0xf5bf0f7e313af5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048919 expref: 6 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.917782:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eb1ca800/0xf5bf0f7e313af5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048919 expref: 6 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.917791:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb1ca800, rc 0) 00000100:00100000:3.0:1788876807.917855:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511269248:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876807.917861:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1788876807.928462:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876807.928537:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269376 00000100:00100000:2.0:1788876807.928552:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269376 00000100:00100000:2.0:1788876807.928651:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1788876807.928662:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511269376:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788876807.928689:0:49163:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788876807.928709:0:49163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788876807.928713:0:49163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788876807.928717:0:49163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788876807.928721:0:49163:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788876807.928723:0:49163:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 79 00000100:00100000:2.0:1788876807.930721:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511269376:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 2048us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.930736:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1788876807.945521:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876807.945568:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876807.945682:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269504 00000100:00100000:2.0:1788876807.945693:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269504 00000100:00100000:2.0:1788876807.945739:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2558 00000100:00100000:2.0:1788876807.945748:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511269504:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1788876807.945779:0:6540:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13c5f9d800, cookie 0xf5bf0f7e313af532 00010000:00080000:2.0:1788876807.945785:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t77309411330 exp ffff8a13c5f9d800 cur 1795 last 1788876806 00010000:02000400:2.0:1788876807.945796:0:6540:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788876807.945803:0:6540:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788876807.945839:0:6540:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788876807.945997:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13ff356000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876807.946068:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511269504:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 Request processed in 319us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876807.946076:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2558 00000100:00100000:3.0:1788876807.949126:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269632 00000100:00100000:3.0:1788876807.949138:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269632 00000100:00100000:3.0:1788876807.949258:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1788876807.949269:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511269632:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876807.949284:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876807.949301:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eb1caa00/0xf5bf0f7e313af5e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048920 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.949338:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eb1caa00/0xf5bf0f7e313af5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048920 expref: 7 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.949350:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eb1caa00/0xf5bf0f7e313af5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048920 expref: 7 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876807.949360:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eb1caa00, rc 0) 00000100:00100000:3.0:1788876807.949417:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511269632:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 150us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876807.949423:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1788876807.949497:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876807.949619:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511262848 00000100:00100000:3.0:1788876807.949624:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511262848 00000100:00100000:3.0:1788876807.949660:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2559 00000100:00100000:3.0:1788876807.949667:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511262848:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:3.0:1788876807.949683:0:8722:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 77309411330, current: 77309411330, replaying 00000100:00100000:3.0:1788876807.949693:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511262848:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 28us (197us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876807.949699:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2559 00010000:00080000:2.0:1788876807.951161:0:49189:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788876807.952378:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876807.952410:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269760 00000100:00100000:3.0:1788876807.952418:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269760 00000100:00100000:3.0:1788876807.952458:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:3.0:1788876807.952467:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511269760:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876807.952622:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511269760:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 136us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876807.952630:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1788876807.963262:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876807.963348:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511269888 00000100:00100000:3.0:1788876807.963358:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511269888 00000100:00100000:3.0:1788876807.963418:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:3.0:1788876807.963428:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511269888:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876807.963560:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511269888:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876807.963568:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1788876808.003293:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876808.003427:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270016 00000100:00100000:1.0:1788876808.003437:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270016 00000100:00100000:1.0:1788876808.003494:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1788876808.003504:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511270016:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.003521:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.003539:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313af5ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048927 expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.003569:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313af5ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048927 expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.003581:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313af5ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048927 expref: 9 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.003590:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34e00, rc 0) 00000100:00100000:1.0:1788876808.003680:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270016:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 177us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.003688:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1788876808.014126:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876808.014274:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270144 00000100:00100000:2.0:1788876808.014283:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270144 00000100:00100000:2.0:1788876808.014353:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1788876808.014364:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270144:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.014515:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270144:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 153us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.014524:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1788876808.021666:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876808.022109:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270272 00000100:00100000:3.0:1788876808.022120:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270272 00000100:00100000:3.0:1788876808.022181:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1788876808.022192:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270272:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.022574:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270272:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 382us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876808.022582:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1788876808.043998:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876808.044046:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270400 00000100:00100000:0.0:1788876808.044059:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270400 00000100:00100000:0.0:1788876808.044125:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1788876808.044137:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511270400:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.044160:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.044186:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400587c00/0xf5bf0f7e313af5f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704892e expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.044223:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400587c00/0xf5bf0f7e313af5f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704892e expref: 10 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.044236:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400587c00/0xf5bf0f7e313af5f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704892e expref: 10 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.044246:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400587c00, rc 0) 00000100:00100000:0.0:1788876808.046229:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511270400:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 2081us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.046242:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1788876808.059954:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876808.060372:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270528 00000100:00100000:2.0:1788876808.060385:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270528 00000100:00100000:2.0:1788876808.060461:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1788876808.060473:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511270528:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.060648:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511270528:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 176us (710us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876808.060658:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00010000:00010000:2.0:1788876808.308251:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788876808.680837:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788876808.680848:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a12c354d000 from 79 10000000:01000000:3.0:1788876808.680856:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788876808.680934:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.680951:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.680969:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.681006:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.681117:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.681180:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.681245:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380160 00000100:00100000:0.0:1788876808.681255:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380160 00000100:00100000:0.0:1788876808.681322:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788876808.681333:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532380160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.681349:0:49166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.681367:0:49166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400586200/0xf5bf0f7e313af604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af5fd expref: -99 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.681396:0:49166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400586200/0xf5bf0f7e313af604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5fd expref: 11 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.681409:0:49166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400586200/0xf5bf0f7e313af604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af5fd expref: 11 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.681421:0:49166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586200, rc 0) 00000100:00100000:0.0:1788876808.681465:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532380160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.681473:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788876808.681564:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876808.681582:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.681592:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.681890:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.681940:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.681970:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.682031:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380288 00000100:00100000:0.0:1788876808.682037:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380288 00000100:00100000:0.0:1788876808.682072:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788876808.682079:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532380288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788876808.682097:0:49161:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788876808.682117:0:49161:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788876808.682120:0:49161:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 79 00000100:00100000:0.0:1788876808.682207:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532380288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.682214:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788876808.682248:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788876808.682302:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788876808.682311:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682320:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876808.682333:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788876808.682336:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:0.0:1788876808.682339:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788876808.682363:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682370:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682383:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876808.682396:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.682425:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.682439:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.682451:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380416 00000100:00100000:0.0:1788876808.682454:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380416 00000100:00100000:0.0:1788876808.682477:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788876808.682482:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532380416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.682490:0:49166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.682501:0:49166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400587800/0xf5bf0f7e313af612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af60b expref: -99 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682517:0:49166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400587800/0xf5bf0f7e313af612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af60b expref: 12 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682526:0:49166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400587800/0xf5bf0f7e313af612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af60b expref: 12 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.682534:0:49166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400587800, rc 0) 00000100:00100000:0.0:1788876808.682561:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.682567:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788876808.682597:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.683327:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.683338:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876808.683409:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.683445:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.683477:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.684017:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380544 00000100:00100000:2.0:1788876808.684024:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380544 00000100:00100000:2.0:1788876808.684067:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788876808.684076:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.684249:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.684257:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788876808.684334:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.684374:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.684427:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.684458:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.684500:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380672 00000100:00100000:2.0:1788876808.684504:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380672 00000100:00100000:2.0:1788876808.684536:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876808.684544:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.684678:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.684685:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876808.684726:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876808.686822:0:49258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788876808.687353:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788876808.687384:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788876808.687399:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.687420:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876808.687432:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788876808.687436:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1788876808.687440:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788876808.687490:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.687498:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.687511:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.687538:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.687820:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.687867:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.687939:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380800 00000100:00100000:0.0:1788876808.687949:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380800 00000100:00100000:0.0:1788876808.688013:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788876808.688025:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532380800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.688038:0:49161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.688056:0:49161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400586c00/0xf5bf0f7e313af620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af619 expref: -99 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.688083:0:49161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400586c00/0xf5bf0f7e313af620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af619 expref: 13 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.688095:0:49161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400586c00/0xf5bf0f7e313af620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af619 expref: 13 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.688105:0:49161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586c00, rc 0) 00000100:00100000:0.0:1788876808.688163:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532380800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.688171:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788876808.688251:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.688269:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.688280:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.688345:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.688374:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.688402:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860000 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.688443:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532380928 00000100:00100000:0.0:1788876808.688448:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532380928 00000100:00100000:0.0:1788876808.688482:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788876808.688491:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efc79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532380928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.688976:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efc79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532380928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.688985:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788876808.689150:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532380928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.689205:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.689267:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.689327:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860000 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.689360:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381056 00000100:00100000:0.0:1788876808.689365:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381056 00000100:00100000:0.0:1788876808.689426:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788876808.689435:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532381056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.693266:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532381056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3816us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.693285:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788876808.702512:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788876808.705085:0:49260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1788876808.705503:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1788876808.705535:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788876808.705550:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.705563:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.705574:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788876808.705578:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:1.0:1788876808.705581:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876808.705676:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.705688:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.705702:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.705735:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.705961:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.706020:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.706088:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381184 00000100:00100000:2.0:1788876808.706099:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381184 00000100:00100000:2.0:1788876808.706162:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788876808.706174:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532381184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.706192:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876808.706209:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313af62e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af627 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.706237:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313af62e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af627 expref: 14 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.706248:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313af62e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af627 expref: 14 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.706257:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff400, rc 0) 00000100:00100000:2.0:1788876808.706302:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.706310:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788876808.706403:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.706439:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.706450:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.706520:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.706548:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.706573:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860000 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.706641:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381312 00000100:00100000:2.0:1788876808.706646:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381312 00000100:00100000:2.0:1788876808.706675:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788876808.706682:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.706941:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.706948:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788876808.707025:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.707058:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.707113:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.707135:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860000 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.707150:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381440 00000100:00100000:1.0:1788876808.707154:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381440 00000100:00100000:1.0:1788876808.707186:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788876808.707194:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.707302:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.707309:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788876808.707348:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876808.710329:0:49261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788876808.710798:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788876808.710829:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876808.710843:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.710857:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876808.710868:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876808.710872:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:2.0:1788876808.710875:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876808.710940:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.710949:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.710963:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876808.710994:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.711091:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.711152:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.711319:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381568 00000100:00100000:0.0:1788876808.711332:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381568 00000100:00100000:0.0:1788876808.711408:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788876808.711419:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532381568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.711436:0:49166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.711453:0:49166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400586800/0xf5bf0f7e313af63c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af635 expref: -99 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.711480:0:49166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400586800/0xf5bf0f7e313af63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af635 expref: 15 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.711493:0:49166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400586800/0xf5bf0f7e313af63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af635 expref: 15 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.711503:0:49166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586800, rc 0) 00000100:00100000:0.0:1788876808.711557:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.711565:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788876808.711725:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.711743:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.711813:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876808.711899:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.711941:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.711967:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.711985:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381696 00000100:00100000:0.0:1788876808.711989:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381696 00000100:00100000:0.0:1788876808.712013:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788876808.712020:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.712200:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.712209:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788876808.712244:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.712274:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.712339:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.712355:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.712366:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381824 00000100:00100000:0.0:1788876808.712369:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381824 00000100:00100000:0.0:1788876808.712385:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788876808.712390:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.712485:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.712493:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788876808.712532:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876808.720354:0:49262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788876808.720728:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788876808.720767:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876808.720783:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.720798:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876808.720810:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788876808.720813:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1788876808.720817:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788876808.720871:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.720881:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.720894:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876808.720935:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.721027:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.721077:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.723900:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532381952 00000100:00100000:1.0:1788876808.723933:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532381952 00000100:00100000:1.0:1788876808.724051:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788876808.724068:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532381952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.724093:0:49161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.724123:0:49161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313af64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af643 expref: -99 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.724164:0:49161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313af64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af643 expref: 16 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.724178:0:49161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313af64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af643 expref: 16 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.724189:0:49161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34400, rc 0) 00000100:00100000:1.0:1788876808.724297:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532381952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.724306:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788876808.724499:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532381952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.724526:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.724538:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876808.724678:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.724720:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.724879:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.725852:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382080 00000100:00100000:2.0:1788876808.725864:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382080 00000100:00100000:2.0:1788876808.725932:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788876808.725942:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532382080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.726163:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532382080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.726171:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788876808.726442:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.726498:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.726552:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876808.726589:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.726725:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382208 00000100:00100000:1.0:1788876808.726730:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382208 00000100:00100000:1.0:1788876808.726777:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788876808.726785:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532382208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.728369:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532382208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1578us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.728383:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788876808.729922:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876808.731865:0:49263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788876808.732900:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788876808.732943:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788876808.732959:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.732975:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.732987:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788876808.732989:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:1.0:1788876808.732993:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876808.733044:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.733054:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.733066:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.733096:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.733182:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.733241:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860540 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.733722:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382336 00000100:00100000:2.0:1788876808.733732:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382336 00000100:00100000:2.0:1788876808.738174:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788876808.738201:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532382336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.738227:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876808.738255:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313af658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af651 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.738292:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313af658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af651 expref: 17 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.738305:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313af658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af651 expref: 17 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.738316:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe400, rc 0) 00000100:00100000:2.0:1788876808.738425:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.738438:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788876808.738514:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.738553:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.738565:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876808.738683:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.738719:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.738767:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.738783:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382464 00000100:00100000:2.0:1788876808.738789:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382464 00000100:00100000:2.0:1788876808.738815:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876808.738822:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.738951:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.738958:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876808.738987:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.739020:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.739073:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.739087:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.739098:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382592 00000100:00100000:2.0:1788876808.739101:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382592 00000100:00100000:2.0:1788876808.739122:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876808.739129:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.739219:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.739225:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876808.739267:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876808.742445:0:49264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788876808.742935:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788876808.742970:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876808.742985:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.742999:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876808.743011:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876808.743014:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:2.0:1788876808.743018:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876808.743070:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.743079:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.743093:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876808.743126:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.743213:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.743261:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.743743:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382720 00000100:00100000:1.0:1788876808.743824:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382720 00000100:00100000:1.0:1788876808.743892:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788876808.743904:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532382720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.743931:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.743951:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34a00/0xf5bf0f7e313af666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af65f expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.743984:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34a00/0xf5bf0f7e313af666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af65f expref: 18 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.743996:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34a00/0xf5bf0f7e313af666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af65f expref: 18 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.744006:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34a00, rc 0) 00000100:00100000:1.0:1788876808.744071:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efd00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532382720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.744079:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788876808.744197:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.744215:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.744225:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876808.744303:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.744335:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.744359:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.745927:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382848 00000100:00100000:1.0:1788876808.745945:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382848 00000100:00100000:1.0:1788876808.746033:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788876808.746045:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532382848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.746296:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532382848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.746305:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788876808.746983:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.747056:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.747133:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.747174:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.750047:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532382976 00000100:00100000:1.0:1788876808.750068:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532382976 00000100:00100000:1.0:1788876808.750136:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788876808.750147:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532382976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.750363:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532382976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.750371:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788876808.750983:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532382976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788876808.752509:0:49265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788876808.753982:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788876808.754045:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788876808.754061:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.754077:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876808.754089:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788876808.754093:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 76 10000000:01000000:2.0:1788876808.754096:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788876808.754151:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.754161:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.754175:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876808.754208:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.754305:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.754364:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.754895:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383104 00000100:00100000:1.0:1788876808.754905:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383104 00000100:00100000:1.0:1788876808.754990:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788876808.755001:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532383104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.755017:0:49161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.755036:0:49161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae35200/0xf5bf0f7e313af674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af66d expref: -99 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.755073:0:49161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae35200/0xf5bf0f7e313af674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af66d expref: 19 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.755087:0:49161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae35200/0xf5bf0f7e313af674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af66d expref: 19 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.755099:0:49161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35200, rc 0) 00000100:00100000:1.0:1788876808.755167:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532383104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.755174:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788876808.755233:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.755254:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.755265:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.755361:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.755399:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.755418:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d06dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.755431:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383232 00000100:00100000:1.0:1788876808.755435:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383232 00000100:00100000:1.0:1788876808.755463:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788876808.755469:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532383232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788876808.755485:0:49164:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788876808.755506:0:49164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788876808.755510:0:49164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788876808.755514:0:49164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788876808.755517:0:49164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788876808.755520:0:49164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 79 00000100:00100000:1.0:1788876808.756547:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532383232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1072us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.756558:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788876808.756735:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788876808.756961:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876808.756974:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.756985:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.756995:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788876808.756998:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788876808.757003:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788876808.757037:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.757046:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.757056:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.757079:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.757126:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.757211:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d06dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876808.765550:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383360 00000100:00100000:3.0:1788876808.765570:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383360 00000100:00100000:1.0:1788876808.765890:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788876808.765905:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532383360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.765942:0:49161:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.765970:0:49161:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313af682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af67b expref: -99 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.766009:0:49161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313af682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af67b expref: 20 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.766024:0:49161:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313af682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af67b expref: 20 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.766035:0:49161:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34800, rc 0) 00000100:00100000:1.0:1788876808.766142:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (9015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.766149:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788876808.766227:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.766250:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.766263:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.766366:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.766404:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.766441:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d06dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.766453:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383488 00000100:00100000:1.0:1788876808.766457:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383488 00000100:00100000:1.0:1788876808.766482:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788876808.766488:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.766871:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.766880:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788876808.766958:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.766998:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.767057:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876808.767081:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.767123:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383616 00000100:00100000:1.0:1788876808.767128:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383616 00000100:00100000:1.0:1788876808.767157:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788876808.767163:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ca2e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.767988:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ca2e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 822us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.767997:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788876808.768074:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876808.772554:0:49267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788876808.773043:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788876808.773079:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788876808.773092:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.773108:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.773119:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788876808.773122:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:1.0:1788876808.773126:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788876808.773183:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.773192:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.773206:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.773240:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.773342:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.773405:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d06dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.773738:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383744 00000100:00100000:2.0:1788876808.773747:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383744 00000100:00100000:2.0:1788876808.773873:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788876808.773883:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532383744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.773900:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876808.773928:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeff600/0xf5bf0f7e313af690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af689 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.773962:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeff600/0xf5bf0f7e313af690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af689 expref: 21 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.773982:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeff600/0xf5bf0f7e313af690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af689 expref: 21 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.773992:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff600, rc 0) 00000100:00100000:2.0:1788876808.774054:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532383744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.774061:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788876808.774174:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876808.774197:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.774207:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876808.774229:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876808.774234:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.774241:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876808.774248:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788876808.774251:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788876808.774253:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788876808.774277:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.774285:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.774293:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.774309:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.774340:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.774365:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876808.774746:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532383872 00000100:00100000:1.0:1788876808.774763:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532383872 00000100:00100000:1.0:1788876808.774806:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788876808.774814:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532383872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.774826:0:49163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876808.774841:0:49163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae35800/0xf5bf0f7e313af69e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af697 expref: -99 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.774861:0:49163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae35800/0xf5bf0f7e313af69e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af697 expref: 22 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.774877:0:49163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae35800/0xf5bf0f7e313af69e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af697 expref: 22 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.774886:0:49163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35800, rc 0) 00000100:00100000:1.0:1788876808.774948:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532383872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876808.774956:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788876808.774998:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532383872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.775011:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.775021:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.775038:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788876808.775043:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.775050:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876808.775057:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788876808.775059:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:1.0:1788876808.775062:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876808.775080:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.775088:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.775095:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.775111:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.775141:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.775157:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.775290:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384000 00000100:00100000:2.0:1788876808.775294:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384000 00000100:00100000:2.0:1788876808.775327:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788876808.775334:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532384000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876808.775341:0:49166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876808.775350:0:49166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313af6ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af6a5 expref: -99 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.775365:0:49166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313af6ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af6a5 expref: 23 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.775373:0:49166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313af6ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af6a5 expref: 23 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876808.775380:0:49166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe200, rc 0) 00000100:00100000:2.0:1788876808.775411:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.775417:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788876808.776012:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876808.776048:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.776057:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876808.776131:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.776170:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.776198:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876808.776240:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384128 00000100:00100000:2.0:1788876808.776245:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384128 00000100:00100000:2.0:1788876808.776311:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788876808.776320:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876808.776451:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876808.776459:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788876808.778538:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.778663:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876808.778777:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876808.779160:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4860180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876808.779410:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384256 00000100:00100000:3.0:1788876808.779419:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384256 00000100:00100000:3.0:1788876808.779488:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788876808.779499:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fb8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.779738:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fb8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876808.779746:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788876808.779936:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876808.783130:0:49268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788876808.783431:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788876808.783464:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876808.783479:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.783494:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876808.783507:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788876808.783510:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788876808.783514:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788876808.783574:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.783584:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.783821:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.783860:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.783982:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.784044:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.790834:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384384 00000100:00100000:0.0:1788876808.790857:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384384 00000100:00100000:0.0:1788876808.790952:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788876808.790964:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fb8df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532384384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876808.790987:0:49164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876808.791010:0:49164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1400586400/0xf5bf0f7e313af6ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313af6b3 expref: -99 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.791045:0:49164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1400586400/0xf5bf0f7e313af6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313af6b3 expref: 24 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.791064:0:49164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1400586400/0xf5bf0f7e313af6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313af6b3 expref: 24 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876808.791075:0:49164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586400, rc 0) 00000100:00100000:0.0:1788876808.791184:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fb8df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532384384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (7202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876808.791192:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788876808.796154:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876808.796194:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876808.796209:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876808.796317:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876808.796405:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876808.796473:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c2dd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876808.797268:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384512 00000100:00100000:0.0:1788876808.797278:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384512 00000100:00100000:0.0:1788876808.797335:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788876808.797345:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532384512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876808.798765:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532384512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1403us (2343us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876808.798781:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788876808.799346:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532384512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788876808.799421:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788876808.799438:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876808.799452:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876809.322025:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876809.706437:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532384640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876809.706542:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876809.709670:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384640 00000100:00100000:3.0:1788876809.709693:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384640 00000100:00100000:3.0:1788876809.709781:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788876809.709797:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532384640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876809.709841:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491903168 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876809.709959:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532384640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876809.709967:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788876809.710043:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532384640:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876809.716976:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876810.347963:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876810.738396:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876810.738421:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532384768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876810.738530:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876810.738629:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384768 00000100:00100000:0.0:1788876810.738642:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384768 00000100:00100000:0.0:1788876810.738717:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1788876810.738729:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532384768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876810.738769:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876810.740781:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532384768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2043us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876810.740796:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00080000:0.0:1788876810.741407:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876810.741546:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4677480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532384768:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876811.370402:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876811.949857:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876811.950018:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270656 00000100:00100000:3.0:1788876811.950031:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270656 00000100:00100000:3.0:1788876811.950099:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1788876811.950111:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511270656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876811.950221:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511270656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876811.950230:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1788876811.950760:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876811.950911:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270912 00000100:00100000:3.0:1788876811.950918:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270912 00000100:00100000:1.0:1788876811.950931:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876811.950968:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1299 00000100:00100000:1.0:1788876811.950971:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876811.950976:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511270912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876811.951009:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511270784 00000100:00100000:1.0:1788876811.951012:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511270784 00000100:00100000:3.0:1788876811.951026:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511270912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876811.951033:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1299 00000100:00100000:1.0:1788876811.951045:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1735 00000100:00100000:3.0:1788876811.951045:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271040 00000100:00100000:3.0:1788876811.951047:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271040 00000100:00100000:1.0:1788876811.951052:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511270784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876811.951070:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1300 00000100:00100000:3.0:1788876811.951076:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511271040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876811.951094:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511270784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876811.951099:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511271040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876811.951102:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1735 00000100:00100000:3.0:1788876811.951105:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1300 00000100:00080000:3.0:1788876811.951121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876811.951126:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876811.951129:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876812.264798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876812.264808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876812.264814:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876812.264882:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1794 00000100:00080000:3.0:1788876812.264903:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876812.264912:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876812.264944:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3659180 x1875771532385024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876812.264963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876812.264966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876812.264968:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876812.264971:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1794 00000100:00080000:3.0:1788876812.264973:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876812.264976:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876812.264987:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c365b100 x1875771532385152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876812.265009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876812.265012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876812.265014:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876812.265017:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1794 00000100:00080000:3.0:1788876812.265019:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876812.265022:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876812.265031:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac98a80 x1875771532385408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876812.265063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876812.265067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876812.265069:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876812.265073:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1794 00000100:00080000:3.0:1788876812.265075:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876812.265079:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876812.265090:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99500 x1875771532385792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876812.265122:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788876812.265126:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876812.265128:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876812.265200:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a12c36e5800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876812.265216:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99f80 x1875771532386432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876812.265260:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532385280:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.265355:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.265967:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532386048:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.266017:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.266052:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788876812.266058:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532384896:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.266091:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.266117:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532385920:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.267264:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.267307:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876812.267323:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532386560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876812.267356:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.267392:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532385024:0@lo:38:kworker.0 00000100:00100000:1.0:1788876812.268331:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385920 00000100:00100000:1.0:1788876812.268345:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385920 00000100:00100000:1.0:1788876812.268563:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:1.0:1788876812.268580:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532385920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876812.268713:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532385920:12345-0@lo:400:kworker.0 Request processed in 141us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876812.268726:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:3.0:1788876812.268986:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.269022:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532385152:0@lo:38:kworker.0 00000100:00100000:3.0:1788876812.269059:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.269080:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532385408:0@lo:38:kworker.0 00000100:00100000:3.0:1788876812.269105:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.269125:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532385792:0@lo:38:kworker.0 00000100:00080000:2.0:1788876812.269981:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876812.270537:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.270622:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532386432:0@lo:38:kworker.0 00000100:00100000:3.0:1788876812.270664:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.270736:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532385536:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.270766:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.270782:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532386176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876812.271366:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385152 00000100:00100000:2.0:1788876812.271378:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385152 00000100:00100000:2.0:1788876812.271516:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385408 00000100:00100000:2.0:1788876812.271521:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385408 00000100:00100000:2.0:1788876812.271532:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385792 00000100:00100000:2.0:1788876812.271534:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385792 00000100:00100000:2.0:1788876812.271540:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386432 00000100:00100000:2.0:1788876812.271542:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386432 00000100:00100000:2.0:1788876812.271549:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385536 00000100:00100000:2.0:1788876812.271551:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385536 00000100:00100000:2.0:1788876812.271592:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1788876812.271619:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876812.271692:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532385536:12345-0@lo:400:kworker.0 Request processed in 92us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.271700:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1788876812.271718:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1788876812.271723:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532385152:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788876812.271751:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1800 last 0 00000100:00100000:3.0:1788876812.271957:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.272022:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532385536:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.272046:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788876812.272054:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532385664:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.272084:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.272106:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532386304:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.272214:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876812.272268:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385280 00000100:00100000:3.0:1788876812.272273:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385280 00000100:00100000:3.0:1788876812.272312:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386176 00000100:00100000:3.0:1788876812.272315:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386176 00000100:00100000:3.0:1788876812.272338:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385664 00000100:00100000:3.0:1788876812.272341:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385664 00000100:00100000:3.0:1788876812.272362:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386304 00000100:00100000:3.0:1788876812.272365:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386304 00000100:00100000:3.0:1788876812.272387:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1788876812.272395:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532385280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876812.273353:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1788876812.273365:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532385408:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876812.273396:0:15659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1800 last 0 00000020:00000080:1.0:1788876812.273764:0:15659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313af6c8 00000004:00100000:1.0:1788876812.273784:0:15659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876812.274039:0:15659:0:(import.c:65:import_set_state_nolock()) ffff8a13c4c3e800 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1788876812.274234:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313af6c1 00000004:00100000:2.0:1788876812.274244:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876812.274267:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a12c62d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876812.274373:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532385280:12345-0@lo:400:kworker.0 Request processed in 1977us (9017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.274383:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:3.0:1788876812.274423:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1788876812.274433:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532386176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.274471:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532386176:12345-0@lo:400:kworker.0 Request processed in 42us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.274477:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1788876812.274487:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1788876812.274494:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532385664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.274519:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532385664:12345-0@lo:400:kworker.0 Request processed in 26us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.274525:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1788876812.274533:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788876812.274539:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532386304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.274561:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532386304:12345-0@lo:400:kworker.0 Request processed in 22us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.274566:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1788876812.274653:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532385664:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.274668:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532386304:0@lo:400:kworker.0 00000100:00100000:3.0:1788876812.274681:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532386176:0@lo:400:kworker.0 00000100:00100000:1.0:1788876812.274764:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532385408:12345-0@lo:38:kworker.0 Request processed in 1399us (5657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876812.274771:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1788876812.274790:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1788876812.274794:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532385792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788876812.274813:0:15659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1800 last 0 00000020:00000080:1.0:1788876812.276000:0:15659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313af6cf 00000004:00100000:1.0:1788876812.276029:0:15659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876812.276095:0:15659:0:(import.c:65:import_set_state_nolock()) ffff8a13c486e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876812.280026:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532385152:12345-0@lo:38:kworker.0 Request processed in 8282us (10946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.280046:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1788876812.280107:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:2.0:1788876812.280115:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532386432:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788876812.280172:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1800 last 0 00000020:00000080:2.0:1788876812.280227:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313af6d6 00000004:00100000:2.0:1788876812.280249:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876812.280296:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a12c62df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876812.280382:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532386432:12345-0@lo:38:kworker.0 Request processed in 267us (9717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.280389:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00010000:00080000:3.0:1788876812.283006:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a12c365b100 x1875771532385152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.283036:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 19 00000100:00080000:2.0:1788876812.283315:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876812.283325:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876812.283330:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876812.285039:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386048 00000100:00100000:2.0:1788876812.285058:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386048 00000100:00100000:2.0:1788876812.285147:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386560 00000100:00100000:2.0:1788876812.285151:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386560 00000100:00100000:2.0:1788876812.285166:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532385024 00000100:00100000:2.0:1788876812.285169:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532385024 00000100:00100000:2.0:1788876812.285188:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1788876812.285198:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3663:x1875771532386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876812.285328:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3663:x1875771532386048:12345-0@lo:400:kworker.0 Request processed in 131us (19309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.285337:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1788876812.285360:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1788876812.285365:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532386560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876812.285399:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876812.285651:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532386560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 285us (18293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.285657:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1788876812.285671:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1788876812.285675:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532385024:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788876812.285702:0:6544:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a13c5f9d000, cookie 0xf5bf0f7e313af52b 00010000:00080000:2.0:1788876812.285708:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a13c5f9d000 cur 1800 last 1788876806 00000004:00100000:2.0:1788876812.285729:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876812.285769:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a12c62dd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876812.285822:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532385024:12345-0@lo:38:kworker.0 Request processed in 146us (16837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.285907:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00010000:00080000:2.0:1788876812.285939:0:49189:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1788876812.285945:0:49189:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 77309411330 00000020:00080000:2.0:1788876812.285952:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.285957:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 77309411330, next_transno: 77309411330 00010000:00080000:2.0:1788876812.285962:0:49189:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (77309411330) 00000020:00080000:2.0:1788876812.285965:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.285979:0:49189:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511262848 t77309411330 from 192.168.203.11@tcp req@ffff8a12c3659c00 x1875771511262848/t0(77309411330) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:203/0 lens 528/0 e 0 to 0 dl 1788876818 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876812.286116:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532386560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876812.286148:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532385920:0@lo:400:kworker.0 00000100:00100000:2.0:1788876812.286163:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532385280:0@lo:400:kworker.0 00000100:00100000:2.0:1788876812.286172:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532386048:0@lo:400:kworker.0 00000100:00100000:1.0:1788876812.289621:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532385792:12345-0@lo:38:kworker.0 Request processed in 14801us (19064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876812.289640:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1788876812.289709:0:49161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532384896 00000100:00100000:1.0:1788876812.289721:0:49161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532384896 00000100:00080000:3.0:1788876812.290188:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a12c365b100 x1875771532385152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.290202:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876812.290210:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876812.290215:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876812.290223:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532385152:0@lo:38:kworker.0 00000100:00100000:1.0:1788876812.290255:0:49161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788876812.290263:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13fac98a80 x1875771532385408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876812.290269:0:49161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d0636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532384896:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788876812.290284:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 19 00000100:00100000:1.0:1788876812.290367:0:49161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d0636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532384896:12345-0@lo:400:kworker.0 Request processed in 102us (24275us total) trans 0 rc 0/0 00000100:00080000:3.0:1788876812.294402:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13fac98a80 x1875771532385408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.294420:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876812.294428:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876812.294433:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876812.294441:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532385408:0@lo:38:kworker.0 00010000:00080000:3.0:1788876812.294487:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13fac99500 x1875771532385792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.294507:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 19 00000100:00100000:2.0:1788876812.296216:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532384896:0@lo:400:kworker.0 00000100:00080000:3.0:1788876812.298783:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13fac99500 x1875771532385792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876837 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.298801:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876812.298810:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876812.298814:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876812.298822:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532385792:0@lo:38:kworker.0 00010000:00080000:3.0:1788876812.298869:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13fac99f80 x1875771532386432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876812.299956:0:49161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:2.0:1788876812.302246:0:49189:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16191us 00000100:00080000:3.0:1788876812.306584:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1788876812.306624:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788876812.306645:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788876812.306651:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788876812.306667:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532386432:0@lo:38:kworker.0 00000100:00080000:3.0:1788876812.306764:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 19 00000100:00080000:3.0:1788876812.306775:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788876812.306781:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788876812.306784:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1788876812.306788:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788876812.306792:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788876812.308002:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532385024:0@lo:38:kworker.0 00010000:00080000:3.0:1788876812.308042:0:49400:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1788876812.308047:0:49400:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1788876812.308054:0:49400:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1788876812.308478:0:49400:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788876812.308534:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532386688:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876812.308642:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.308675:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386688 00000100:00100000:2.0:1788876812.308685:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386688 00000100:00100000:2.0:1788876812.308741:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1788876812.308752:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532386688:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788876812.308779:0:6544:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a12c606c700 x1875771532386688/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:208/0 lens 224/0 e 0 to 0 dl 1788876823 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876812.308803:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532386688:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 53us (162us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788876812.308810:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00010000:00010000:2.0:1788876812.350996:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.351027:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.351046:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.351065:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.351072:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.351078:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354015:0:49189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354038:0:49189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354047:0:49189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354054:0:49189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876812.354060:0:49189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354068:0:49189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354088:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13cff8bb00) 00010000:00010000:2.0:1788876812.354092:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876812.354099:0:49189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354105:0:49189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af6dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876812.354134:0:49189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054d821b4 reply state 0000000047ddeba7 transno 77309411330 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354150:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.354159:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13cff8b400) 00010000:00010000:2.0:1788876812.354161:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876812.354164:0:49189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788876812.354335:0:49189:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788876812.354366:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.354370:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411331 00000020:00080000:2.0:1788876812.354375:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.354378:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411331 00000100:00100000:1.0:1788876812.363020:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876812.363124:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511263360 00000100:00100000:0.0:1788876812.363150:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511263360 00000001:00080000:2.0:1788876812.363191:0:49157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 77309411330 is committed 00000100:00100000:0.0:1788876812.363230:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2564 00000100:00100000:0.0:1788876812.363247:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2394:x1875771511263360:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876812.363254:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.363270:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788876812.363273:0:6540:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 77309411331, current: 77309411331, replaying 00010000:00010000:2.0:1788876812.363286:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876812.363298:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2394:x1875771511263360:12345-192.168.203.11@tcp:36:rm.0 Request processed in 55us (292us total) trans 0 rc 0/-999 00010000:00010000:2.0:1788876812.363299:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876812.363311:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876812.363313:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2564 00010000:00010000:2.0:1788876812.363328:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.363350:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13cff8b400) 00010000:00010000:2.0:1788876812.363354:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876812.363360:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788876812.363363:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876812.363374:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 77309411331, next_transno: 77309411331 00010000:00010000:2.0:1788876812.363374:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffc00/0xf5bf0f7e313af6e4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788876812.363384:0:49189:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (77309411331) 00000020:00080000:0.0:1788876812.363391:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876812.363406:0:49189:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511263360 t77309411331 from 192.168.203.11@tcp req@ffff8a13fa48c000 x1875771511263360/t0(77309411331) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:208/0 lens 512/0 e 0 to 0 dl 1788876823 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788876812.363754:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.363774:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.364550:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.364579:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.364588:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.364598:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.365036:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.365046:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.365054:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366303:0:49189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366315:0:49189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366324:0:49189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366330:0:49189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876812.366335:0:49189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366345:0:49189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366361:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10d:0x0].0x0 (ffff8a13f35d9d00) 00010000:00010000:0.0:1788876812.366365:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876812.366371:0:49189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.366378:0:49189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313af6f9 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368363:0:49189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368383:0:49189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368391:0:49189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368397:0:49189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876812.368867:0:49189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368881:0:49189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368913:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f35d9700) 00010000:00010000:0.0:1788876812.368917:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876812.368923:0:49189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368932:0:49189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af6eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876812.368964:0:49189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000293c26a0 reply state 00000000930e7a3f transno 77309411331 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368978:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.368987:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f35d9c00) 00010000:00010000:0.0:1788876812.368991:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876812.368994:0:49189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1788876812.369597:0:49189:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1788876812.369668:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876812.369673:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411332 00000020:00080000:0.0:1788876812.369679:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876812.369680:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411332 00000100:00100000:2.0:1788876812.386955:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876812.387643:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511264512 00000100:00100000:1.0:1788876812.387660:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511264512 00000100:00100000:1.0:1788876812.387742:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2565 00000100:00100000:1.0:1788876812.387755:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511264512:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:1.0:1788876812.387916:0:6539:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 77309411332, current: 77309411332, replaying 00000100:00100000:1.0:1788876812.387940:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511264512:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 188us (1004us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876812.387948:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2565 00000020:00080000:2.0:1788876812.391029:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.391043:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 77309411332, next_transno: 77309411332 00010000:00080000:2.0:1788876812.391050:0:49189:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (77309411332) 00000020:00080000:2.0:1788876812.391054:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.391075:0:49189:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511264512 t77309411332 from 192.168.203.11@tcp req@ffff8a13eb148000 x1875771511264512/t0(77309411332) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:208/0 lens 520/0 e 0 to 0 dl 1788876823 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788876812.391916:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.391940:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.391956:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.391970:0:49189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.391978:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.391989:0:49189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396152:0:49189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396177:0:49189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396186:0:49189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396193:0:49189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876812.396199:0:49189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396209:0:49189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396232:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13cff8b400) 00010000:00010000:2.0:1788876812.396235:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876812.396242:0:49189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396250:0:49189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe000/0xf5bf0f7e313af700 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876812.396283:0:49189:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e55c446 reply state 00000000188ee18b transno 77309411332 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396300:0:49189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.396309:0:49189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13cff8bb00) 00010000:00010000:2.0:1788876812.396312:0:49189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876812.396316:0:49189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788876812.396473:0:49189:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788876812.396503:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.396507:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411333 00000020:00080000:2.0:1788876812.396512:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876812.396514:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 77309411333 00010000:00010000:1.0:1788876812.420578:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876812.421113:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876812.422529:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271168 00000100:00100000:3.0:1788876812.422547:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271168 00000100:00100000:3.0:1788876812.422681:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1738 00000100:00100000:3.0:1788876812.422695:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511271168:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788876812.422732:0:15659:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13eb149c00 x1875771511271168/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:208/0 lens 224/0 e 0 to 0 dl 1788876823 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876812.422759:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511271168:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 67us (1656us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876812.422768:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1738 00000020:00080000:3.0:1788876812.422789:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876812.422795:0:49189:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 77309411333 00010000:00080000:3.0:1788876812.422799:0:49189:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788876812.422803:0:49189:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876812.422814:0:49189:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788876812.422818:0:49189:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788876812.422975:0:49189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 19, last_transno is 81604378624 00000001:00100000:3.0:1788876812.424861:0:49157:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:3.0:1788876812.424872:0:49157:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1788876812.424898:0:49157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 77309411332 is committed 00000001:00080000:3.0:1788876812.425157:0:49189:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1788876812.425199:0:49189:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1788876812.425215:0:49189:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a12c606c700 x1875771532386688/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:208/0 lens 224/0 e 0 to 0 dl 1788876823 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788876812.426436:0:49189:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13eb149c00 x1875771511271168/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:208/0 lens 224/0 e 0 to 0 dl 1788876823 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.426554:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788876812.426562:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a12c606dc00 x1875771532386688/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876828 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.426571:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a12c606dc00 x1875771532386688/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876828 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876812.426578:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876812.427406:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1788876812.427415:0:3661:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001b21984a): req@ffff8a13fad1ea00 x1875771532365696/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876796 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876812.427436:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532386688:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876812.429969:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1788876812.430109:0:49189:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:2.0:1788876812.430503:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532386816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876812.430563:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.430653:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532365696 00000100:00100000:2.0:1788876812.430663:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532365696 00000100:00100000:2.0:1788876812.430711:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386816 00000100:00100000:2.0:1788876812.430714:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386816 00000100:00100000:2.0:1788876812.430730:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1788876812.430739:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1875771532365696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876812.430778:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00010000:00010000:1.0:1788876812.430937:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.430953:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.430962:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.430969:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876812.430975:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.430985:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431008:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13f35d9c00) 00010000:00010000:1.0:1788876812.431012:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876812.431019:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431026:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af6f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431058:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431066:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431072:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431078:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876812.431081:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431088:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431097:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13cff8bb00) 00010000:00010000:1.0:1788876812.431100:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876812.431103:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.431110:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313af707 lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 49189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876812.431172:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1788876812.431183:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1875771532386816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876812.431197:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:1.0:1788876812.431256:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1875771532386816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876812.431265:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1788876812.431316:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532386816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876812.431986:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532365696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1244us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.431995:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1788876812.432625:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532365696:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1788876812.470996:0:49189:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620886bfe10 00100000:10000000:2.0:1788876812.471019:0:49189:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1788876812.472266:0:49175:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788876812.472339:0:49175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:49175:1875771532386944:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788876812.473542:0:49175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.473594:0:49175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c72036c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788876812.473644:0:49177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:2.0:1788876812.473679:0:49177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:49177:1875771532387072:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788876812.473725:0:49177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.473742:0:49177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7d3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876812.473769:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532386944 00000100:00100000:2.0:1788876812.473777:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532386944 00000100:00100000:2.0:1788876812.474558:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387072 00000100:00100000:2.0:1788876812.474565:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387072 00000100:00100000:2.0:1788876812.474597:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1788876812.474626:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:49175:x1875771532386944:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788876812.474663:0:43958:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -114 00002000:02000040:2.0:1788876812.474669:0:43958:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:673) 00000100:00100000:3.0:1788876812.476174:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1788876812.476202:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:49177:x1875771532387072:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788876812.476246:0:43964:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -114 00002000:02000040:3.0:1788876812.476252:0:43964:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:673) 00002000:00010000:2.0:1788876812.503773:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.504525:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.504551:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a1:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.504556:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.504565:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.504583:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.504696:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.504713:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.504737:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876812.507075:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507090:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507119:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a0:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507124:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507133:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507151:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507165:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507175:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507194:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788876812.507254:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507261:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507272:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29f:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507275:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507279:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507290:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507299:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507308:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507325:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788876812.507366:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507371:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507379:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29e:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507382:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507385:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507393:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507406:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507412:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507421:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788876812.507459:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507464:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507472:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29d:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507476:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507479:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507489:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507497:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507506:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507520:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788876812.507555:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507560:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507567:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29c:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507570:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507574:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507584:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507591:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507622:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507632:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788876812.507670:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507675:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507682:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29b:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507686:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507689:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507697:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507704:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507710:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507717:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788876812.507751:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507756:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507763:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29a:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507766:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507769:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507777:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507785:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507792:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507800:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788876812.507833:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507837:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507845:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x299:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507847:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507851:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507860:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507867:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507874:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507881:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1788876812.507931:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.507936:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507945:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x298:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.507947:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x298:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.507951:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507961:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507968:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507976:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.507985:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1788876812.508021:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508025:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508032:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x297:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508035:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x297:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508039:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508047:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508059:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508065:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508073:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1788876812.508108:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508113:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508120:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x296:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508123:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508127:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508135:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508143:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508149:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508163:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1788876812.508200:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508205:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508213:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x295:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508216:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x295:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508220:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508229:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508237:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508243:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508251:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1788876812.508287:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508292:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508300:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x294:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508303:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508307:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508315:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508322:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508329:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508338:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1788876812.508372:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508377:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508385:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x293:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508388:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508391:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508399:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508407:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508415:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508423:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1788876812.508464:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508469:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508477:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x292:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508479:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x292:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508483:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508493:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508501:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508510:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508519:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1788876812.508553:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.508558:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508567:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x291:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.508570:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x291:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.508574:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508583:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508592:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.508639:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.517924:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788876812.517940:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.517957:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefee00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.517963:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.517977:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518005:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518013:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb15325/0xf5bf0f7e313af70e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518035:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788876812.518039:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518051:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518054:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518061:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518069:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518076:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73e2fb6/0xf5bf0f7e313af715 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518086:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788876812.518090:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518096:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518100:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518106:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518114:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518121:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313af71c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518132:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788876812.518134:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518139:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518141:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518149:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518157:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518163:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313af723 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518174:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788876812.518178:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518185:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518189:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518197:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518205:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518211:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313af72a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518287:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788876812.518291:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518297:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518300:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518308:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518318:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518326:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313af731 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518339:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788876812.518343:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518350:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8be00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518353:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518361:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518371:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518378:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18dc567/0xf5bf0f7e313af738 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518391:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788876812.518395:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518402:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518405:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518419:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518429:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518437:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179f1d65/0xf5bf0f7e313af73f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518450:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788876812.518454:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518460:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518463:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518469:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518477:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518484:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7d628/0xf5bf0f7e313af746 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518502:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788876812.518507:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518514:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518517:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518525:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518534:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518541:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d5db1bc/0xf5bf0f7e313af74d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518555:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788876812.518559:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518565:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8aa00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518569:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518582:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518592:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518621:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072508b5c/0xf5bf0f7e313af754 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518635:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876812.518640:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518646:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518649:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518657:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518667:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518674:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d3f96cb/0xf5bf0f7e313af75b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518693:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876812.518696:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518702:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518705:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518712:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518722:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518729:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078029a29/0xf5bf0f7e313af762 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518741:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876812.518745:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518751:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518754:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518765:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518773:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518779:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050657c4/0xf5bf0f7e313af769 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518790:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876812.518794:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518799:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8bc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518802:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518809:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518818:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518826:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dceb57c/0xf5bf0f7e313af770 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518843:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876812.518847:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518853:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.518857:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518864:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518874:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.518881:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037c28c5e/0xf5bf0f7e313af777 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.519807:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.519842:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.519853:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.519872:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a1:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.519877:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.519895:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.519911:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.519986:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.519995:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520019:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.520029:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.520034:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520042:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.520047:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520056:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520074:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520081:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af785 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520104:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520108:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.520108:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.520121:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520132:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ac00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.520136:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520145:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520157:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520170:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af77e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.520187:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.520189:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.520192:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.520280:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.520290:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520306:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x290:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.520311:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x290:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.520318:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520333:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520349:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520357:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520378:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.520388:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.520393:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520401:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8a600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.520405:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520415:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520430:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520438:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062dba18e/0xf5bf0f7e313af78c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520513:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520515:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520517:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.520629:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.520637:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520647:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28f:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.520651:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.520655:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.520660:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520670:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520680:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520688:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520706:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.520716:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.520721:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520730:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ae00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.520734:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520749:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520764:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520772:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096d61c28/0xf5bf0f7e313af793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520787:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520789:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.520791:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.520832:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.520836:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520843:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28e:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.520846:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.520850:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520857:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520864:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520871:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520895:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.520901:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.520905:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.520911:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ba00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.521086:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521097:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521186:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521196:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001797594b/0xf5bf0f7e313af79a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521214:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521216:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521220:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.521274:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.521280:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521288:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28d:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.521290:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.521295:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521305:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521314:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521322:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521339:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.521345:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.521348:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521355:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.521358:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521365:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521375:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521381:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047036805/0xf5bf0f7e313af7a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521396:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521398:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521400:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.521441:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.521447:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521454:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28c:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.521457:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.521460:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521470:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521477:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521485:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521504:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.521510:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.521514:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521520:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8b600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.521523:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521531:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521540:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521548:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000962a2742/0xf5bf0f7e313af7a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.521562:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521564:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.521566:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.523024:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.523036:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523050:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28b:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.523055:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.523060:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523074:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523083:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523091:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523110:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.523123:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.523128:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523135:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.523139:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523146:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523159:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523171:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000222d5046/0xf5bf0f7e313af7af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523187:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.523188:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.523190:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.523259:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.523264:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523272:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28a:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.523275:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.523279:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523296:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523304:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523311:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523326:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.523335:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.523340:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523348:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.523352:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523360:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523373:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523380:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1bfb38/0xf5bf0f7e313af7b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523397:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.523399:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.523401:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.523468:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.523474:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.523482:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x289:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.523485:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.523489:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788876812.523572:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.523585:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.523618:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a0:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.523623:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.523629:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.523643:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.523652:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.523660:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.523683:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.525111:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.525125:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.525219:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.525225:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.525239:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.525264:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.525273:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c5b3090/0xf5bf0f7e313af7c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.525376:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.525379:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.525381:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.525542:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525724:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525745:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525775:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.525789:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.525795:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525803:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.525808:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525817:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525834:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525842:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000765b1c57/0xf5bf0f7e313af7bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.525864:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.525866:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.525868:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.526240:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.526248:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526260:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x288:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.526265:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.526271:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526282:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526290:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526297:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526376:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876812.526419:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.526425:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526439:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x287:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.526442:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.526447:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526530:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.526539:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526576:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.526585:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526595:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ce00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.526611:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526628:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526665:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526674:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c3f014/0xf5bf0f7e313af7cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526696:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.526698:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.526700:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.526855:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.526861:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526873:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29f:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.526901:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.526908:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526922:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526932:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526941:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.526982:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.527055:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527075:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.527083:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788876812.527085:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788876812.527099:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cba00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.527105:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527116:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788876812.527122:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.527142:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527151:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b18cd19/0xf5bf0f7e313af7d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527176:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.527178:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.527180:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.527200:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876812.527268:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.527274:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527283:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x286:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.527287:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.527292:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527371:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527383:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527391:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527407:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876812.527414:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876812.527417:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527425:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.527428:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527436:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527447:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527525:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313af7d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527541:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.527544:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527551:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8dc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.527555:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527569:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527580:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527728:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd2a560/0xf5bf0f7e313af7e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527742:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.527744:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.527746:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.527791:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.527797:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527806:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x285:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.527810:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.527814:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527824:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527833:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527842:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527857:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.527864:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.527868:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527875:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.527878:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527898:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527909:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527915:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313af7ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.527958:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.527969:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29e:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.527973:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.527978:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.527989:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.527995:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.528000:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.528000:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.528007:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.528019:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.528036:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.528063:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876812.528090:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.528098:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.528108:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.528111:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.528121:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529068:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529077:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4052db7/0xf5bf0f7e313af7e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529101:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.529103:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.529105:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.529203:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.529209:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529219:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x284:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.529222:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.529228:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529244:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529255:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529263:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.529290:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.532317:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.532334:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532350:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ca00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.532356:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532369:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532395:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532403:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5d43cc7/0xf5bf0f7e313af7f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532429:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.532431:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.532433:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.532478:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.532486:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532499:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29d:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.532504:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.532511:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532529:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532540:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532548:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532576:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876812.532733:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.532738:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532746:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29c:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.532749:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.532753:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532761:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532769:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.532783:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533288:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.533303:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533317:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.533322:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533334:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533356:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533364:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc99fbd/0xf5bf0f7e313af7fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533393:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.533395:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.533397:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876812.533504:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.533511:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533523:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x283:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.533527:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.533533:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533546:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533554:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533562:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533590:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876812.533651:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876812.533656:0:43958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533670:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:2.0:1788876812.533673:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876812.533677:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533687:0:43958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533695:0:43958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533702:0:43958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533715:0:43958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876812.533722:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876812.533726:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533733:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8de00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.533736:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533743:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533760:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533768:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc10dce/0xf5bf0f7e313af80a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533783:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876812.533786:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533792:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8cc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876812.533796:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533804:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533813:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533820:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029ad4546/0xf5bf0f7e313af811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876812.533832:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.533834:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876812.533836:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.535078:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.535082:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.535085:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788876812.535879:0:43958:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:2.0:1788876812.536066:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:49175:x1875771532386944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 61438us (62525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.536078:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1788876812.536141:0:49175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:49175:1875771532386944:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788876812.536158:0:49175:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2a1:0x0] from OST, last_created [0x280000401:0x2a1:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788876812.536227:0:49175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa644380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:49175:1875771532387328:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788876812.536261:0:49175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.536284:0:49175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876812.536301:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532387200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876812.536326:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876812.536363:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387328 00000100:00100000:2.0:1788876812.536369:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387328 00000100:00100000:2.0:1788876812.536404:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:2.0:1788876812.536413:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:49175:x1875771532387328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788876812.536448:0:43959:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 674 00000001:00100000:0.0:1788876812.537221:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788876812.537279:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387200 00000100:00100000:0.0:1788876812.537296:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387200 00000100:00100000:0.0:1788876812.537355:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1788876812.537365:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532387200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876812.537394:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491647808 pending 896 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876812.537479:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532387200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876812.537486:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00010000:00010000:3.0:1788876812.537641:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.537661:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876812.537790:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.537804:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537823:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29b:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.537828:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.537836:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537853:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537866:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537875:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537899:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788876812.537944:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.537950:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537958:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29a:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.537962:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.537966:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537976:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537985:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.537994:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538009:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788876812.538015:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876812.538021:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538028:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1ca400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538034:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538044:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538063:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538070:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000deeb47bc/0xf5bf0f7e313af803 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538092:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876812.538097:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538104:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538107:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538114:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538128:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538136:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a05172df/0xf5bf0f7e313af818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538150:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.538154:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538162:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538165:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538173:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538186:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538195:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c7f1cbe/0xf5bf0f7e313af81f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538214:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538217:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538225:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.538294:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.538303:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538312:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x299:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.538316:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x299:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.538321:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538335:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538346:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538355:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538373:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.538383:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.538388:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538396:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cb400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538400:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538412:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538424:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538432:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005527fe58/0xf5bf0f7e313af826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538447:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538449:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538451:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.538499:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.538505:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538514:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x298:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.538517:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x298:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.538522:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538532:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538542:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538550:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538563:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.538569:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.538573:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538581:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ac00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538585:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538625:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538638:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538646:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d0b2d63/0xf5bf0f7e313af82d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538662:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538664:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538666:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.538711:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.538717:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538725:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x297:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.538728:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x297:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.538732:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538743:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538753:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538762:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538779:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876812.538787:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876812.538792:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538799:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876812.538804:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538812:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538824:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538833:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076dd6f93/0xf5bf0f7e313af834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.538855:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538858:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876812.538861:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.540712:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.540725:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876812.541137:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532387200:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788876812.541372:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.541384:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541409:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x296:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.541414:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x296:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.541423:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541441:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541452:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541461:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541488:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876812.541554:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.541560:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541568:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x295:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.541570:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x295:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.541574:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541582:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541590:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541597:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541632:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788876812.541676:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.541681:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541689:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x294:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.541692:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x294:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.541696:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541705:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541714:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541721:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541739:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788876812.541780:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.541787:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541795:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x293:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.541798:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x293:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.541803:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541814:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541823:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541831:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541843:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788876812.541909:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.541916:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541923:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x292:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.541927:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x292:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.541931:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541940:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541948:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541956:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.541965:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788876812.542009:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542014:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542021:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x291:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542024:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x291:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542029:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542038:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542046:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542054:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542063:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788876812.542102:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542107:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542115:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x290:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542118:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x290:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542122:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542132:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542140:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542147:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542156:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1788876812.542202:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542207:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542216:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28f:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542219:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542223:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542232:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542240:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542248:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542257:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1788876812.542299:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542304:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542313:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28e:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542316:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542320:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542329:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542343:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542352:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542361:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1788876812.542400:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542406:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542414:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28d:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542417:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542421:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542430:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542439:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542446:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542460:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1788876812.542507:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542513:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542521:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28c:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542524:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542528:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542537:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542546:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542554:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542565:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1788876812.542651:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542657:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542666:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28b:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542671:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542675:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542685:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542694:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542702:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542713:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:3.0:1788876812.542770:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542777:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542785:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28a:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542788:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542793:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542804:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542813:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542821:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542832:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:3.0:1788876812.542901:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.542907:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542917:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x289:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.542920:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x289:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.542924:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542937:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542946:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542954:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.542965:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:3.0:1788876812.543027:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.543033:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543043:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x288:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.543047:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x288:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.543051:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543063:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543072:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543080:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543091:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:3.0:1788876812.543151:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.543157:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543167:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x287:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.543170:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x287:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.543174:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543183:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543196:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543204:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543220:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:3.0:1788876812.543277:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.543284:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543292:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x286:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.543295:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x286:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.543299:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543310:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543319:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543328:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543347:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:3.0:1788876812.543400:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.543406:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543416:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x285:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.543420:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x285:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.543425:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543435:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543445:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543453:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543463:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00000100:00100000:2.0:1788876812.543509:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:49175:x1875771532387328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7084us (7233us total) trans 8589934859 rc 0/0 00002000:00010000:3.0:1788876812.543512:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.543529:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876812.543538:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00010000:00010000:3.0:1788876812.543549:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x284:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.543555:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x284:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.543559:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543572:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543581:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543590:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.543638:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00000100:00100000:2.0:1788876812.543763:0:49175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa644380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:49175:1875771532387328:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788876812.543783:0:49175:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2a1:0x0]-[0x280000401:0x2c1:0x0] 00010000:00010000:0.0:1788876812.544827:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1788876812.544839:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544850:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.544855:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544866:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544901:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544909:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53d3a/0xf5bf0f7e313af83b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544937:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1788876812.544941:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544949:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.544952:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544959:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544969:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544977:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313af842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.544991:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1788876812.544995:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545002:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545005:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545012:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545022:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545029:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313af849 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545041:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1788876812.545045:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545051:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545054:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545061:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545071:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545078:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b59a57f/0xf5bf0f7e313af850 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545092:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1788876812.545098:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545105:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545110:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545117:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545129:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545137:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313af857 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545152:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1788876812.545157:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545163:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545166:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545173:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545181:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545188:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313af85e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545204:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1788876812.545208:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545215:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545218:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545227:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545239:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545247:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313af865 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545259:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1788876812.545263:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545269:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545272:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545286:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545299:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545306:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313af86c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545320:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1788876812.545324:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545330:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545333:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545340:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545352:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545360:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313af873 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545404:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788876812.545409:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545417:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545421:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545430:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545442:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545450:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313af87a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545463:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788876812.545467:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545473:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545477:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545490:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545500:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545508:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008628c897/0xf5bf0f7e313af881 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545520:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788876812.545524:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545530:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545533:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545541:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545551:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545558:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c409b4e9/0xf5bf0f7e313af888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545575:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788876812.545578:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545584:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545587:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545594:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545626:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545634:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313af88f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545647:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788876812.545651:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545658:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545661:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545674:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545682:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545690:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313af896 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545702:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876812.545705:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545711:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545714:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545720:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545728:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545735:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313af89d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545751:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876812.545754:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545760:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545763:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545771:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545780:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545787:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313af8a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545799:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876812.545804:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545810:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545814:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545825:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545835:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545842:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313af8ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545852:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876812.545855:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545861:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545864:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545870:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545878:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545896:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313af8b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545912:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876812.545915:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545921:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876812.545924:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545931:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545940:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545947:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313af8b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876812.545961:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.545962:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.545965:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.545975:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876812.545991:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876812.548459:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.548478:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548500:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x283:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.548506:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x283:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.548514:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548529:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548541:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548551:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548585:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876812.548732:0:43964:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876812.548738:0:43964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548746:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x282:0x0].0x0 since=1800s v=(0 0) 00010000:00010000:3.0:1788876812.548749:0:43964:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x282:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876812.548754:0:43964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548762:0:43964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548771:0:43964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548779:0:43964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876812.548799:0:43964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876812.549318:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876812.549329:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549338:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876812.549343:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549354:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549374:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549382:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313af8c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549405:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876812.549410:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549416:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876812.549419:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549426:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549436:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549442:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313af8c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876812.549453:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876812.549454:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876812.549456:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876812.549483:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788876812.550321:0:43964:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00000100:00100000:3.0:1788876812.550515:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:49177:x1875771532387072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 74321us (76783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.550528:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1788876812.558474:0:49177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3659180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:49177:1875771532387072:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788876812.558502:0:49177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2a1:0x0] from OST, last_created [0x2c0000401:0x2a1:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876812.558644:0:49177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:49177:1875771532387584:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876812.558730:0:49177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876812.558776:0:49177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13eb223cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876812.558823:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387584 00000100:00100000:1.0:1788876812.558831:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387584 00000100:00100000:1.0:1788876812.558909:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1788876812.558921:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:49177:x1875771532387584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788876812.558976:0:43955:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 674 00000100:00100000:1.0:1788876812.560899:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:49177:x1875771532387584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1961us (2149us total) trans 4294967567 rc 0/0 00000100:00100000:1.0:1788876812.560912:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1788876812.560986:0:49177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:49177:1875771532387584:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788876812.561004:0:49177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2a1:0x0]-[0x2c0000401:0x2c1:0x0] 00000100:00100000:0.0:1788876812.561147:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876812.561171:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532387456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876812.561226:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876812.561270:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387456 00000100:00100000:0.0:1788876812.561277:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387456 00000100:00100000:0.0:1788876812.561319:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788876812.561329:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532387456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876812.561352:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876812.561390:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532387456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876812.561396:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788876812.561428:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532387456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876812.985900:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876812.985961:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876812.986045:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876812.986071:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876812.986174:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876812.986219:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271424 00000100:00100000:2.0:1788876812.986232:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271424 00000100:00100000:2.0:1788876812.986302:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271552 00000100:00100000:2.0:1788876812.986305:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271552 00000100:00100000:2.0:1788876812.986342:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1739 00000100:00100000:2.0:1788876812.986353:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511271424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876812.986457:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511271424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 106us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.986465:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1739 00000100:00100000:2.0:1788876812.986487:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1740 00000100:00100000:2.0:1788876812.986495:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511271552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876812.986519:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511271552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876812.986526:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1740 00000100:00100000:3.0:1788876812.988336:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271296 00000100:00100000:3.0:1788876812.988352:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271296 00000100:00100000:3.0:1788876812.988417:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1788876812.988427:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511271296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876812.988517:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511271296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876812.988525:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:1.0:1788876812.999528:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271680 00000100:00100000:1.0:1788876812.999551:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271680 00000100:00100000:1.0:1788876813.000011:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271808 00000100:00100000:1.0:1788876813.000017:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271808 00000100:00100000:1.0:1788876813.000062:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1305 00000100:00100000:1.0:1788876813.000074:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511271680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876813.000171:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1306 00000100:00100000:3.0:1788876813.000182:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511271808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876813.000300:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511271808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 120us (14125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876813.000309:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1306 00000100:00100000:1.0:1788876813.000384:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511271680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 311us (14422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876813.000391:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1305 00000001:02000400:0.0:1788876813.168148:0:49443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:2.0:1788876813.310567:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788876813.481027:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788876814.460117:0:49495:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876814.460467:0:49495:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788876814.511770:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876814.831681:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876814.831712:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532387712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876814.831808:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876814.831939:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387712 00000100:00100000:1.0:1788876814.831950:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387712 00000100:00100000:1.0:1788876814.832018:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1788876814.832029:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532387712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876814.832070:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876814.832125:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532387712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876814.832132:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1788876814.832289:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876814.832379:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532387712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876815.531564:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876815.848922:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532387840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876815.849034:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876815.849195:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387840 00000100:00100000:1.0:1788876815.849207:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387840 00000100:00100000:1.0:1788876815.849296:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788876815.849310:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532387840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876815.849352:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876815.849431:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532387840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876815.849439:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1788876815.849505:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532387840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788876815.849648:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1788876815.939112:0:49546:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788876815.939456:0:49546:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788876816.554532:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876817.386197:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532388224:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386301:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386305:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532387968:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386349:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386372:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532388480:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386372:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f5219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532388736:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386395:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386396:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876817.386412:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389248:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386413:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532388992:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386432:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386433:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386447:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532389504:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386458:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788876817.386464:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532388352:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386483:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386484:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876817.386499:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532388864:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386501:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788876817.386506:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532388096:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386520:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386528:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876817.386534:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389376:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386542:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532388608:0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386552:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386558:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876817.386566:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532389120:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386586:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876817.386588:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532387968 00000100:00100000:2.0:1788876817.386597:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532387968 00000100:00100000:0.0:1788876817.386626:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388224 00000100:00100000:0.0:1788876817.386630:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388224 00000100:00100000:0.0:1788876817.386659:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388480 00000100:00100000:0.0:1788876817.386662:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388480 00000100:00100000:2.0:1788876817.386665:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788876817.386674:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386687:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388992 00000100:00100000:0.0:1788876817.386689:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388992 00000100:00100000:0.0:1788876817.386701:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389504 00000100:00100000:0.0:1788876817.386703:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389504 00000100:00100000:0.0:1788876817.386713:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388864 00000100:00100000:0.0:1788876817.386715:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388864 00000100:00100000:0.0:1788876817.386727:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388608 00000100:00100000:0.0:1788876817.386729:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388608 00000100:00100000:2.0:1788876817.386729:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532387968:12345-0@lo:400:kworker.0 Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386736:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788876817.386742:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:0.0:1788876817.386758:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532388224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386774:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388096 00000100:00100000:2.0:1788876817.386777:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388096 00000100:00100000:0.0:1788876817.386797:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532388224:12345-0@lo:400:kworker.0 Request processed in 50us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386799:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389120 00000100:00100000:2.0:1788876817.386802:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389120 00000100:00100000:0.0:1788876817.386804:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:2.0:1788876817.386814:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1788876817.386816:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:2.0:1788876817.386820:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532388096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386821:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532388480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386846:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532388480:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386846:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532388096:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386868:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1788876817.386880:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1788876817.386884:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:2.0:1788876817.386886:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386895:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1788876817.386900:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.386914:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532389120:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386920:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1788876817.386922:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532388992:12345-0@lo:400:kworker.0 Request processed in 23us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876817.386928:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1788876817.386937:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:0.0:1788876817.386943:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386966:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532389504:12345-0@lo:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.386966:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532388224:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.386971:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:0.0:1788876817.386981:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:0.0:1788876817.386986:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.387017:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532388864:12345-0@lo:400:kworker.0 Request processed in 31us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876817.387022:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1788876817.387029:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876817.387060:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532388608:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876817.387282:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388736 00000100:00100000:3.0:1788876817.387287:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388736 00000100:00100000:3.0:1788876817.387324:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389248 00000100:00100000:3.0:1788876817.387328:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389248 00000100:00100000:3.0:1788876817.387362:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532388352 00000100:00100000:3.0:1788876817.387366:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532388352 00000100:00100000:3.0:1788876817.387387:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389376 00000100:00100000:3.0:1788876817.387390:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389376 00000100:00100000:3.0:1788876817.387411:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788876817.387419:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532388736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.387462:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532388736:12345-0@lo:400:kworker.0 Request processed in 45us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876817.387480:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788876817.387496:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788876817.387502:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.387530:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389248:12345-0@lo:400:kworker.0 Request processed in 28us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876817.387536:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788876817.387546:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1788876817.387552:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532388352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.387577:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532388352:12345-0@lo:400:kworker.0 Request processed in 26us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876817.388349:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00080000:0.0:1788876817.388383:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876817.388388:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876817.388391:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876817.388394:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876817.388410:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1788876817.388422:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.388559:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1788876817.388697:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532388352:0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.388711:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532388864:0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.388724:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.388735:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f5219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788876817.388814:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389248:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.388986:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389376:12345-0@lo:400:kworker.0 Request processed in 54us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876817.388994:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1788876817.389029:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532388096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389043:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532388608:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389055:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532389120:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389065:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532387968:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389077:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532388480:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389089:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532388992:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.389103:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532389504:0@lo:400:kworker.0 00000100:00100000:0.0:1788876817.392564:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876817.392651:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532389632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876817.392765:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876817.393111:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389632 00000100:00100000:1.0:1788876817.393132:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389632 00000100:00100000:1.0:1788876817.393198:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1788876817.393210:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532389632:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876817.393235:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000004:00000024:1.0:1788876817.393254:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876817.393322:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532389632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876817.393329:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1788876817.393419:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532389632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788876817.577768:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876817.896916:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876817.896948:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532389760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876817.897073:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876817.897768:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389760 00000100:00100000:1.0:1788876817.897783:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389760 00000100:00100000:1.0:1788876817.897879:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1788876817.897893:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532389760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876817.897939:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876817.898016:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532389760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876817.898024:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1788876817.898380:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876817.898400:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876817.898448:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876817.898505:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532389888 00000100:00100000:3.0:1788876817.898511:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532389888 00000100:00100000:3.0:1788876817.898547:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788876817.898554:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876817.898574:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876817.898635:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532389888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876817.898643:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788876817.898698:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876817.899078:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876817.899089:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532390016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876817.899131:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876817.899182:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532389760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876817.900705:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390016 00000100:00100000:1.0:1788876817.900724:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390016 00000100:00100000:1.0:1788876817.900789:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1788876817.900801:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532390016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876817.900843:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:1.0:1788876817.901094:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532390016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 294us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876817.901102:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1788876817.901164:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532390016:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788876817.906447:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967567 is committed 00000001:00080000:0.0:1788876817.906819:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934859 is committed 00000100:00100000:3.0:1788876818.094778:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.094855:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.094896:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.094933:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.094961:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.095009:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272448 00000100:00100000:3.0:1788876818.095021:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272448 00000100:00100000:2.0:1788876818.095160:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272320 00000100:00100000:2.0:1788876818.095166:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272320 00000100:00100000:2.0:1788876818.095218:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1311 00000100:00100000:2.0:1788876818.095229:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511272320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876818.095318:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511272320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876818.095327:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1311 00000100:00100000:2.0:1788876818.095374:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272192 00000100:00100000:2.0:1788876818.095377:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272192 00000100:00100000:2.0:1788876818.095409:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272064 00000100:00100000:2.0:1788876818.095413:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272064 00000100:00100000:2.0:1788876818.095438:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1747 00000100:00100000:2.0:1788876818.095445:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511272192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876818.095476:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511272192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876818.095482:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1747 00000100:00100000:2.0:1788876818.095494:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1748 00000100:00100000:2.0:1788876818.095499:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511272064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876818.095522:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f521a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511272064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876818.095528:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1748 00000100:00100000:3.0:1788876818.095654:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1312 00000100:00100000:3.0:1788876818.095663:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511272448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876818.095695:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511272448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876818.095701:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1312 00000100:00100000:0.0:1788876818.097367:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511271936 00000100:00100000:0.0:1788876818.097385:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511271936 00000100:00100000:0.0:1788876818.097473:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:0.0:1788876818.097486:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511271936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876818.097566:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511271936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876818.097573:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00080000:0.0:1788876818.097664:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876818.097670:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876818.097675:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876818.097678:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876818.240101:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.240219:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272576 00000100:00100000:3.0:1788876818.240236:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272576 00000100:00100000:3.0:1788876818.240316:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2566 00000100:00100000:3.0:1788876818.240329:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37330:x1875771511272576:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1788876818.240359:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876818.240395:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048935 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240508:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240533:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240562:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876818.240673:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876818.240678:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876818.240727:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240760:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048935 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240782:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048935 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876818.240793:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:3.0:1788876818.240796:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876818.240801:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960a00, rc 0) 00000100:00100000:3.0:1788876818.240894:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37330:x1875771511272576:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 568us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876818.240903:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2566 00000100:00100000:0.0:1788876818.279264:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876818.279389:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272704 00000100:00100000:2.0:1788876818.279414:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272704 00000100:00100000:2.0:1788876818.279504:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2567 00000100:00100000:2.0:1788876818.279516:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37330:x1875771511272704:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876818.279568:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:2.0:1788876818.279729:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37330:x1875771511272704:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 215us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876818.279739:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2567 00000100:00100000:0.0:1788876818.294549:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876818.298702:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272832 00000100:00100000:1.0:1788876818.298724:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272832 00000100:00100000:1.0:1788876818.298821:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2568 00000100:00100000:1.0:1788876818.298833:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37330:x1875771511272832:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876818.298896:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876818.299073:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37330:x1875771511272832:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 241us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876818.299082:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2568 00000100:00100000:0.0:1788876818.318989:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876818.319256:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511272960 00000100:00100000:1.0:1788876818.319274:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511272960 00000100:00100000:1.0:1788876818.319360:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1046 00000100:00100000:1.0:1788876818.319378:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37330:x1875771511272960:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876818.319424:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876818.319530:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37330:x1875771511272960:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 153us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876818.319539:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1046 00000100:00100000:0.0:1788876818.324199:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876818.324375:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273088 00000100:00100000:3.0:1788876818.324390:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273088 00000100:00100000:3.0:1788876818.324473:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1047 00000100:00100000:3.0:1788876818.324485:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37330:x1875771511273088:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788876818.324522:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876818.324665:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37330:x1875771511273088:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 181us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876818.324674:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1047 00010000:00010000:1.0:1788876818.601010:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876819.625649:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876819.944755:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876819.944783:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532390144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876819.944883:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876819.944963:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390144 00000100:00100000:1.0:1788876819.944973:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390144 00000100:00100000:1.0:1788876819.945040:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1788876819.945051:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532390144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876819.945089:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876819.945139:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532390144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876819.945146:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:1.0:1788876819.945169:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876819.945209:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532390144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876820.656968:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876820.969296:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876820.969327:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532390272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876820.969424:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876820.969780:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390272 00000100:00100000:3.0:1788876820.969790:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390272 00000100:00100000:3.0:1788876820.969881:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788876820.969894:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532390272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876820.969944:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876820.970004:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532390272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876820.970012:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788876820.970075:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532390272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788876820.970141:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876821.673038:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876822.510353:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532390656:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510450:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510516:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510544:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510562:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532391680:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510583:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510636:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788876822.510642:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532390528:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510681:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510706:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532391040:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510728:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510745:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532391552:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510768:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876822.510803:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390656 00000100:00100000:0.0:1788876822.510822:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390656 00000100:00100000:0.0:1788876822.510879:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391040 00000100:00100000:0.0:1788876822.510883:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391040 00000100:00100000:0.0:1788876822.510918:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:0.0:1788876822.510927:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532390656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.510988:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532390656:12345-0@lo:400:kworker.0 Request processed in 61us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.510996:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:0.0:1788876822.511013:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:0.0:1788876822.511019:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532391040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511146:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532390400:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511197:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511227:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532390912:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511252:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511271:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511294:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511305:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532391936:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511325:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511340:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788876822.511346:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532390784:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511369:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511387:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511406:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511416:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532391808:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511434:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.511471:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391168 00000100:00100000:1.0:1788876822.511476:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391168 00000100:00100000:1.0:1788876822.511512:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391680 00000100:00100000:1.0:1788876822.511515:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391680 00000100:00100000:1.0:1788876822.511536:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390784 00000100:00100000:1.0:1788876822.511539:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390784 00000100:00100000:1.0:1788876822.511556:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391808 00000100:00100000:1.0:1788876822.511559:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391808 00000100:00100000:1.0:1788876822.511581:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1788876822.511588:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511648:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532391168:12345-0@lo:400:kworker.0 Request processed in 60us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511654:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1788876822.511667:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1788876822.511674:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532391680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511700:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532391680:12345-0@lo:400:kworker.0 Request processed in 27us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511706:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1788876822.511716:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1788876822.511721:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511747:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532390784:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511753:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1788876822.511763:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788876822.511768:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532391808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511793:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532391808:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511799:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788876822.511828:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390528 00000100:00100000:1.0:1788876822.511832:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390528 00000100:00100000:1.0:1788876822.511859:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391552 00000100:00100000:1.0:1788876822.511862:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391552 00000100:00100000:1.0:1788876822.511874:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1788876822.511880:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532390528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511916:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532390528:12345-0@lo:400:kworker.0 Request processed in 35us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511922:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1788876822.511933:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1788876822.511938:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.511965:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532391552:12345-0@lo:400:kworker.0 Request processed in 27us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.511971:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1788876822.511987:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390912 00000100:00100000:1.0:1788876822.511991:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390912 00000100:00100000:1.0:1788876822.512008:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391424 00000100:00100000:1.0:1788876822.512010:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391424 00000100:00100000:0.0:1788876822.512149:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532391040:12345-0@lo:400:kworker.0 Request processed in 1129us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.512156:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:0.0:1788876822.512168:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391296 00000100:00100000:0.0:1788876822.512171:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391296 00000100:00100000:0.0:1788876822.512187:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:0.0:1788876822.512193:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512219:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532390912:12345-0@lo:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.512224:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:0.0:1788876822.512234:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1788876822.512239:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512262:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532391424:12345-0@lo:400:kworker.0 Request processed in 23us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.512268:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1788876822.512277:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:0.0:1788876822.512282:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532391296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512306:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532391296:12345-0@lo:400:kworker.0 Request processed in 23us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.512312:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00080000:0.0:1788876822.512337:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876822.512342:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876822.512345:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876822.512347:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876822.512382:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532390528:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512396:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532391040:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512407:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532391552:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512419:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532390656:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512430:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512440:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934859 gen 2 00000100:00100000:0.0:1788876822.512457:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532391680:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512541:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532390400 00000100:00100000:0.0:1788876822.512545:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532390400 00000100:00100000:0.0:1788876822.512575:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788876822.512581:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532390400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512633:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532390400:12345-0@lo:400:kworker.0 Request processed in 51us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876822.512640:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788876822.512710:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532390784:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512721:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532391296:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512730:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 2 00000100:00100000:0.0:1788876822.512742:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512752:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532390400:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512762:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532390912:0@lo:400:kworker.0 00000100:00100000:0.0:1788876822.512771:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.514865:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532391936 00000100:00100000:1.0:1788876822.514879:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532391936 00000100:00100000:3.0:1788876822.514888:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876822.514913:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532392064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876822.514948:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1788876822.514959:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532391936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876822.515072:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532391936:12345-0@lo:400:kworker.0 Request processed in 114us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.515081:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1788876822.515137:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532391936:0@lo:400:kworker.0 00000100:00100000:3.0:1788876822.515263:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876822.516914:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392064 00000100:00100000:1.0:1788876822.516933:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392064 00000100:00100000:1.0:1788876822.517002:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1788876822.517013:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532392064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876822.517063:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876822.517166:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532392064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876822.517176:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1788876822.517522:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532392064:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788876822.700129:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876823.016973:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876823.017004:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876823.017118:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876823.017278:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392192 00000100:00100000:2.0:1788876823.017289:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392192 00000100:00100000:2.0:1788876823.017361:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1788876823.017373:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532392192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876823.017416:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:2.0:1788876823.017476:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532392192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876823.017483:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:1.0:1788876823.017738:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876823.017955:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532392320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876823.017996:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876823.020139:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876823.020165:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876823.020247:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876823.020303:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392320 00000100:00100000:2.0:1788876823.020314:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392320 00000100:00100000:2.0:1788876823.020585:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392448 00000100:00100000:2.0:1788876823.020591:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392448 00000100:00100000:2.0:1788876823.020647:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1788876823.020664:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532392320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876823.020702:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876823.020764:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532392320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (2766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876823.020782:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1788876823.020796:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1788876823.020817:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876823.020840:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876823.020862:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532392320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876823.020882:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876823.020888:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1788876823.020899:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876823.215493:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876823.215715:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876823.216170:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273216 00000100:00100000:3.0:1788876823.216183:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273216 00000100:00100000:3.0:1788876823.216266:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:3.0:1788876823.216279:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511273216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876823.216376:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511273216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876823.216384:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:0.0:1788876823.217105:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876823.217146:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876823.217261:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273728 00000100:00100000:3.0:1788876823.217268:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273728 00000100:00100000:3.0:1788876823.217336:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1317 00000100:00100000:3.0:1788876823.217346:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511273728:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876823.217399:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511273728:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876823.217406:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1317 00000100:00080000:1.0:1788876823.217771:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876823.225543:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876823.226945:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273472 00000100:00100000:2.0:1788876823.226969:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273472 00000100:00080000:1.0:1788876823.227151:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876823.229180:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273600 00000100:00100000:1.0:1788876823.229193:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273600 00000100:00100000:1.0:1788876823.229290:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1318 00000100:00100000:1.0:1788876823.229303:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511273600:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876823.229403:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511273600:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 104us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876823.229411:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1318 00000100:00080000:0.0:1788876823.229737:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876823.233329:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273344 00000100:00100000:3.0:1788876823.233347:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273344 00000100:00100000:3.0:1788876823.233542:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1755 00000100:00080000:0.0:1788876823.233689:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876823.233824:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511273472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876823.233931:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511273472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (18216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876823.233940:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1755 00000100:00100000:3.0:1788876823.233961:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1756 00000100:00100000:3.0:1788876823.233967:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511273344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876823.233994:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511273344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (16847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876823.234001:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1756 00010000:00010000:1.0:1788876823.721756:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876824.745747:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876825.064881:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876825.065000:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876825.065126:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392576 00000100:00100000:3.0:1788876825.065135:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392576 00000100:00100000:3.0:1788876825.065215:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1788876825.065228:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532392576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876825.065269:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788876825.067791:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876825.072579:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532392576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7344us (7569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876825.072598:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1788876825.081456:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392576:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788876825.536575:0:49739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:0.0:1788876825.774251:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876826.089041:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876826.089075:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876826.089171:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876826.089336:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392704 00000100:00100000:0.0:1788876826.089347:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392704 00000100:00100000:0.0:1788876826.089428:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788876826.089441:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532392704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876826.089480:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876826.089538:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532392704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876826.089545:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1788876826.089691:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532392704:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876826.089934:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876826.793212:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788876827.436348:0:49787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1788876827.626033:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532392832:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626129:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626181:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532393344:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626207:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626224:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532393856:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626242:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626257:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532394368:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626274:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626298:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788876827.626303:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532392960:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626326:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626341:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532393472:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626359:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626372:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532393984:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626389:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626416:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532393088:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626456:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626473:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532393600:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626496:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626513:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532394112:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626535:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626554:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788876827.626560:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532393216:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626584:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626827:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532393728:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626853:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626865:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532394240:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.626885:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876827.626925:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392832 00000100:00100000:0.0:1788876827.626936:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392832 00000100:00100000:0.0:1788876827.626990:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788876827.627000:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.627057:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532392832:12345-0@lo:400:kworker.0 Request processed in 58us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.627066:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788876827.627107:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393344 00000100:00100000:0.0:1788876827.627111:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393344 00000100:00100000:0.0:1788876827.627148:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393856 00000100:00100000:0.0:1788876827.627151:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393856 00000100:00100000:0.0:1788876827.627163:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394368 00000100:00100000:0.0:1788876827.627165:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394368 00000100:00100000:0.0:1788876827.627174:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393472 00000100:00100000:0.0:1788876827.627176:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393472 00000100:00100000:0.0:1788876827.627188:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393088 00000100:00100000:0.0:1788876827.627190:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393088 00000100:00100000:0.0:1788876827.627199:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393728 00000100:00100000:0.0:1788876827.627201:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393728 00000100:00100000:0.0:1788876827.627213:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1788876827.627218:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532393344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.627250:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532393344:12345-0@lo:400:kworker.0 Request processed in 32us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.627257:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:0.0:1788876827.627268:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788876827.627274:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532393856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.627300:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532393856:12345-0@lo:400:kworker.0 Request processed in 26us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.627305:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1788876827.627317:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1788876827.627322:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532394368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.627347:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532394368:12345-0@lo:400:kworker.0 Request processed in 25us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.627351:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1788876827.627361:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1788876827.627366:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532393472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.627390:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532393472:12345-0@lo:400:kworker.0 Request processed in 24us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.627395:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1788876827.627405:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1788876827.627410:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532393088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.628107:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393600 00000100:00100000:1.0:1788876827.628117:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393600 00000100:00100000:1.0:1788876827.628163:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394112 00000100:00100000:1.0:1788876827.628167:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394112 00000100:00100000:1.0:1788876827.628188:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393216 00000100:00100000:1.0:1788876827.628192:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393216 00000100:00100000:1.0:1788876827.628209:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394240 00000100:00100000:1.0:1788876827.628212:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394240 00000100:00100000:1.0:1788876827.628231:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788876827.628240:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532393600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876827.628998:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:2.0:1788876827.629015:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532394112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876827.631645:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788876827.631670:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.631977:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532393088:12345-0@lo:400:kworker.0 Request processed in 4563us (5516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.631990:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1788876827.632096:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1788876827.632108:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532394240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.632117:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532393600:12345-0@lo:400:kworker.0 Request processed in 3877us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876827.632125:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1788876827.632143:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532394240:12345-0@lo:400:kworker.0 Request processed in 40us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876827.632149:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1788876827.632157:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:1.0:1788876827.632168:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532393728:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788876827.632181:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876827.632187:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876827.632192:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876827.632195:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876827.632205:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532393728:12345-0@lo:400:kworker.0 Request processed in 40us (5350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876827.632211:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1788876827.632221:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532394496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876827.632233:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532392960 00000100:00100000:1.0:1788876827.632242:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532392960 00000100:00100000:0.0:1788876827.632266:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876827.632276:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532393984 00000100:00100000:1.0:1788876827.632279:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532393984 00000100:00100000:1.0:1788876827.632290:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394496 00000100:00100000:1.0:1788876827.632293:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394496 00000100:00100000:1.0:1788876827.632305:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1788876827.632310:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532392960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876827.632391:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532394112:12345-0@lo:400:kworker.0 Request processed in 3381us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876827.632399:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1788876827.632581:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532392960:12345-0@lo:400:kworker.0 Request processed in 269us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876827.632588:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1788876827.632618:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1788876827.632626:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532393984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.632659:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532393984:12345-0@lo:400:kworker.0 Request processed in 34us (6268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876827.632665:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1788876827.632678:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1788876827.632684:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532394496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876827.632714:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876827.632753:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532394496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876827.632759:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1788876827.633075:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532394496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876827.633998:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532392960:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634017:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532393472:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634026:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532393984:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634039:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532392832:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634053:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532393344:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634067:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532393856:0@lo:400:kworker.0 00000100:00100000:1.0:1788876827.634081:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532394368:0@lo:400:kworker.0 00000100:00100000:3.0:1788876827.634209:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532393216:12345-0@lo:400:kworker.0 Request processed in 2547us (7620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876827.634221:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1788876827.638025:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532393216:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.638050:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532393728:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.638065:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532394240:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.638078:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532393088:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.638091:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532393600:0@lo:400:kworker.0 00000100:00100000:0.0:1788876827.638107:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532394112:0@lo:400:kworker.0 00010000:00010000:0.0:1788876827.816922:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876828.138813:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532394752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876828.138813:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876828.138916:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876828.138934:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532394880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876828.147383:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876828.147862:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876828.147938:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394752 00000100:00100000:2.0:1788876828.147950:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394752 00000100:00100000:2.0:1788876828.148016:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1788876828.148029:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532394752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876828.148075:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876828.148141:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532394752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876828.148149:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1788876828.148208:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532394752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876828.151692:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394624 00000100:00100000:0.0:1788876828.151714:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394624 00000100:00100000:0.0:1788876828.151819:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1788876828.151831:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532394624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876828.151882:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:0.0:1788876828.152087:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532394624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 256us (4224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876828.152096:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1788876828.153275:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876828.153511:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532394624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876828.153646:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532394880 00000100:00100000:0.0:1788876828.153653:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532394880 00000100:00100000:0.0:1788876828.153710:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1788876828.153721:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532394880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876828.153752:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876828.153900:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532394880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876828.153909:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1788876828.154354:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532394880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876828.337333:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876828.337387:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876828.337425:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876828.337465:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876828.337490:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876828.337695:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273856 00000100:00100000:3.0:1788876828.337710:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273856 00000100:00100000:3.0:1788876828.337799:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1788876828.337814:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511273856:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876828.337934:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511273856:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 124us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876828.337944:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1788876828.341167:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274112 00000100:00100000:1.0:1788876828.341189:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274112 00000100:00100000:1.0:1788876828.341293:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511273984 00000100:00100000:1.0:1788876828.341297:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511273984 00000100:00100000:1.0:1788876828.341333:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1763 00000100:00100000:1.0:1788876828.341345:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511274112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876828.341452:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511274112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 107us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876828.341460:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1763 00000100:00100000:1.0:1788876828.341481:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1764 00000100:00100000:1.0:1788876828.341488:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511273984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876828.341517:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511273984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876828.341523:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1764 00000100:00080000:3.0:1788876828.342097:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788876828.342104:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876828.342517:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274368 00000100:00100000:2.0:1788876828.342527:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274368 00000100:00100000:2.0:1788876828.342583:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274240 00000100:00100000:2.0:1788876828.342588:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274240 00000100:00080000:3.0:1788876828.342597:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876828.342653:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1323 00000100:00100000:2.0:1788876828.342663:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511274368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1788876828.342668:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876828.342731:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511274368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (5299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876828.342738:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1324 00000100:00100000:2.0:1788876828.342755:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1323 00000100:00100000:3.0:1788876828.342894:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511274240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876828.343000:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511274240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 243us (5507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876828.343010:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1324 00010000:00010000:0.0:1788876828.841088:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876829.331054:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.332062:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274496 00000100:00100000:2.0:1788876829.332081:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274496 00000100:00100000:2.0:1788876829.332177:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2569 00000100:00100000:2.0:1788876829.332192:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37798:x1875771511274496:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876829.332263:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446256640 avail 1300017152 00000100:00100000:2.0:1788876829.332379:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37798:x1875771511274496:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 192us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.332388:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2569 00000100:00100000:0.0:1788876829.334511:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.334660:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274624 00000100:00100000:1.0:1788876829.334670:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274624 00000100:00100000:1.0:1788876829.334731:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2570 00000100:00100000:1.0:1788876829.334741:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37798:x1875771511274624:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876829.334788:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876829.334861:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:37798:x1875771511274624:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 122us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876829.334869:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2570 00000100:00100000:3.0:1788876829.338103:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.338213:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274752 00000100:00100000:2.0:1788876829.338223:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274752 00000100:00100000:2.0:1788876829.338283:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1056 00000100:00100000:2.0:1788876829.338293:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37798:x1875771511274752:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876829.338318:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876829.338390:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37798:x1875771511274752:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.338397:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1056 00000100:00100000:0.0:1788876829.351207:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.351286:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511274880 00000100:00100000:2.0:1788876829.351295:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511274880 00000100:00100000:2.0:1788876829.351346:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1057 00000100:00100000:2.0:1788876829.351356:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37798:x1875771511274880:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876829.351382:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876829.351449:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37798:x1875771511274880:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.351457:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1057 00000100:00100000:0.0:1788876829.401942:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.402240:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511275008 00000100:00100000:1.0:1788876829.402249:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511275008 00000100:00100000:1.0:1788876829.402321:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2571 00000100:00100000:1.0:1788876829.402331:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:37815:x1875771511275008:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:1.0:1788876829.402351:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876829.402375:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35e00/0xf5bf0f7e313af8dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704893c expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402442:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402458:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402472:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402853:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402861:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402869:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402967:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402976:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.402983:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876829.403030:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00000004:00200000:1.0:1788876829.403033:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876829.403078:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403090:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403097:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403103:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403114:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876829.403118:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403127:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403139:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:1.0:1788876829.403142:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876829.403148:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403153:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313af8e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403168:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403173:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403179:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403183:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876829.403255:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403263:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403275:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13f4518a00) 00010000:00010000:1.0:1788876829.403277:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876829.403281:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403287:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35c00/0xf5bf0f7e313af8ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403324:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35e00/0xf5bf0f7e313af8dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704893c expref: 9 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403338:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704893c expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.403344:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876829.403347:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876829.403350:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73a00, rc 0) 00000100:00100000:1.0:1788876829.403551:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37815:x1875771511275008:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 1220us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876829.403559:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2571 00000100:00100000:3.0:1788876829.424157:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.424328:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511275136 00000100:00100000:2.0:1788876829.424341:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511275136 00000100:00100000:2.0:1788876829.424413:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2572 00000100:00100000:2.0:1788876829.424424:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:37816:x1875771511275136:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:2.0:1788876829.424449:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876829.424474:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af8f8 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048943 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424552:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424567:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424577:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424590:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424596:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424636:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424720:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424934:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.424944:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876829.424991:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10e:0x0]: returning size 0 00000004:00200000:2.0:1788876829.424995:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876829.425018:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425029:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425038:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425044:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425050:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425055:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8cc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876829.425059:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425066:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425077:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:2.0:1788876829.425079:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876829.425083:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425090:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af8ff lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425103:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425110:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425115:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425121:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ca00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876829.425124:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425130:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425137:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13fa4ad600) 00010000:00010000:2.0:1788876829.425139:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876829.425142:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425148:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af906 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425187:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af8f8 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048943 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425213:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048943 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.425221:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10e:0x0].0x0 (ffff8a13fa4add00) 00010000:00010000:2.0:1788876829.425224:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788876829.425227:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8ce00, rc 0) 00000100:00100000:2.0:1788876829.425299:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:37816:x1875771511275136:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 876us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.425305:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2572 00000100:00100000:0.0:1788876829.444282:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.444387:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511275392 00000100:00100000:1.0:1788876829.444399:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511275392 00000100:00100000:1.0:1788876829.444465:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2573 00000100:00100000:1.0:1788876829.444485:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:37819:x1875771511275392:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876829.444511:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876829.444536:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704894a expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876829.444671:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00010000:00010000:1.0:1788876829.444817:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af914 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704894a expref: 11 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.444832:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:1.0:1788876829.444835:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788876829.444841:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704894a expref: 11 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.444854:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72a00, rc 0) 00000100:00100000:1.0:1788876829.444915:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:37819:x1875771511275392:12345-192.168.203.11@tcp:101:rm.0 Request processed in 440us (646us total) trans 81604378625 rc 301/301 00000100:00100000:1.0:1788876829.444922:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2573 00000100:00100000:0.0:1788876829.456245:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.456340:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511275520 00000100:00100000:2.0:1788876829.456350:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511275520 00000100:00100000:2.0:1788876829.456406:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 739 00000100:00100000:2.0:1788876829.456417:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:37819:x1875771511275520:12345-192.168.203.11@tcp:37:rm.0 00000100:00100000:2.0:1788876829.461124:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:37819:x1875771511275520:12345-192.168.203.11@tcp:37:rm.0 Request processed in 4698us (4878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.461137:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 739 00000100:00100000:0.0:1788876829.479550:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.479660:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511275776 00000100:00100000:1.0:1788876829.479670:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511275776 00000100:00100000:1.0:1788876829.479736:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 740 00000100:00100000:1.0:1788876829.479746:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c796d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:37819:x1875771511275776:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:1.0:1788876829.479998:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c796d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+11:37819:x1875771511275776:12345-192.168.203.11@tcp:35:rm.0 Request processed in 252us (455us total) trans 81604378626 rc 0/0 00000100:00100000:1.0:1788876829.480006:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 740 00000100:00100000:0.0:1788876829.485527:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.485941:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511276032 00000100:00100000:1.0:1788876829.485953:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511276032 00000100:00100000:1.0:1788876829.486086:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2574 00000100:00100000:1.0:1788876829.486097:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+11:37819:x1875771511276032:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876829.486122:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876829.486150:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048951 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.486282:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313af929 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.486299:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313af929 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.486311:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313af929 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876829.486323:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00010000:00010000:1.0:1788876829.486440:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048951 expref: 14 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.486462:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313af929 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048951 expref: 13 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.486472:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876829.486485:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788876829.486489:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72200, rc 0) 00000100:00100000:1.0:1788876829.486564:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+13:37819:x1875771511276032:12345-192.168.203.11@tcp:101:rm.0 Request processed in 469us (1048us total) trans 81604378627 rc 0/0 00000100:00100000:1.0:1788876829.486572:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2574 00000100:00100000:3.0:1788876829.497242:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.497389:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511276288 00000100:00100000:2.0:1788876829.497399:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511276288 00000100:00100000:2.0:1788876829.497452:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2575 00000100:00100000:2.0:1788876829.497462:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+13:37819:x1875771511276288:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876829.497529:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876829.497556:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af90d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048943 expref: 13 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497575:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10e:0x0].0x0 (ffff8a13fa4add00) 00010000:00010000:2.0:1788876829.497591:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313af8f1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704893c expref: 12 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497629:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:2.0:1788876829.497633:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876829.497654:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497667:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497677:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497691:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497699:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497705:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497933:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497942:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.497953:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498144:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498153:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498161:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498168:0:6541:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498174:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.498180:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.499625:0:6541:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876829.499722:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876829.499739:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876829.499748:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876829.499752:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876829.499768:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876829.499782:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10e:0x0].0x0 (ffff8a13fa4ad500) 00010000:00010000:0.0:1788876829.499784:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876829.499789:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876829.499794:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af94c lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x10e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876829.499810:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876829.499812:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876829.499814:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876829.505242:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505257:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505264:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505270:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8cc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876829.505273:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505280:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505296:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10e:0x0].0x0 (ffff8a13fa4ad500) 00010000:00010000:3.0:1788876829.505299:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876829.505304:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505310:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8cc00/0xf5bf0f7e313af945 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505345:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505352:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505357:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505367:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8de00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876829.505371:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505377:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505386:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:3.0:1788876829.505388:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876829.505391:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505395:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8de00/0xf5bf0f7e313af937 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x10c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876829.505406:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073311237 reply state 0000000008820794 transno 81604378628 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505417:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876829.505425:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13fa4ad600) 00010000:00010000:3.0:1788876829.505427:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876829.505431:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876829.505544:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+13:37819:x1875771511276288:12345-192.168.203.11@tcp:36:rm.0 Request processed in 8079us (8307us total) trans 81604378628 rc 0/0 00000100:00100000:3.0:1788876829.505552:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2575 00000100:00100000:0.0:1788876829.508030:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.508120:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511276416 00000100:00100000:2.0:1788876829.508132:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511276416 00000100:00100000:2.0:1788876829.508203:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2576 00000100:00100000:2.0:1788876829.508213:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+13:37819:x1875771511276416:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876829.508236:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876829.508255:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048958 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508329:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508345:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508357:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508370:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508375:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508381:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508471:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508480:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508487:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876829.508526:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00000004:00200000:2.0:1788876829.508530:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876829.508549:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508564:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508570:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508576:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508582:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8dc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876829.508586:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508594:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508839:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:2.0:1788876829.508844:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876829.508850:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508856:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313af95a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508868:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508873:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508878:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508883:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876829.508886:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508892:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508900:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13fa4add00) 00010000:00010000:2.0:1788876829.508902:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876829.508905:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508910:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313af961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508942:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313af953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048958 expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508955:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048958 expref: 14 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876829.508962:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:2.0:1788876829.508965:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876829.508967:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8d400, rc 0) 00000100:00100000:2.0:1788876829.509028:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+14:37819:x1875771511276416:12345-192.168.203.11@tcp:101:rm.0 Request processed in 816us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876829.509035:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2576 00000100:00100000:0.0:1788876829.517053:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876829.517133:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511276672 00000100:00100000:2.0:1788876829.517142:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511276672 00000100:00100000:2.0:1788876829.517208:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 741 00000100:00100000:2.0:1788876829.517219:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+14:37819:x1875771511276672:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:2.0:1788876829.517453:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+15:37819:x1875771511276672:12345-192.168.203.11@tcp:35:rm.0 Request processed in 236us (409us total) trans 81604378629 rc 0/0 00000100:00100000:2.0:1788876829.517460:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 741 00000100:00100000:3.0:1788876829.521176:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876829.521324:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511276928 00000100:00100000:1.0:1788876829.521334:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511276928 00000100:00100000:1.0:1788876829.521403:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2577 00000100:00100000:1.0:1788876829.521415:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+15:37819:x1875771511276928:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1788876829.521483:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788876829.521511:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313af968 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048958 expref: 15 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521537:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313af929 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x10c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048951 expref: 14 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521547:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876829.521563:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313af8d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048935 expref: 13 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521572:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55700) 00010000:00010000:1.0:1788876829.521578:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876829.521640:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521653:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521662:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521675:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521682:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521689:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521891:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521900:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.521907:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876829.522155:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10c:0x0]: returning size 4096 00010000:00010000:1.0:1788876829.522172:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522179:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522185:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522373:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876829.522377:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522386:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522396:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x0 (ffff8a13f4518300) 00010000:00010000:1.0:1788876829.522399:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876829.522403:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522414:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313af97d lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522434:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522440:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522446:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522451:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876829.522454:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522460:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522467:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518a00) 00010000:00010000:1.0:1788876829.522469:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876829.522472:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522477:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313af96f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876829.522488:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4534412 reply state 0000000011a711df transno 81604378630 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522499:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876829.522505:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13f4518f00) 00010000:00010000:1.0:1788876829.522507:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876829.522510:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876829.522686:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+14:37819:x1875771511276928:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1271us (1517us total) trans 81604378630 rc 0/0 00000100:00100000:1.0:1788876829.522695:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2577 00010000:00010000:0.0:1788876829.867929:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876830.184909:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532395008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876830.184984:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876830.185120:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395008 00000100:00100000:1.0:1788876830.185129:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395008 00000100:00100000:1.0:1788876830.185189:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1788876830.185199:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532395008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876830.185227:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876830.185280:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532395008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876830.185287:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:3.0:1788876830.185355:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876830.185484:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532395008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876830.893180:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876831.209286:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876831.209311:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532395136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876831.209395:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876831.209468:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395136 00000100:00100000:2.0:1788876831.209477:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395136 00000100:00100000:2.0:1788876831.209540:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1788876831.209550:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532395136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876831.209582:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876831.209648:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532395136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876831.209656:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:2.0:1788876831.209675:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876831.209719:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532395136:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876831.912871:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876832.744927:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876832.744953:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532395264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876832.745020:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745328:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532395648:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.745359:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745382:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532396160:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.745406:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745422:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.745442:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745476:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876832.745482:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532395776:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.745508:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745526:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532396288:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.745544:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.745560:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532396800:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.745763:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532395392:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.745807:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876832.745833:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532395904:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.745860:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532395520:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.745884:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876832.745902:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532396032:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.745937:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396160 00000100:00100000:0.0:1788876832.745947:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396160 00000100:00100000:0.0:1788876832.746003:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396672 00000100:00100000:0.0:1788876832.746007:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396672 00000100:00100000:0.0:1788876832.746025:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395776 00000100:00100000:0.0:1788876832.746028:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395776 00000100:00100000:0.0:1788876832.746048:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788876832.746062:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.746120:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532396160:12345-0@lo:400:kworker.0 Request processed in 62us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746127:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788876832.746145:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1788876832.746151:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532396672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.746177:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532396672:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746183:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1788876832.746193:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788876832.746200:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532395776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.746225:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532395776:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746231:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788876832.746254:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395392 00000100:00100000:0.0:1788876832.746258:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395392 00000100:00100000:0.0:1788876832.746284:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788876832.746290:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efe1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532395392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.746330:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efe1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532395392:12345-0@lo:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746342:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788876832.746375:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395264 00000100:00100000:0.0:1788876832.746379:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395264 00000100:00100000:0.0:1788876832.746405:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395520 00000100:00100000:0.0:1788876832.746408:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395520 00000100:00100000:0.0:1788876832.746424:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1788876832.746431:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532395264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876832.746539:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876832.746576:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532395264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746705:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1788876832.746718:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1788876832.746728:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532395520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.746774:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532395520:12345-0@lo:400:kworker.0 Request processed in 50us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876832.746781:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00080000:0.0:1788876832.746798:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876832.746867:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395648 00000100:00100000:0.0:1788876832.746871:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395648 00000100:00100000:0.0:1788876832.746899:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396288 00000100:00100000:0.0:1788876832.746902:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396288 00000100:00100000:1.0:1788876832.746959:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.747013:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532396160:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747026:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747042:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532395264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876832.747086:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532395776:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747108:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396800 00000100:00100000:1.0:1788876832.747110:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396800 00000100:00100000:1.0:1788876832.747136:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:1.0:1788876832.747143:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532395648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747179:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532395648:12345-0@lo:400:kworker.0 Request processed in 37us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747188:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:1.0:1788876832.747202:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1788876832.747207:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747235:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532396288:12345-0@lo:400:kworker.0 Request processed in 28us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747241:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1788876832.747250:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:1.0:1788876832.747259:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747291:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532396800:12345-0@lo:400:kworker.0 Request processed in 32us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747297:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:1.0:1788876832.747313:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.747340:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532396544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747365:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.747398:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532395520:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747415:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396032 00000100:00100000:1.0:1788876832.747417:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396032 00000100:00100000:1.0:1788876832.747434:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:1.0:1788876832.747440:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532396032:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788876832.747536:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876832.747540:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876832.747563:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876832.747692:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532396032:12345-0@lo:400:kworker.0 Request processed in 252us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747699:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:1.0:1788876832.747713:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532395904 00000100:00100000:1.0:1788876832.747717:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532395904 00000100:00100000:1.0:1788876832.747751:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:1.0:1788876832.747757:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532395904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747790:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532395904:12345-0@lo:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747796:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:1.0:1788876832.747815:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396544 00000100:00100000:1.0:1788876832.747818:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396544 00000100:00100000:1.0:1788876832.747840:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1788876832.747846:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532396544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.747874:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532396544:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876832.747880:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00080000:1.0:1788876832.747897:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876832.747944:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532395904:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.747951:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532396416:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.748105:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876832.748155:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876832.748177:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532396032:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.748190:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532396544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.748230:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532396288:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.748243:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532396800:0@lo:400:kworker.0 00000100:00100000:1.0:1788876832.748256:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532395648:0@lo:400:kworker.0 00000100:00100000:0.0:1788876832.749081:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532395392:0@lo:400:kworker.0 00000100:00100000:3.0:1788876832.757941:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396416 00000100:00100000:3.0:1788876832.757961:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396416 00000100:00100000:3.0:1788876832.758048:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1788876832.758058:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532396416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876832.758159:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532396416:12345-0@lo:400:kworker.0 Request processed in 102us (10053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876832.758357:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1788876832.758425:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532396416:0@lo:400:kworker.0 00000100:00080000:0.0:1788876832.758490:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876832.937808:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876833.257664:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532396928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876833.257767:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876833.258222:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876833.258239:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532397056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876833.258297:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876833.258428:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397056 00000100:00100000:0.0:1788876833.258442:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397056 00000100:00100000:2.0:1788876833.258574:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532396928 00000100:00100000:2.0:1788876833.258583:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532396928 00000100:00100000:2.0:1788876833.258676:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1788876833.258690:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532396928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876833.258749:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876833.258800:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532396928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876833.258807:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1788876833.258869:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532396928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876833.258893:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1788876833.258902:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532397056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876833.258922:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876833.258969:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532397056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876833.258975:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1788876833.259038:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532397056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876833.261750:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876833.261772:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876833.261844:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876833.262045:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397184 00000100:00100000:2.0:1788876833.262053:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397184 00000100:00100000:2.0:1788876833.262110:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788876833.262120:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532397184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876833.262149:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876833.262204:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532397184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876833.262211:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1788876833.262811:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876833.457596:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876833.457726:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876833.457774:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876833.457808:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876833.457833:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876833.457860:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277312 00000100:00100000:3.0:1788876833.457869:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277312 00000100:00100000:3.0:1788876833.457925:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277184 00000100:00100000:3.0:1788876833.457928:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277184 00000100:00100000:3.0:1788876833.457949:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1771 00000100:00100000:3.0:1788876833.457958:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511277312:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876833.458126:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277568 00000100:00100000:2.0:1788876833.458131:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277568 00000100:00100000:2.0:1788876833.458158:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277440 00000100:00100000:2.0:1788876833.458160:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277440 00000100:00100000:2.0:1788876833.458176:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1329 00000100:00100000:2.0:1788876833.458183:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511277568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876833.458219:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511277568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876833.458226:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1329 00000100:00100000:2.0:1788876833.458241:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1330 00000100:00100000:2.0:1788876833.458247:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511277440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876833.458267:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511277440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876833.458285:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1330 00000100:00100000:2.0:1788876833.458321:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1772 00000100:00100000:2.0:1788876833.458329:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+14:2395:x1875771511277184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876833.458358:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+14:2395:x1875771511277184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876833.458364:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1772 00000100:00100000:3.0:1788876833.458700:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511277312:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 742us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876833.458708:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1771 00000100:00100000:0.0:1788876833.458836:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277056 00000100:00100000:0.0:1788876833.458842:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277056 00000100:00100000:0.0:1788876833.458880:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1788876833.458887:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efe1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511277056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876833.458913:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efe1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511277056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876833.458923:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00080000:0.0:1788876833.458952:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876833.458956:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876833.458959:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876833.458961:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876833.965026:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876834.985829:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876835.305736:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876835.305758:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532397312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876835.305828:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876835.305998:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397312 00000100:00100000:1.0:1788876835.306007:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397312 00000100:00100000:1.0:1788876835.306066:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1788876835.306075:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532397312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876835.306103:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876835.306152:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532397312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876835.306159:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1788876835.306201:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532397312:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876835.306266:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788876835.310406:0:49157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 81604378630 is committed 00010000:00010000:2.0:1788876835.310632:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310650:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310659:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310664:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ca00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876835.310669:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310676:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310694:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10c:0x0].0x4aece201 (ffff8a13fa4ad600) 00010000:00010000:2.0:1788876835.310697:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876835.310702:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310707:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ca00/0xf5bf0f7e313af93e lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x10c:0x0].0x4aece201 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310745:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310752:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310761:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310766:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876835.310768:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310773:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310781:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8085fce3 (ffff8a13f4518f00) 00010000:00010000:2.0:1788876835.310784:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876835.310786:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876835.310792:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313af976 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8085fce3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876836.009782:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876836.330947:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532397440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876836.331021:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876836.331167:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397440 00000100:00100000:2.0:1788876836.331176:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397440 00000100:00100000:2.0:1788876836.331243:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1788876836.331253:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532397440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876836.331294:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876836.331342:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532397440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876836.331348:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1788876836.331796:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532397440:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788876836.332456:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788876836.523369:0:49982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 8: creat open |X| close ============ 10:13:55 (1788876835) 00010000:00010000:1.0:1788876837.032764:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876837.406761:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876837.406836:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277696 00000100:00100000:0.0:1788876837.406846:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277696 00000100:00100000:0.0:1788876837.406918:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2578 00000100:00100000:0.0:1788876837.406928:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38411:x1875771511277696:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1788876837.406951:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876837.406975:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704895f expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407036:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407052:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407067:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876837.407117:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876837.407122:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876837.407142:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407166:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704895f expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407184:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704895f expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.407193:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77400) 00010000:00010000:0.0:1788876837.407197:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876837.407200:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586600, rc 0) 00000100:00100000:0.0:1788876837.407256:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38411:x1875771511277696:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 329us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876837.407263:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2578 00000100:00080000:2.0:1788876837.407426:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876837.433384:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876837.434619:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277824 00000100:00100000:2.0:1788876837.434630:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277824 00000100:00100000:2.0:1788876837.434684:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2579 00000100:00100000:2.0:1788876837.434694:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38411:x1875771511277824:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876837.434737:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876837.434802:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38411:x1875771511277824:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 109us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876837.434810:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2579 00000100:00100000:0.0:1788876837.452153:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876837.452724:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511277952 00000100:00100000:1.0:1788876837.452735:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511277952 00000100:00100000:1.0:1788876837.452835:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2580 00000100:00100000:1.0:1788876837.452845:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38411:x1875771511277952:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876837.452880:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876837.452948:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38411:x1875771511277952:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 104us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.458223:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2580 00000100:00080000:2.0:1788876837.458337:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876837.472983:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876837.473014:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278080 00000100:00100000:2.0:1788876837.473023:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278080 00000100:00100000:2.0:1788876837.473074:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1064 00000100:00100000:2.0:1788876837.473083:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38411:x1875771511278080:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876837.473117:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876837.473170:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38411:x1875771511278080:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 87us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876837.473176:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1064 00000100:00080000:2.0:1788876837.473197:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876837.479065:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876837.484787:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278208 00000100:00100000:2.0:1788876837.484799:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278208 00000100:00100000:2.0:1788876837.484863:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1065 00000100:00100000:2.0:1788876837.484873:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38411:x1875771511278208:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876837.484904:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876837.484984:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38411:x1875771511278208:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 111us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876837.484991:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1065 00000100:00080000:2.0:1788876837.485015:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876837.542528:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876837.542674:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278464 00000100:00100000:3.0:1788876837.542691:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278464 00000100:00100000:3.0:1788876837.542786:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2581 00000100:00100000:3.0:1788876837.542799:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38418:x1875771511278464:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:3.0:1788876837.542877:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876837.542941:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313af98b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704895f expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.542971:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77400) 00010000:00010000:3.0:1788876837.542986:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876837.543105:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543122:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543134:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543148:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543161:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543169:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543781:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543794:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543801:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543808:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876837.543814:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543824:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543837:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55d00) 00010000:00010000:3.0:1788876837.543840:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876837.543845:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543852:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af992 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876837.543874:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007f9bb9f reply state 000000009b2d2bb3 transno 81604378631 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543887:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.543893:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a12c1a55400) 00010000:00010000:3.0:1788876837.543896:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876837.543899:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788876837.544040:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38418:x1875771511278464:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1241us (1520us total) trans 81604378631 rc 0/0 00000100:00100000:3.0:1788876837.544048:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2581 00000100:00100000:2.0:1788876837.578152:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876837.578298:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278592 00000100:00100000:1.0:1788876837.578309:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278592 00000100:00100000:1.0:1788876837.578375:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2582 00000100:00100000:1.0:1788876837.578386:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38421:x1875771511278592:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876837.578414:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876837.578442:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72600/0xf5bf0f7e313af9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048966 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578519:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578536:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578549:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876837.578620:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876837.578624:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876837.578644:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578669:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72600/0xf5bf0f7e313af9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048966 expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578690:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048966 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.578700:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876837.578703:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876837.578717:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72c00, rc 0) 00000100:00100000:1.0:1788876837.578779:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:38421:x1875771511278592:12345-192.168.203.11@tcp:101:rm.0 Request processed in 395us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.578787:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2582 00000100:00100000:2.0:1788876837.581737:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876837.581863:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278720 00000100:00100000:1.0:1788876837.581875:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278720 00000100:00100000:1.0:1788876837.581941:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2583 00000100:00100000:1.0:1788876837.581952:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:38421:x1875771511278720:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876837.581970:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876837.581991:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313af9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704896d expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582051:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582066:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582079:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582101:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582111:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582118:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582214:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582224:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582232:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876837.582282:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x10f:0x0]: returning size 0 00000004:00200000:1.0:1788876837.582286:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876837.582305:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582317:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582325:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582332:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582338:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582348:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876837.582353:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582361:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582373:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:1.0:1788876837.582376:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876837.582381:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582388:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313af9b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582402:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582408:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582415:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582421:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876837.582423:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582430:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582442:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a12c1a55400) 00010000:00010000:1.0:1788876837.582444:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876837.582447:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582453:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313af9bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582477:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313af9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704896d expref: 11 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582491:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704896d expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876837.582498:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10f:0x0].0x0 (ffff8a13f4518800) 00010000:00010000:1.0:1788876837.582500:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788876837.582502:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73400, rc 0) 00000100:00100000:1.0:1788876837.582569:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:38421:x1875771511278720:12345-192.168.203.11@tcp:101:rm.0 Request processed in 618us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.582576:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2583 00000100:00100000:2.0:1788876837.587314:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876837.587449:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278976 00000100:00100000:3.0:1788876837.587459:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278976 00000100:00100000:3.0:1788876837.587528:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2584 00000100:00100000:3.0:1788876837.587540:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:38421:x1875771511278976:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788876837.587636:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788876837.587665:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313af9c3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x10f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704896d expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587687:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10f:0x0].0x0 (ffff8a13f4518800) 00010000:00010000:3.0:1788876837.587702:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313af9a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048966 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587722:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13f4518e00) 00010000:00010000:3.0:1788876837.587728:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788876837.587752:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587766:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587777:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587788:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587796:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587803:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587887:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587896:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876837.587904:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588490:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588502:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588512:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588522:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588529:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588536:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588555:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876837.588577:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588585:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588593:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588631:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876837.588637:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588646:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588656:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10f:0x0].0x0 (ffff8a12c1a55500) 00010000:00010000:2.0:1788876837.588660:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876837.588663:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588670:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313af9d8 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588686:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588692:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588698:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588714:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876837.588717:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588724:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588731:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a12c1a55d00) 00010000:00010000:2.0:1788876837.588733:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876837.588735:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588741:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313af9ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876837.588756:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8bcf54c reply state 000000007924b0dc transno 81604378632 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588767:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876837.588773:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a12c1a55400) 00010000:00010000:2.0:1788876837.588775:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876837.588778:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788876837.588825:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876837.588834:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.588839:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876837.588842:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.588849:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.588858:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10f:0x0].0x0 (ffff8a12c1a55500) 00000100:00100000:2.0:1788876837.588858:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:38421:x1875771511278976:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1320us (1553us total) trans 81604378632 rc 0/0 00010000:00010000:0.0:1788876837.588861:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876837.588864:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876837.588866:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2584 00010000:00010000:0.0:1788876837.588869:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313af9df lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x10f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876837.588881:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876837.588883:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876837.588884:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876837.864935:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876837.864958:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532397568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876837.865024:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.865086:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397568 00000100:00100000:1.0:1788876837.865092:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397568 00000100:00100000:1.0:1788876837.865133:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1788876837.865142:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532397568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876837.865171:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876837.865216:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532397568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.865223:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1788876837.865265:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532397568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876837.868754:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.868922:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.868962:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.868990:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869009:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869030:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869052:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876837.869058:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869081:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869098:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532398336:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869118:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869134:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532398848:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869155:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869185:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869206:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869222:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532398592:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869240:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869254:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532399104:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869275:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869290:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788876837.869295:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532397952:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869315:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869325:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532398464:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869344:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869368:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532398976:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869387:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876837.869415:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397696 00000100:00100000:1.0:1788876837.869422:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397696 00000100:00100000:1.0:1788876837.869468:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788876837.869476:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869521:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532397696:12345-0@lo:400:kworker.0 Request processed in 45us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869528:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788876837.869560:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398208 00000100:00100000:1.0:1788876837.869563:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398208 00000100:00100000:1.0:1788876837.869591:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398720 00000100:00100000:1.0:1788876837.869594:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398720 00000100:00100000:1.0:1788876837.869630:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398336 00000100:00100000:1.0:1788876837.869633:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398336 00000100:00100000:1.0:1788876837.869644:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398592 00000100:00100000:1.0:1788876837.869647:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398592 00000100:00100000:1.0:1788876837.869656:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399104 00000100:00100000:1.0:1788876837.869658:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399104 00000100:00100000:1.0:1788876837.869666:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397952 00000100:00100000:1.0:1788876837.869669:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397952 00000100:00100000:1.0:1788876837.869681:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1788876837.869687:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532398208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869731:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532398208:12345-0@lo:400:kworker.0 Request processed in 44us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869738:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:1.0:1788876837.869750:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788876837.869757:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869783:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532398720:12345-0@lo:400:kworker.0 Request processed in 27us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869789:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788876837.869800:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788876837.869806:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869831:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532398336:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869838:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788876837.869848:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1788876837.869854:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532398592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869883:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532398592:12345-0@lo:400:kworker.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869889:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:1.0:1788876837.869900:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788876837.869906:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532399104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869933:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532399104:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869939:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1788876837.869949:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1788876837.869955:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.869978:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532397952:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.869984:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1788876837.870006:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532397824 00000100:00100000:1.0:1788876837.870010:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532397824 00000100:00100000:1.0:1788876837.870032:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788876837.870038:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.870068:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532397824:12345-0@lo:400:kworker.0 Request processed in 29us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.870073:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788876837.870094:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398848 00000100:00100000:1.0:1788876837.870097:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398848 00000100:00100000:1.0:1788876837.870123:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398080 00000100:00100000:1.0:1788876837.870127:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398080 00000100:00100000:1.0:1788876837.870141:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398464 00000100:00100000:1.0:1788876837.870144:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398464 00000100:00100000:1.0:1788876837.870160:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532398976 00000100:00100000:1.0:1788876837.870162:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532398976 00000100:00100000:1.0:1788876837.870179:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1788876837.870184:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.870786:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788876837.870798:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876837.871119:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1788876837.871129:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532398464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872675:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532398080:12345-0@lo:400:kworker.0 Request processed in 1876us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876837.872688:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788876837.872726:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1788876837.872737:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872778:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532398976:12345-0@lo:400:kworker.0 Request processed in 44us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876837.872784:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1788876837.872844:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532397824:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872859:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532398336:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872871:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532397696:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872883:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532398208:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.872894:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532398720:0@lo:400:kworker.0 00000100:00080000:0.0:1788876837.873213:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876837.873218:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876837.873222:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876837.873225:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876837.873251:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532397952:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.873264:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.873276:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532398080:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.873288:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532398592:0@lo:400:kworker.0 00000100:00100000:0.0:1788876837.873301:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532399104:0@lo:400:kworker.0 00000100:00100000:1.0:1788876837.877933:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532398848:12345-0@lo:400:kworker.0 Request processed in 7738us (8766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876837.877948:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:0.0:1788876837.878093:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532398848:0@lo:400:kworker.0 00000100:00100000:3.0:1788876837.878695:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efeced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532398464:12345-0@lo:400:kworker.0 Request processed in 7567us (9348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876837.878715:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788876837.878927:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532398464:0@lo:400:kworker.0 00010000:00010000:0.0:1788876838.058115:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876838.377996:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532399232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876838.378063:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876838.378128:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399232 00000100:00100000:3.0:1788876838.378136:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399232 00000100:00100000:3.0:1788876838.378182:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788876838.378192:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532399232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876838.378226:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876838.378271:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532399232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876838.378278:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788876838.378386:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532399232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876838.383867:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876838.383895:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c1a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876838.383979:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876838.384067:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399360 00000100:00100000:2.0:1788876838.384076:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399360 00000100:00100000:2.0:1788876838.384131:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1788876838.384139:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532399360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876838.384160:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876838.384205:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532399360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876838.384212:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788876838.384291:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c1a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876838.384481:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876838.388756:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876838.388825:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876838.390644:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399488 00000100:00100000:2.0:1788876838.390660:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399488 00000100:00100000:2.0:1788876838.390725:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1788876838.390736:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532399488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876838.390773:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876838.390856:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532399488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876838.390862:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1788876838.391033:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876838.578894:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876838.578941:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876838.578987:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876838.579051:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279232 00000100:00100000:0.0:1788876838.579064:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279232 00000100:00100000:3.0:1788876838.579068:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279488 00000100:00100000:3.0:1788876838.579091:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279488 00000100:00100000:0.0:1788876838.579145:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1779 00000100:00100000:0.0:1788876838.579162:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2395:x1875771511279232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876838.579169:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1335 00000100:00100000:3.0:1788876838.579188:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511279488:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:0.0:1788876838.579217:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c1a17b80 x1875771511279232/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:234/0 lens 224/224 e 0 to 0 dl 1788876849 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876838.579285:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511279488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876838.579294:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1335 00000100:00100000:1.0:1788876838.579866:0:49164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279104 00000100:00100000:1.0:1788876838.579873:0:49164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279104 00000100:00100000:1.0:1788876838.579908:0:49164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:1.0:1788876838.579916:0:49164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511279104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876838.580407:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2395:x1875771511279232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1249us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876838.580417:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1779 00000100:00100000:1.0:1788876838.581444:0:49164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511279104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1521us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876838.581456:0:49164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:3.0:1788876838.583945:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876838.583991:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876838.584129:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279360 00000100:00100000:1.0:1788876838.584143:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279360 00000100:00100000:1.0:1788876838.584202:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1780 00000100:00100000:1.0:1788876838.584211:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511279360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876838.584277:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511279360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876838.584283:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1780 00000100:00100000:1.0:1788876838.584366:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279616 00000100:00100000:1.0:1788876838.584371:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279616 00000100:00100000:1.0:1788876838.584400:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1336 00000100:00100000:1.0:1788876838.584408:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511279616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876838.584435:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511279616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876838.584441:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1336 00010000:00010000:2.0:1788876839.084930:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876840.110131:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876840.424898:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532399616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876840.424999:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876840.425180:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399616 00000100:00100000:1.0:1788876840.425191:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399616 00000100:00100000:1.0:1788876840.425255:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1788876840.425263:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532399616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876840.425297:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876840.425347:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532399616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876840.425356:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:2.0:1788876840.425514:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876840.425567:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532399616:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788876841.134660:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876841.451175:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876841.451198:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532399744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876841.451273:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876841.451425:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399744 00000100:00100000:2.0:1788876841.451433:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399744 00000100:00100000:2.0:1788876841.451489:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1788876841.451499:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532399744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876841.451528:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876841.451576:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532399744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876841.451582:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00080000:2.0:1788876841.451620:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876841.451654:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532399744:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876842.153504:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876842.984845:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532399872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876842.984914:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.985102:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532399872 00000100:00100000:0.0:1788876842.985110:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532399872 00000100:00100000:0.0:1788876842.985162:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1788876842.985171:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532399872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876842.985205:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876842.985253:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532399872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.985260:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1788876842.985301:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532399872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876842.985647:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985691:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985715:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532400640:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985740:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985756:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532401152:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985777:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985793:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788876842.985799:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532400000:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985823:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985845:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532400512:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985865:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985879:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532401024:0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985899:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876842.985921:0:49166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400000 00000100:00100000:1.0:1788876842.985926:0:49166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400000 00000100:00100000:1.0:1788876842.985952:0:49166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788876842.985959:0:49166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532400000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876842.985994:0:49166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532400000:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876842.986002:0:49166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788876842.986034:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532400000:0@lo:400:kworker.0 00000100:00100000:2.0:1788876842.986099:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400640 00000100:00100000:2.0:1788876842.986103:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400640 00000100:00100000:2.0:1788876842.986151:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400512 00000100:00100000:2.0:1788876842.986154:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400512 00000100:00100000:2.0:1788876842.986171:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401024 00000100:00100000:2.0:1788876842.986174:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401024 00000100:00100000:2.0:1788876842.986186:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:2.0:1788876842.986192:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532400640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876842.986231:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532400640:12345-0@lo:400:kworker.0 Request processed in 39us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876842.986238:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:2.0:1788876842.986251:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:2.0:1788876842.986257:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532400512:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876842.986269:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13efecf100 x1875771532400512/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:238/0 lens 224/224 e 0 to 0 dl 1788876853 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876842.986296:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532400512:12345-0@lo:400:kworker.0 Request processed in 40us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876842.986302:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:2.0:1788876842.986312:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:2.0:1788876842.986319:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532401024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876842.986350:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532401024:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876842.986355:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:2.0:1788876842.986386:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788876842.986394:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876842.986401:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532400640:0@lo:400:kworker.0 00000100:00080000:1.0:1788876842.986460:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876842.986464:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876842.986584:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400128 00000100:00100000:3.0:1788876842.986589:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400128 00000100:00100000:3.0:1788876842.986649:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1788876842.986657:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532400128:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876842.986681:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13efecc700 x1875771532400128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:238/0 lens 224/224 e 0 to 0 dl 1788876853 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876842.986723:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532400128:12345-0@lo:400:kworker.0 Request processed in 67us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876842.986729:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1788876842.986798:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532400128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987027:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532400256:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987060:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987086:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987106:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987126:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987143:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987167:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788876842.987173:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987191:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987206:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987223:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987235:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532401408:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987251:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876842.987273:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400256 00000100:00100000:0.0:1788876842.987276:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400256 00000100:00100000:0.0:1788876842.987293:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400896 00000100:00100000:0.0:1788876842.987295:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400896 00000100:00100000:0.0:1788876842.987309:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401408 00000100:00100000:0.0:1788876842.987312:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401408 00000100:00100000:0.0:1788876842.987322:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:0.0:1788876842.987327:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532400256:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876842.987338:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad3a300 x1875771532400256/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:238/0 lens 224/224 e 0 to 0 dl 1788876853 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876842.987367:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532400256:12345-0@lo:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987373:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:0.0:1788876842.987399:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1788876842.987405:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532400896:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876842.987415:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad38380 x1875771532400896/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:238/0 lens 224/224 e 0 to 0 dl 1788876853 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876842.987440:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532400896:12345-0@lo:400:kworker.0 Request processed in 36us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987446:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1788876842.987456:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788876842.987461:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532401408:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876842.987470:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad38e00 x1875771532401408/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:238/0 lens 224/224 e 0 to 0 dl 1788876853 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876842.987490:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532401408:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987495:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1788876842.987511:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401152 00000100:00100000:0.0:1788876842.987515:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401152 00000100:00100000:0.0:1788876842.987535:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400768 00000100:00100000:0.0:1788876842.987538:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400768 00000100:00100000:0.0:1788876842.987550:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401280 00000100:00100000:0.0:1788876842.987553:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401280 00000100:00100000:0.0:1788876842.987564:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532400384 00000100:00100000:0.0:1788876842.987566:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532400384 00000100:00100000:0.0:1788876842.987579:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788876842.987585:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532401152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987644:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532401152:12345-0@lo:400:kworker.0 Request processed in 59us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987650:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788876842.987660:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788876842.987677:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532400768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987702:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532400768:12345-0@lo:400:kworker.0 Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987707:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788876842.987717:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1788876842.987722:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532401280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987741:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532401280:12345-0@lo:400:kworker.0 Request processed in 19us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987746:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1788876842.987754:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788876842.987759:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532400384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987778:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532400384:12345-0@lo:400:kworker.0 Request processed in 19us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876842.987783:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00080000:0.0:1788876842.987822:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876842.987825:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876842.987827:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876842.987846:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987854:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987862:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532401408:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987869:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532400256:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987877:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987884:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788876842.987910:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532401152:0@lo:400:kworker.0 00010000:00010000:3.0:1788876843.177699:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788876843.430247:0:49157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 81604378632 is committed 00010000:00010000:1.0:1788876843.430309:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430321:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430327:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430333:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876843.430337:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430345:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430360:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a12c1a55400) 00010000:00010000:1.0:1788876843.430363:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876843.430368:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430374:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313af999 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430393:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430399:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430409:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430414:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876843.430416:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430423:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430430:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a12c1a55400) 00010000:00010000:1.0:1788876843.430432:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876843.430435:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876843.430440:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313af9d1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876843.499694:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876843.499721:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532401536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876843.499790:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876843.501782:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401536 00000100:00100000:2.0:1788876843.501792:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401536 00000100:00100000:2.0:1788876843.501844:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1788876843.501853:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532401536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788876843.501888:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:2.0:1788876843.501901:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fad39f80 x1875771532401536/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:239/0 lens 224/368 e 0 to 0 dl 1788876854 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876843.501957:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532401536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.501963:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1788876843.502039:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532401664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876843.502077:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876843.502129:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532401536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876843.502346:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401664 00000100:00100000:2.0:1788876843.502351:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401664 00000100:00100000:2.0:1788876843.502393:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1788876843.502400:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532401664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876843.502418:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876843.502458:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532401664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.502465:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1788876843.502576:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532401664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876843.503406:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876843.503417:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532401792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876843.503452:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876843.503576:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401792 00000100:00100000:2.0:1788876843.503581:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401792 00000100:00100000:2.0:1788876843.503640:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788876843.503648:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532401792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876843.503676:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876843.503717:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532401792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.503724:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788876843.503756:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532401792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876843.694643:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876843.694691:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876843.694723:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876843.694746:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876843.694773:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876843.694801:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280256 00000100:00100000:2.0:1788876843.694810:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280256 00000100:00100000:2.0:1788876843.694870:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280128 00000100:00100000:2.0:1788876843.694873:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280128 00000100:00100000:2.0:1788876843.694898:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1341 00000100:00100000:2.0:1788876843.694908:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511280256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876843.694984:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511280256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.694991:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1341 00000100:00100000:2.0:1788876843.695009:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1342 00000100:00100000:2.0:1788876843.695015:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511280128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876843.695047:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511280128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.695056:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1342 00000100:00100000:2.0:1788876843.695075:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280000 00000100:00100000:2.0:1788876843.695079:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280000 00000100:00100000:2.0:1788876843.695110:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279872 00000100:00100000:2.0:1788876843.695113:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279872 00000100:00100000:2.0:1788876843.695132:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1787 00000100:00100000:2.0:1788876843.695138:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511280000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876843.695169:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511280000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.695176:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1787 00000100:00100000:2.0:1788876843.695188:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1788 00000100:00100000:2.0:1788876843.695194:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511279872:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:2.0:1788876843.695209:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c3790e00 x1875771511279872/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:239/0 lens 224/224 e 0 to 0 dl 1788876854 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876843.695232:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511279872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876843.695238:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1788 00000100:00080000:2.0:1788876843.695258:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876843.695262:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876843.695265:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876843.695267:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876843.695788:0:49163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511279744 00000100:00100000:3.0:1788876843.695795:0:49163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511279744 00000100:00100000:3.0:1788876843.696248:0:49163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:3.0:1788876843.696258:0:49163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c4847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511279744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876843.696306:0:49163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c4847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511279744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876843.696314:0:49163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00010000:00010000:3.0:1788876844.201084:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876844.469347:0:50378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1788876844.683898:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876844.684277:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280384 00000100:00100000:0.0:1788876844.684287:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280384 00000100:00100000:0.0:1788876844.684387:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2585 00000100:00100000:0.0:1788876844.684398:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38489:x1875771511280384:12345-192.168.203.11@tcp:101:multiop.0 00010000:00010000:0.0:1788876844.684417:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876844.684441:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af9e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048974 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684512:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684527:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684542:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876844.684588:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876844.684592:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876844.684666:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684695:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313af9e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048974 expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684716:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048974 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.684724:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77200) 00010000:00010000:0.0:1788876844.684727:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876844.684731:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400587000, rc 0) 00010000:00000080:0.0:1788876844.684740:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7ae7800 x1875771511280384/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:240/0 lens 576/688 e 0 to 0 dl 1788876855 ref 1 fl Interpret:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876844.685929:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38489:x1875771511280384:12345-192.168.203.11@tcp:101:multiop.0 Request processed in 1527us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876844.685939:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2585 00000100:00100000:2.0:1788876844.696111:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876844.698465:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280640 00000100:00100000:2.0:1788876844.698478:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280640 00000100:00100000:2.0:1788876844.698544:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2586 00000100:00100000:2.0:1788876844.698553:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38489:x1875771511280640:12345-192.168.203.11@tcp:36:multiop.0 00010000:00010000:2.0:1788876844.698628:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876844.698664:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313af9ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048974 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.698682:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77200) 00010000:00010000:2.0:1788876844.698694:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876844.699565:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.699583:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.699595:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.699629:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.699637:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.699643:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702182:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702199:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702858:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702865:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876844.702870:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702879:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702894:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad600) 00010000:00010000:2.0:1788876844.702897:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876844.702902:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702908:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c000/0xf5bf0f7e313af9f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876844.702928:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1ce390a reply state 00000000865c0904 transno 81604378633 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702940:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876844.702947:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13fa4add00) 00010000:00010000:2.0:1788876844.702950:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876844.702953:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1788876844.702990:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c3793480 x1875771511280640/t81604378633(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:240/0 lens 520/448 e 0 to 0 dl 1788876855 ref 1 fl Interpret:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876844.703066:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38489:x1875771511280640:12345-192.168.203.11@tcp:36:multiop.0 Request processed in 4513us (6961us total) trans 81604378633 rc 0/0 00000100:00100000:2.0:1788876844.703075:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2586 00000100:00100000:1.0:1788876844.706680:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876844.706852:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280768 00000100:00100000:0.0:1788876844.706862:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280768 00000100:00100000:0.0:1788876844.706921:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2587 00000100:00100000:0.0:1788876844.706931:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38489:x1875771511280768:12345-192.168.203.11@tcp:101:multiop.0 00010000:00010000:0.0:1788876844.706954:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876844.706981:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313afa02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704897b expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707051:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707067:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707079:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876844.707119:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876844.707123:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876844.707140:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707162:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586000/0xf5bf0f7e313afa02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704897b expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707178:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704897b expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.707188:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77500) 00010000:00010000:0.0:1788876844.707191:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876844.707194:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1400586600, rc 0) 00010000:00000080:0.0:1788876844.707202:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13efeced80 x1875771511280768/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:240/0 lens 576/688 e 0 to 0 dl 1788876855 ref 1 fl Interpret:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876844.707257:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efeced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:38489:x1875771511280768:12345-192.168.203.11@tcp:101:multiop.0 Request processed in 327us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876844.707264:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2587 00000100:00100000:1.0:1788876844.712090:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876844.712171:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281024 00000100:00100000:0.0:1788876844.712181:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281024 00000100:00100000:0.0:1788876844.712244:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2588 00000100:00100000:0.0:1788876844.712255:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:38489:x1875771511281024:12345-192.168.203.11@tcp:101:multiop.0 00010000:00010000:0.0:1788876844.712276:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876844.712299:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313afa10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048982 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712370:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712390:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712401:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712413:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712428:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712434:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712551:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313afa25 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712560:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313afa25 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712568:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313afa25 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876844.712576:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x110:0x0]: returning size 0 00010000:00010000:0.0:1788876844.712704:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712711:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712718:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712724:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876844.712728:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712736:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712819:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c4c77500) 00010000:00010000:0.0:1788876844.712823:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876844.712829:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712837:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587600/0xf5bf0f7e313afa17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712848:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712854:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712860:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712865:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876844.712868:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712873:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712880:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13fa4add00) 00010000:00010000:0.0:1788876844.712883:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876844.712885:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712891:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313afa1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712930:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400587000/0xf5bf0f7e313afa10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048982 expref: 12 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712943:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313afa25 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048982 expref: 11 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876844.712950:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x110:0x0].0x0 (ffff8a13c4c77800) 00010000:00010000:0.0:1788876844.712952:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788876844.712954:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220c00, rc 0) 00010000:00000080:0.0:1788876844.712961:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13efecd180 x1875771511281024/t81604378634(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:240/0 lens 664/608 e 0 to 0 dl 1788876855 ref 1 fl Interpret:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876844.713016:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:38489:x1875771511281024:12345-192.168.203.11@tcp:101:multiop.0 Request processed in 763us (936us total) trans 81604378634 rc 0/0 00000100:00100000:0.0:1788876844.713023:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2588 00010000:00010000:1.0:1788876845.235556:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876845.544867:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876845.544892:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532401920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876845.544980:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876845.545095:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532401920 00000100:00100000:2.0:1788876845.545104:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532401920 00000100:00100000:2.0:1788876845.545169:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1788876845.545180:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532401920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876845.545211:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876845.545262:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532401920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876845.545269:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1788876845.545321:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532401920:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788876845.545371:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788876846.248923:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876846.572990:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532402048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876846.573059:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876846.573131:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402048 00000100:00100000:0.0:1788876846.573139:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402048 00000100:00100000:0.0:1788876846.573187:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1788876846.573196:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532402048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876846.573223:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876846.573263:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532402048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876846.573270:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00080000:0.0:1788876846.573290:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876846.573325:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532402048:0@lo:13:osp-pre-0-1.0 00000020:01000004:1.0:1788876846.701357:0:50476:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788876846.701416:0:50476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.701434:0:50476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.701441:0:50476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.701449:0:50476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.701475:0:50476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788876846.701481:0:50476:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788876846.701507:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788876846.701511:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788876846.701517:0:50476:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788876846.701542:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788876846.701576:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876846.701583:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.701591:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587400 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876846.701594:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.701625:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876846.701633:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876846.701638:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788876846.701649:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788876846.701652:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788876846.701677:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.701683:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788876846.701702:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.701708:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a1400587400/0xf5bf0f7e313af5be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5c5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.701720:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876846.701734:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876846.701736:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876846.701743:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876846.701759:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876846.701825:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876846.701903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402304 00000100:00100000:0.0:1788876846.701910:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402304 00000100:00100000:0.0:1788876846.701954:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788876846.701964:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532402304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876846.701978:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876846.701994:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313af5c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af5be expref: 24 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.702006:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876846.702038:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532402304:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876846.702056:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788876846.702091:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.702549:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532402176:0@lo:39:umount.0 00000100:00100000:2.0:1788876846.702588:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876846.702769:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402176 00000100:00100000:0.0:1788876846.702774:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402176 00000100:00100000:0.0:1788876846.702812:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1788876846.702821:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532402176:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788876846.702844:0:15659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af6d6 00000100:00080000:0.0:1788876846.703005:0:15659:0:(import.c:65:import_set_state_nolock()) ffff8a12c62df000 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788876846.703038:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c3790000 x1875771532402176/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:242/0 lens 224/224 e 0 to 0 dl 1788876857 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788876846.703164:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876846.703236:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532402176:12345-0@lo:39:umount.0 Request processed in 416us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876846.703242:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000020:00000080:0.0:1788876846.703251:0:15659:0:(genops.c:885:class_export_put()) final put ffff8a12c62da800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788876846.703374:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876846.703392:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532402176:0@lo:39:umount.0 00000100:00080000:3.0:1788876846.703443:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876846.703446:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788876846.703451:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788876846.704355:0:50476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704373:0:50476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704380:0:50476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704387:0:50476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704408:0:50476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876846.704412:0:50476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704418:0:50476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704424:0:50476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704430:0:50476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704445:0:50476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788876846.704451:0:50476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704458:0:50476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704470:0:50476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704476:0:50476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704493:0:50476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788876846.704499:0:50476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704506:0:50476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704513:0:50476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704520:0:50476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.704526:0:50476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788876846.704529:0:50476:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788876846.704559:0:50476:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788876846.704563:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1788876846.704568:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1788876846.704573:0:50476:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1788876846.705832:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788876846.705856:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.705866:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876846.705870:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.705880:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876846.705887:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876846.705899:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876846.705901:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788876846.705904:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788876846.705946:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.705952:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876846.705978:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.705985:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313af4de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4e5 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.705998:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876846.706001:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706007:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eb1cbe00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876846.706009:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706015:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876846.706021:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876846.706026:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876846.706028:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788876846.706030:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788876846.706042:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706047:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876846.706052:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706057:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cbe00/0xf5bf0f7e313af5fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af604 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706065:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876846.706068:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706073:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876846.706075:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706080:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876846.706085:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876846.706090:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788876846.706091:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788876846.706093:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788876846.706102:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706107:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876846.706123:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706129:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35600/0xf5bf0f7e313af5b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af5b7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706138:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876846.706142:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706147:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876846.706150:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706156:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876846.706161:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876846.706166:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876846.706168:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788876846.706169:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788876846.706180:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706185:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876846.706190:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706195:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a1400587a00/0xf5bf0f7e313af4d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313af4d7 expref: -99 pid: 49156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706208:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876846.706209:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876846.706211:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876846.706247:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532402432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.706305:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876846.706355:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876846.706361:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532402560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.706383:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876846.706411:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.706434:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876846.706451:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876846.706456:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.706475:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876846.706506:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402432 00000100:00100000:2.0:1788876846.706512:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402432 00000100:00100000:2.0:1788876846.706547:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402560 00000100:00100000:2.0:1788876846.706550:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402560 00000100:00100000:2.0:1788876846.706562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402688 00000100:00100000:2.0:1788876846.706564:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402688 00000100:00100000:2.0:1788876846.706573:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402816 00000100:00100000:2.0:1788876846.706576:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402816 00000100:00100000:2.0:1788876846.706590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788876846.706598:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+26:3664:x1875771532402432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876846.706629:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876846.706656:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313af4e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af4de expref: 26 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706673:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876846.706708:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+25:3664:x1875771532402432:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876846.706715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788876846.706730:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788876846.706737:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532402560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876846.706745:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876846.706753:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400586200/0xf5bf0f7e313af604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af5fd expref: 24 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706762:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876846.706782:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3664:x1875771532402560:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876846.706787:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788876846.706799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788876846.706804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3662:x1875771532402688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876846.706811:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876846.706818:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eb1cae00/0xf5bf0f7e313af5b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af5b0 expref: 22 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706827:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876846.706848:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3662:x1875771532402688:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876846.706854:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788876846.706891:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788876846.706897:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3662:x1875771532402816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876846.706904:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876846.706912:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400587e00/0xf5bf0f7e313af4d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af4d0 expref: 20 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876846.706919:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876846.706937:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3662:x1875771532402816:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876846.706942:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788876846.706984:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.706992:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532402688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.707014:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532402560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876846.707021:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532402432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876846.707163:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876846.707184:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788876846.713007:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62da800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788876846.713082:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c62df000 for lustre-MDT0000 00000004:00000080:3.0:1788876846.714876:0:50476:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788876846.715307:0:49157:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 81604378634 is committed 00000020:00000080:1.0:1788876846.715727:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788876846.715736:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d564f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876846.715742:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a12c62d9800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876846.715747:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13ef173800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876846.715755:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c5f9d800 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 8 (0 0 2) 0 0 0 1: ffff8a13eff46000 81604378634 stale:0 00000020:00080000:1.0:1788876846.715760:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c5f9d000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788876846.715765:0:50476:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c20199c0) has exports, disconnecting them 00000020:00080000:1.0:1788876846.715769:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d564f000), last request at 1788876842 00000020:00000080:1.0:1788876846.715776:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af6cf 00000100:00080000:1.0:1788876846.715785:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13c486e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876846.715810:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d564f000): rc 0 00000020:00000080:1.0:1788876846.715812:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13d564f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788876846.715820:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a12c62d9800), last request at 1788876812 00000020:00000080:1.0:1788876846.715823:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af6c1 00000100:00080000:1.0:1788876846.715827:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a12c62d9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876846.715834:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c62d9800): rc 0 00000020:00000080:1.0:1788876846.715836:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c62d9800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788876846.715840:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13ef173800), last request at 1788876842 00000020:00000080:1.0:1788876846.715843:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af6c8 00000100:00080000:1.0:1788876846.715856:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13c4c3e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876846.715864:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13ef173800): rc 0 00000020:00000080:1.0:1788876846.715866:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13ef173800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788876846.715871:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13c5f9d800), last request at 1788876844 00000020:00000080:1.0:1788876846.715879:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af532 00000020:00010000:1.0:1788876846.715890:0:50476:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13c5f9d800: total 3 00000100:00080000:1.0:1788876846.715893:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13ff356000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876846.715945:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13c5f9d800): rc 0 00000020:00080000:1.0:1788876846.715949:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13c5f9d000), last request at 1788876806 00000020:00000080:1.0:1788876846.715952:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af52b 00000100:00080000:1.0:1788876846.715957:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a12c62dd000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876846.715962:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c5f9d000): rc 0 00000020:00000080:1.0:1788876846.715964:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13c5f9d000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1788876846.715970:0:50476:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa620886b7ae0 00000100:00080000:1.0:1788876846.715985:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788876846.715989:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788876846.716897:0:50476:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788876846.716921:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13d060c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1788876846.717092:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d564f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876846.717140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62d9800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876846.717160:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef173800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876846.717178:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f9d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876846.717204:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c486e000 for lustre-MDT0000 00000020:00000080:0.0:1788876846.717214:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c62d9000 for lustre-MDT0000 00000020:00000080:0.0:1788876846.717217:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c4c3e800 for lustre-MDT0000 00000020:00000080:0.0:1788876846.717220:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c62dd000 for lustre-MDT0000 00000020:00010000:0.0:1788876846.717231:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13c5f9d800: total 0 00000100:00100000:2.0:1788876846.717250:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532402944:0@lo:39:umount.0 00010000:00010000:0.0:1788876846.717277:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13c5f9d800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788876846.717309:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1400586600/0xf5bf0f7e313afa09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704897b expref: 4 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876846.717315:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788876846.717335:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220c00/0xf5bf0f7e313afa25 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048982 expref: 3 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876846.717346:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13c5f9d800, canceled 2 locks, left on hash table 0. 00000100:00100000:2.0:1788876846.717361:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532402944 00000100:00100000:2.0:1788876846.717367:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532402944 00000100:00100000:2.0:1788876846.717407:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1788876846.717414:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532402944:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788876846.717436:0:13623:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af563 00000100:00080000:2.0:1788876846.717442:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a12c62db000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876846.717453:0:13623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788876846.717695:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532402944:12345-0@lo:39:umount.0 Request processed in 280us (379us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788876846.717722:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:2.0:1788876846.717762:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d060c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876846.717768:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532402944:0@lo:39:umount.0 00010000:00010000:3.0:1788876846.721988:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722005:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722015:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722022:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876846.722027:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722035:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722052:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13fa4add00) 00010000:00010000:3.0:1788876846.722055:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876846.722060:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876846.722067:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c600/0xf5bf0f7e313af9fb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788876846.722292:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876846.722298:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934859 gen 3 00000004:00080000:2.0:1788876846.722319:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788876846.722377:0:50476:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788876846.722404:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13f3692800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788876846.722421:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876846.722423:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 3 00000004:00080000:2.0:1788876846.722431:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876846.722573:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532403072:0@lo:9:umount.0 00000100:00100000:2.0:1788876846.722679:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876846.722747:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403072 00000100:00100000:2.0:1788876846.722754:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403072 00000100:00100000:2.0:1788876846.723316:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1788876846.723326:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532403072:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876846.723350:0:43963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af58d 00000100:00080000:2.0:1788876846.723358:0:43963:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876846.723389:0:43963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934859 00000100:00080000:3.0:1788876846.723666:0:50476:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788876846.723683:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788876846.723732:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c20199c0) has no exports 00000100:00100000:2.0:1788876846.723930:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532403072:12345-0@lo:9:umount.0 Request processed in 605us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876846.723938:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00080000:2.0:1788876846.723957:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876846.723973:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532403200:0@lo:9:umount.0 00000100:00100000:2.0:1788876846.724000:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876846.724028:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403200 00000100:00100000:3.0:1788876846.724034:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403200 00000100:00080000:2.0:1788876846.724042:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f3692800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876846.724051:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876846.724053:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876846.724056:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532403072:0@lo:9:umount.0 00000100:00100000:3.0:1788876846.724067:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00080000:2.0:1788876846.724074:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876846.724074:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532403200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788876846.724087:0:43959:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af59b 00000100:00080000:3.0:1788876846.724093:0:43959:0:(import.c:65:import_set_state_nolock()) ffff8a13d0bc6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788876846.724117:0:43959:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967567 00000100:00100000:3.0:1788876846.724213:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532403200:12345-0@lo:9:umount.0 Request processed in 139us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876846.724220:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00010000:00010000:1.0:1788876846.724654:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876846.724661:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876846.724681:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876846.724691:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876846.724694:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876846.724696:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532403200:0@lo:9:umount.0 00000020:00080000:3.0:1788876846.728297:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c20199c0) has no exports 00000020:00000080:0.0:1788876846.767463:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13c5f9d800/f0204769-56bd-4f5c-ab97-74c450c9e072 00000020:00000080:2.0:1788876846.768154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f9d800/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:2.0:1788876846.768218:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff356000 for lustre-MDT0000 00010000:00010000:2.0:1788876846.768229:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876846.768231:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876846.768234:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788876846.817428:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af547 00000020:00000080:3.0:1788876846.817444:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13f53b5000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788876846.817526:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788876846.817628:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876846.817647:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876846.817652:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a13f5274d40) has no exports 00000020:00000080:2.0:1788876846.818087:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af540 00000020:00000080:2.0:1788876846.818094:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13ff3db800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876846.818190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f53b5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788876846.818274:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876846.818336:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.818345:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788876846.818347:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13ff3dc000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788876846.818350:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3dc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788876846.818358:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788876846.818478:0:50476:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13e7a07de0 - data ffff8a12c1e50510/ffff8a12c1a9ac00 00000020:01000000:2.0:1788876846.818980:0:50476:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efe3e000 - data ffff8a13f0114288/ffff8a13c5ff3800 00000100:00080000:1.0:1788876846.877323:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788876846.877331:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788876846.877346:0:50476:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13cfcdad80 x1875771532402944/t4294967326(4294967326) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876856 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876846.877369:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788876846.882560:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788876846.882567:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934859 gen 4 00000004:00080000:1.0:1788876846.882585:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876846.882587:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788876846.884807:0:49174:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788876846.884816:0:49174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4c:0x0] index 1 count 1 00000040:00080000:2.0:1788876846.884829:0:49174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 19 count 2 00000100:00080000:1.0:1788876846.885757:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788876846.885764:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 4 00000004:00080000:1.0:1788876846.885788:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876846.885790:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788876846.886074:0:49176:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788876846.886079:0:49176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x4e:0x0] index 1 count 1 00000040:00080000:2.0:1788876846.886087:0:49176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 19 count 2 00000020:00000080:1.0:1788876846.887384:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af4fa 00000020:00000080:1.0:1788876846.887394:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c62de800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876846.888725:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62de800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876846.891073:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af50f 00000020:00000080:1.0:1788876846.891086:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c2595800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876846.891255:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788876846.891262:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876846.891270:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788876846.891275:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c201cd40) has no exports 00000004:01000000:1.0:1788876846.891435:0:50476:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788876846.891443:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af594 00000020:00000080:1.0:1788876846.891448:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13ff3d9800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876846.891452:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788876846.891456:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876846.891474:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788876846.891477:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c4e33380) has no exports 00000020:00000080:1.0:1788876846.891483:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af586 00000020:00000080:1.0:1788876846.891487:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c62db800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788876846.891838:0:50476:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788876846.891843:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788876846.892991:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967567 gen 5 00000004:00080000:1.0:1788876846.893002:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876846.893005:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788876846.893048:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788876846.893061:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876846.893068:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af578 00000020:00000080:1.0:1788876846.893074:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c3408000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876846.893080:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788876846.893085:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876846.893090:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788876846.893092:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a13f4538000) has no exports 00000020:00000080:1.0:1788876846.893098:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af571 00000020:00000080:1.0:1788876846.893101:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13ff3df000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788876846.893423:0:50476:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788876846.893427:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788876846.893430:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934859 gen 5 00000004:00080000:1.0:1788876846.893433:0:50476:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876846.893434:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788876846.893456:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788876846.893462:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788876846.893473:0:50476:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788876846.893479:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af55c 00000020:00000080:1.0:1788876846.893483:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13d2129800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876846.893486:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788876846.893489:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876846.893492:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788876846.893494:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a13f5270000) has no exports 00000020:00000080:1.0:1788876846.893498:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af555 00000020:00000080:1.0:1788876846.893501:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13d0608800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876846.895007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2595800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788876846.895022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3d9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788876846.895028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876846.895035:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff37c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788876846.895042:0:8:0:(genops.c:885:class_export_put()) final put ffff8a12c340a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876846.895045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788876846.895048:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876846.895132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c3408000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788876846.895137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876846.895143:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f3692800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788876846.895147:0:8:0:(genops.c:885:class_export_put()) final put ffff8a13d0608000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876846.895149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0608000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788876846.895153:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876846.895182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d2129800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788876846.895187:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0608800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788876846.899744:0:50476:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788876846.899751:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876846.899755:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876846.899763:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876846.899820:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.899832:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876846.899868:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.899872:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876846.899877:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c62de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876846.899881:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62de000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788876846.899889:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876846.899985:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af516 00000020:00000080:2.0:1788876846.899992:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c2594800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788876846.899997:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788876846.900001:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876846.900006:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876846.900010:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c201b380) has no exports 00000020:00000080:2.0:1788876846.900030:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.900033:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788876846.900038:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af51d 00000020:00000080:2.0:1788876846.900042:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c2591000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788876846.900049:0:50476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c354d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788876846.900052:0:50476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c354d000 3 00000020:01000004:2.0:1788876846.900055:0:50476:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a12c354d000 from lustre-MDT0000 00000020:00000080:2.0:1788876846.900074:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.900078:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788876846.900081:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c62df800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788876846.900082:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62df800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788876846.900089:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788876846.900117:0:50476:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788876846.900120:0:50476:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788876846.900123:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788876846.900125:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876846.900128:0:50476:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788876846.900136:0:50476:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13c5fff000 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876846.900143:0:50476:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13c5f99800 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876846.900147:0:50476:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c25e99c0) has exports, disconnecting them 00000020:00080000:2.0:1788876846.900151:0:50476:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13c5fff000), last request at 1788876806 00000020:00000080:2.0:1788876846.900171:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af524 00000020:00010000:2.0:1788876846.900176:0:50476:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13c5fff000: total 2 00000100:00080000:2.0:1788876846.900179:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13c5ffc800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876846.900197:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13c5fff000): rc 0 00000020:00080000:2.0:1788876846.900201:0:50476:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13c5f99800), last request at 1788876806 00000020:00000080:2.0:1788876846.900245:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af4bb 00000020:00010000:2.0:1788876846.900249:0:50476:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13c5f99800: total 2 00000100:00080000:2.0:1788876846.900251:0:50476:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876846.900259:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c5f99800): rc 0 00000020:00080000:2.0:1788876846.900264:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c25e99c0) has no exports 00000100:00100000:2.0:1788876846.900315:0:49164:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13e7b23400:49164] 2 exiting: rc = 0 00000100:00100000:3.0:1788876846.900511:0:49163:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13e00c4e00:49163] 1 exiting: rc = 0 00000020:00000080:3.0:1788876846.900556:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d060c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788876846.900562:0:8:0:(genops.c:885:class_export_put()) final put ffff8a13ff3de800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876846.900565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3de800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788876846.900570:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876846.900654:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2594800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788876846.900659:0:8:0:(genops.c:885:class_export_put()) final put ffff8a12c62da000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788876846.900661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c62da000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788876846.900665:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788876846.900689:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2591000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788876846.901003:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13c5fff000: total 0 00010000:00010000:1.0:1788876846.901008:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876846.901045:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13c5fff000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788876846.901078:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eb1ca800/0xf5bf0f7e313af5e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048919 expref: 5 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901095:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34e00/0xf5bf0f7e313af5ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048927 expref: 4 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901108:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eb1caa00/0xf5bf0f7e313af5e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048920 expref: 3 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901120:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400587c00/0xf5bf0f7e313af5f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704892e expref: 2 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901129:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13c5fff000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788876846.901146:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13c5fff000/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:1.0:1788876846.901191:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13c5f99800: total 1 00010000:00010000:1.0:1788876846.901210:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13c5f99800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788876846.901226:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400586800/0xf5bf0f7e313af63c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af635 expref: 14 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901238:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae35800/0xf5bf0f7e313af69e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af697 expref: 13 pid: 49163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901250:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313af62e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af627 expref: 12 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901259:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313af6ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af6a5 expref: 11 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901269:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400586400/0xf5bf0f7e313af6ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af6b3 expref: 10 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901284:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34400/0xf5bf0f7e313af64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af643 expref: 9 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901294:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313af658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af651 expref: 8 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901306:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34a00/0xf5bf0f7e313af666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af65f expref: 7 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901317:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae35200/0xf5bf0f7e313af674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af66d expref: 6 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901327:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400587800/0xf5bf0f7e313af612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af60b expref: 5 pid: 49166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901337:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff600/0xf5bf0f7e313af690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af689 expref: 4 pid: 49164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901348:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1400586c00/0xf5bf0f7e313af620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af619 expref: 3 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901358:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34800/0xf5bf0f7e313af682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313af67b expref: 2 pid: 49161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876846.901368:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13c5f99800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788876846.901378:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13c5f99800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00000020:00000080:3.0:1788876846.904783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5fff000/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:3.0:1788876846.904843:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5ffc800 for MGS 00010000:00010000:1.0:1788876846.905199:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876846.905203:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876846.905206:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876846.905214:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876846.905258:0:49166:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8a13ff53ae00:49166] 3 exiting: rc = 0 00000020:00000080:2.0:1788876846.905424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f99800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:2.0:1788876846.905451:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5f9f000 for MGS 00000100:00100000:2.0:1788876846.906824:0:49161:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13e15a1800:49161] 0 exiting: rc = 1 00000100:00100000:3.0:1788876846.906997:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907006:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907012:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907017:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907024:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907030:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907036:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907042:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907048:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907054:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907061:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907067:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907073:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907080:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907086:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907092:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907098:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907105:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907111:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907116:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907122:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907128:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907134:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907139:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907144:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907149:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907179:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907186:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907192:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907199:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907204:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907210:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907216:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907222:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907228:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907234:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907240:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907246:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907251:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907257:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907263:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907268:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907273:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907279:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907284:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907290:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907295:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907300:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907306:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907311:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907316:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907321:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907326:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907331:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907338:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907344:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907350:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907355:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907359:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907364:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907370:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907376:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907381:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788876846.907386:0:50476:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788876846.908838:0:50476:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efe3e120 - data ffff8a12c1e300d8/ffff8a13d9eff000 00000020:01000000:3.0:1788876846.908965:0:50476:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13cfe48120 - data ffff8a12c1e31438/ffff8a13e7b01800 00000020:00000080:3.0:1788876846.909395:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af4b4 00000020:00000080:3.0:1788876846.909404:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13d0e67800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788876846.909424:0:50476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a12c354d000 from MGS, refs=2 00000020:01000004:3.0:1788876846.909428:0:50476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c354d000 2 00000020:01000004:3.0:1788876846.909431:0:50476:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a12c354d000 from MGS 00000020:00000080:3.0:1788876846.909451:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876846.909459:0:50476:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788876846.909462:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13efedb000/MGS 00000020:00000080:3.0:1788876846.909464:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13efedb000/MGS for MGS 00000020:01000000:3.0:1788876846.909471:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788876846.909537:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788876846.909541:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876846.909550:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788876846.909557:0:50476:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a12c49f9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788876846.909563:0:50476:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c3f64d40) has exports, disconnecting them 00000020:00080000:3.0:1788876846.909569:0:50476:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a12c49f9800), last request at 1788876807 00000020:00000080:3.0:1788876846.909573:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af5d3 00000020:00080000:3.0:1788876846.909582:0:50476:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c49f9800): rc 0 00000020:00000080:3.0:1788876846.909587:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c49f9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876846.910277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e67800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876846.910287:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49f9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788876846.928670:0:50476:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788876846.928679:0:50476:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876846.928684:0:50476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876846.928693:0:50476:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876846.928727:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c36e5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876846.928897:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876846.928911:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788876846.928916:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a12c49ff800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788876846.928920:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49ff800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788876846.928930:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788876846.929002:0:50476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a12c354d000 1 00000020:00000080:2.0:1788876846.929008:0:50476:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313af4a6 00000020:00000080:2.0:1788876846.929013:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13efeda800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788876846.929022:0:50476:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788876846.929030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13efeda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876846.929040:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876846.929044:0:50476:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788876846.929047:0:50476:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c5e38000) has no exports 00000020:00000080:2.0:1788876847.038582:0:50476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876847.038594:0:50476:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788876847.039114:0:50476:0:(genops.c:885:class_export_put()) final put ffff8a13c8692000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876847.039119:0:50476:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c8692000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788876847.039125:0:50476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788876847.039240:0:50476:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13f5236000 00000020:02000400:2.0:1788876847.041897:0:50476:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788876847.275203:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876848.104811:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532403328:0@lo:400:kworker.0 00000400:00000100:0.0:1788876848.104864:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532403328 offset 0 length 224: 4 00000100:00100000:0.0:1788876848.104898:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.104927:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.104948:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532404352:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.104967:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.104990:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788876848.104995:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532403456:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105016:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105031:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105049:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105076:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532403584:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105099:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105118:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532404096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105138:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105155:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788876848.105160:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532403712:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105178:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105196:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105214:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876848.105242:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403840 00000100:00100000:0.0:1788876848.105249:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403840 00000100:00100000:0.0:1788876848.105278:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404352 00000100:00100000:0.0:1788876848.105280:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404352 00000100:00100000:0.0:1788876848.105303:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403968 00000100:00100000:0.0:1788876848.105305:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403968 00000100:00100000:0.0:1788876848.105315:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403584 00000100:00100000:0.0:1788876848.105317:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403584 00000100:00100000:0.0:1788876848.105323:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404224 00000100:00100000:0.0:1788876848.105325:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404224 00000100:00100000:0.0:1788876848.105334:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1788876848.105341:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105403:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532404352:12345-0@lo:400:kworker.0 Request processed in 61us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.105412:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1788876848.105429:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:0.0:1788876848.105435:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105460:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532403968:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.105465:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00100000:0.0:1788876848.105476:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1788876848.105480:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3664:x1875771532403840:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876848.105485:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876848.105508:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3664:x1875771532403840:12345-0@lo:400:kworker.0 Request processed in 27us (580us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876848.105513:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1788876848.105523:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1788876848.105527:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1875771532403584:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876848.105531:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876848.105552:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1875771532403584:12345-0@lo:400:kworker.0 Request processed in 24us (453us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876848.105557:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1788876848.105566:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:0.0:1788876848.105569:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1875771532404224:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876848.105574:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876848.105593:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1875771532404224:12345-0@lo:400:kworker.0 Request processed in 22us (378us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876848.105598:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:0.0:1788876848.105649:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403456 00000100:00100000:0.0:1788876848.105653:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403456 00000100:00100000:0.0:1788876848.105672:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1788876848.105676:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3664:x1875771532403456:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876848.105681:0:6545:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876848.105702:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3664:x1875771532403456:12345-0@lo:400:kworker.0 Request processed in 25us (685us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876848.105707:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1788876848.105729:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404096 00000100:00100000:0.0:1788876848.105732:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404096 00000100:00100000:0.0:1788876848.105754:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532403712 00000100:00100000:0.0:1788876848.105756:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532403712 00000100:00100000:0.0:1788876848.105772:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788876848.105777:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105803:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532404096:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.105809:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788876848.105819:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788876848.105824:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532403712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.105850:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532403712:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.105855:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00080000:0.0:1788876848.105875:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876848.105879:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876848.105881:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876848.105915:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532403712:0@lo:400:kworker.0 00000100:00080000:0.0:1788876848.105926:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876848.105930:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876848.105934:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876848.105940:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876848.105943:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1800 00000100:00080000:0.0:1788876848.105949:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876848.105971:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979880 x1875771532404480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876848.105988:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532404224:0@lo:400:kworker.0 00000100:00080000:0.0:1788876848.105997:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876848.106000:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876848.106002:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876848.106005:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876848.106008:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1800 00000100:00080000:0.0:1788876848.106012:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876848.106021:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978e00 x1875771532404608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876848.106031:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532403584:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.106042:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532404096:0@lo:400:kworker.0 00000100:00080000:0.0:1788876848.106079:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876848.106082:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876848.106085:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876848.106089:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876848.106092:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1800 00000100:00080000:0.0:1788876848.106096:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876848.106109:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e797a300 x1875771532404736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876848.106118:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532403456:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.106132:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532403968:0@lo:400:kworker.0 00000100:00080000:0.0:1788876848.106141:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876848.106143:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876848.106146:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876848.106148:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876848.106151:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1800 00000100:00080000:0.0:1788876848.106154:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876848.106166:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532404864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876848.106175:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788876848.106186:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532404352:0@lo:400:kworker.0 00000100:00100000:2.0:1788876848.109842:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532404480:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788876848.109911:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876848.109945:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532404608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788876848.109966:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876848.109982:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532404736:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788876848.110003:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876848.110021:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532404864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788876848.110039:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876848.110076:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404736 00000100:00100000:2.0:1788876848.110084:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404736 00000100:00100000:2.0:1788876848.110118:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1788876848.110125:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532404736:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788876848.110145:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876848.110186:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532404736:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 60us (181us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876848.110193:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1788876848.110215:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404480 00000100:00100000:2.0:1788876848.110218:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404480 00000100:00100000:2.0:1788876848.110233:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404608 00000100:00100000:2.0:1788876848.110235:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404608 00000100:00100000:2.0:1788876848.110245:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404864 00000100:00100000:2.0:1788876848.110248:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404864 00000100:00100000:2.0:1788876848.110256:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1788876848.110260:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404480:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788876848.110269:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876848.110290:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404480:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29us (381us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876848.110296:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1788876848.110306:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1788876848.110309:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788876848.110317:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876848.110334:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 24us (368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876848.110339:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:2.0:1788876848.110363:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1788876848.110367:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788876848.110375:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876848.110396:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532404864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 27us (355us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876848.110400:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00080000:2.0:1788876848.110440:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876848.110445:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876848.110448:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532404480:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788876848.110455:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876848.110458:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876848.110461:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532404608:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788876848.110468:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876848.110470:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876848.110473:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532404736:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788876848.110480:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876848.110483:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876848.110486:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532404864:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788876848.302959:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788876848.821897:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511281152 offset 0 length 224: 4 00000100:00100000:3.0:1788876848.821936:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876848.821960:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876848.821989:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876848.822058:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876848.822085:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281280 00000100:00100000:3.0:1788876848.822094:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281280 00000100:00100000:3.0:1788876848.822133:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281408 00000100:00100000:3.0:1788876848.822136:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281408 00000100:00100000:3.0:1788876848.822174:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1791 00000100:00100000:3.0:1788876848.822184:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511281408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876848.822300:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511281408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876848.822308:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1791 00000100:00100000:3.0:1788876848.822326:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2596 00000100:00100000:3.0:1788876848.822330:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875771511281280:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:3.0:1788876848.822337:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:3.0:1788876848.822358:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1875771511281280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (423us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788876848.822365:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2596 00000100:00100000:3.0:1788876848.829164:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876848.829200:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281792 00000100:00100000:3.0:1788876848.829209:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281792 00000100:00100000:3.0:1788876848.829248:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2597 00000100:00100000:3.0:1788876848.829256:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511281792:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788876848.829278:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876848.829334:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511281792:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 Request processed in 78us (178us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876848.829341:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2597 00000100:00100000:0.0:1788876848.829848:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281536 00000100:00100000:0.0:1788876848.829854:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281536 00000100:00100000:0.0:1788876848.829893:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281664 00000100:00100000:0.0:1788876848.829896:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281664 00000100:00100000:0.0:1788876848.829916:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1345 00000100:00100000:0.0:1788876848.829922:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511281536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876848.829965:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511281536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.829973:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1345 00000100:00100000:0.0:1788876848.829988:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1346 00000100:00100000:0.0:1788876848.829995:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511281664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876848.830019:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511281664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (7962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876848.830025:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1346 00000100:00080000:0.0:1788876848.830048:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876848.830052:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876848.830054:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876849.320933:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876850.345042:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876850.664940:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876850.664972:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532404992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876850.665072:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876850.665223:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532404992 00000100:00100000:2.0:1788876850.665235:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532404992 00000100:00100000:2.0:1788876850.665322:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1788876850.665333:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532404992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876850.665368:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788876850.665416:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876850.665436:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532404992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876850.665445:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1788876850.665549:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532404992:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876851.369014:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876851.689194:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876851.689215:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532405120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876851.689294:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876851.689563:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405120 00000100:00100000:0.0:1788876851.689573:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405120 00000100:00100000:0.0:1788876851.689672:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788876851.689683:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532405120:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876851.689714:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788876851.689725:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876851.689786:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532405120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876851.689793:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1788876851.689931:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532405120:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788876852.203271:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876852.203282:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13ff37f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876852.203340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788876852.203425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0bc6000 for lustre-OST0001 00000001:00100000:0.0:1788876852.204560:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876852.204569:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13ff37b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876852.204696:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788876852.204771:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff37e000 for lustre-OST0000 00000001:00100000:2.0:1788876852.205050:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788876852.205063:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967326 is committed 00000020:00000080:2.0:1788876852.205067:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a12c2593800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876852.206137:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2593800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788876852.210064:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c62db000 for lustre-MDT0001 00010000:00010000:1.0:1788876852.392880:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876853.224912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876853.224921:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876853.224925:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876853.224935:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1835 00000100:00080000:0.0:1788876853.224944:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876853.224952:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876853.224977:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532405376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876853.225005:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876853.225009:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876853.225011:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876853.225014:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1835 00000100:00080000:0.0:1788876853.225017:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876853.225020:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876853.225031:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c5591880 x1875771532405504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876853.225197:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532405248:0@lo:400:kworker.0 00000400:00000100:1.0:1788876853.225268:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532405248 offset 0 length 224: 4 00000100:00100000:3.0:1788876853.225456:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532405376:0@lo:38:kworker.0 00000100:00100000:3.0:1788876853.225506:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876853.225533:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532405504:0@lo:38:kworker.0 00000100:00100000:3.0:1788876853.225559:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876853.225633:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405376 00000100:00100000:3.0:1788876853.225642:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405376 00000100:00100000:3.0:1788876853.225686:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1788876853.225695:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532405376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876853.225721:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876853.225772:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532405376:12345-0@lo:38:kworker.0 Request processed in 75us (265us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876853.225779:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1788876853.225821:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405504 00000100:00100000:3.0:1788876853.225825:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405504 00000100:00100000:3.0:1788876853.225849:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:3.0:1788876853.225853:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532405504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876853.225862:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876853.225887:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532405504:12345-0@lo:38:kworker.0 Request processed in 33us (328us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876853.225893:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00080000:3.0:1788876853.225937:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876853.225942:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876853.225946:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532405376:0@lo:38:kworker.0 00000100:00080000:3.0:1788876853.225954:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876853.225957:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876853.225959:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532405504:0@lo:38:kworker.0 00000100:00100000:1.0:1788876853.231553:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532405632:0@lo:400:kworker.0 00000100:00100000:1.0:1788876853.231695:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876853.231804:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405632 00000100:00100000:1.0:1788876853.235486:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405632 00000100:00100000:1.0:1788876853.235676:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1788876853.235689:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532405632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876853.235825:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532405632:12345-0@lo:400:kworker.0 Request processed in 139us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876853.235833:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00080000:1.0:1788876853.235870:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876853.235924:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532405632:0@lo:400:kworker.0 00000100:00080000:0.0:1788876853.241178:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876853.241190:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876853.241195:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876853.241205:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1835 00000100:00080000:0.0:1788876853.241212:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876853.241220:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876853.241271:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff574a80 x1875771532405760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876853.241348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876853.241352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876853.241354:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876853.241357:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1835 00000100:00080000:0.0:1788876853.241360:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876853.241363:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876853.241378:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff574000 x1875771532406144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876853.241531:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532405760:0@lo:38:kworker.0 00000100:00100000:3.0:1788876853.241645:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876853.241699:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532406144:0@lo:38:kworker.0 00000100:00100000:3.0:1788876853.241722:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876853.241772:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405760 00000100:00100000:3.0:1788876853.241783:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405760 00000100:00100000:3.0:1788876853.241839:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406144 00000100:00100000:3.0:1788876853.241842:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406144 00000100:00100000:3.0:1788876853.241861:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:3.0:1788876853.241869:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532405760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876853.241897:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876853.241949:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532405760:12345-0@lo:38:kworker.0 Request processed in 79us (305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876853.241957:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:3.0:1788876853.241978:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:3.0:1788876853.241983:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532406144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876853.241992:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876853.242015:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532406144:12345-0@lo:38:kworker.0 Request processed in 31us (291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876853.242020:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00080000:3.0:1788876853.242175:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876853.242181:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876853.242185:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532405760:0@lo:38:kworker.0 00000100:00080000:3.0:1788876853.242195:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876853.242198:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876853.242201:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532406144:0@lo:38:kworker.0 00000100:00100000:2.0:1788876853.242297:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242343:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876853.242384:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532406016:0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242416:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876853.242441:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876853.242447:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242470:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876853.242498:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406016 00000100:00100000:2.0:1788876853.242502:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406016 00000100:00100000:2.0:1788876853.242554:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1788876853.242561:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532406016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242648:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532406016:12345-0@lo:400:kworker.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876853.242655:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00080000:2.0:1788876853.242679:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876853.242705:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532406016:0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242722:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532405888 00000100:00100000:2.0:1788876853.242726:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532405888 00000100:00100000:2.0:1788876853.242755:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406272 00000100:00100000:2.0:1788876853.242759:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406272 00000100:00100000:2.0:1788876853.242776:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1788876853.242783:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532405888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242833:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532405888:12345-0@lo:400:kworker.0 Request processed in 51us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876853.242840:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1788876853.242853:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:2.0:1788876853.242859:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532406272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242890:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532406272:12345-0@lo:400:kworker.0 Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876853.242899:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00080000:2.0:1788876853.242915:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876853.242929:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788876853.242949:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532406272:0@lo:400:kworker.0 00010000:00010000:2.0:1788876853.419820:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788876853.938114:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511281920 offset 0 length 224: 4 00000100:00100000:3.0:1788876853.938171:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876853.938212:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876853.938249:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876853.938277:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876853.938330:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282176 00000100:00100000:3.0:1788876853.938343:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282176 00000100:00100000:3.0:1788876853.938420:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282048 00000100:00100000:3.0:1788876853.938424:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282048 00000100:00100000:3.0:1788876853.938445:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1794 00000100:00100000:3.0:1788876853.938458:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511282176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876853.938548:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511282176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876853.938556:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1794 00000100:00100000:3.0:1788876853.938576:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2601 00000100:00100000:3.0:1788876853.938580:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511282048:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788876853.938662:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876853.938689:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511282048:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 107us (411us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876853.938695:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2601 00000100:00100000:2.0:1788876853.939312:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282304 00000100:00100000:2.0:1788876853.939320:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282304 00000100:00100000:2.0:1788876853.939365:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282432 00000100:00100000:2.0:1788876853.939368:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282432 00000100:00100000:2.0:1788876853.939393:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1349 00000100:00100000:2.0:1788876853.939400:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511282304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876853.939450:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511282304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876853.939457:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1349 00000100:00100000:2.0:1788876853.939470:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1350 00000100:00100000:2.0:1788876853.939476:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511282432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876853.939496:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511282432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876853.939502:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1350 00000100:00080000:2.0:1788876853.939522:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876853.939526:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876853.939528:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788876854.442835:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876855.466750:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876855.785052:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532406400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876855.785158:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876855.785354:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406400 00000100:00100000:2.0:1788876855.785366:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406400 00000100:00100000:2.0:1788876855.785452:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1788876855.785464:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532406400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876855.785504:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876855.785561:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532406400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876855.785569:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1788876855.785712:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532406400:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876855.785786:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876856.495183:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876856.812628:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876856.812656:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532406528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876856.812752:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876856.812889:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406528 00000100:00100000:0.0:1788876856.812900:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406528 00000100:00100000:0.0:1788876856.812980:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788876856.812993:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532406528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876856.813028:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876856.813084:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532406528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876856.813103:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788876856.813156:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532406528:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788876856.813281:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876857.516419:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876858.345497:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876858.345512:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876858.345517:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876858.345528:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1841 00000100:00080000:2.0:1788876858.345535:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788876858.345545:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876858.345584:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978e00 x1875771532406784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876858.345620:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876858.345624:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876858.345626:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876858.345630:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1841 00000100:00080000:2.0:1788876858.345633:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788876858.345636:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876858.345652:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5c2a00 x1875771532406912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876858.345668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876858.345672:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876858.345673:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876858.345678:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1841 00000100:00080000:2.0:1788876858.345680:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788876858.345683:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876858.345693:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5c0000 x1875771532407168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876858.345727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876858.345731:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876858.345733:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876858.345737:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1841 00000100:00080000:2.0:1788876858.345739:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788876858.345742:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876858.345750:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788876858.345753:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5c3480 x1875771532407552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1788876858.345821:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532406656 offset 0 length 224: 4 00000100:00100000:2.0:1788876858.345861:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532407424:0@lo:400:kworker.0 00000100:00100000:3.0:1788876858.345880:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532407680:0@lo:400:kworker.0 00000100:00100000:2.0:1788876858.345905:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876858.345905:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876858.345925:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876858.345926:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876858.345931:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532407296:0@lo:400:kworker.0 00000100:00100000:3.0:1788876858.345931:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532407040:0@lo:400:kworker.0 00000100:00100000:2.0:1788876858.345952:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876858.345953:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876858.346323:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532406784:0@lo:38:kworker.0 00000100:00100000:2.0:1788876858.346380:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876858.346403:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532406912:0@lo:38:kworker.0 00000100:00100000:2.0:1788876858.346441:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876858.350771:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407424 00000100:00100000:3.0:1788876858.350794:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407424 00000100:00100000:3.0:1788876858.350893:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407040 00000100:00100000:3.0:1788876858.350897:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407040 00000100:00100000:3.0:1788876858.350930:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788876858.350943:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876858.351658:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532407424:12345-0@lo:400:kworker.0 Request processed in 715us (5750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876858.351670:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788876858.351695:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788876858.351703:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876858.351744:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532407040:12345-0@lo:400:kworker.0 Request processed in 42us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876858.351750:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00080000:1.0:1788876858.357724:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876858.357740:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876858.357765:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406784 00000100:00100000:1.0:1788876858.357778:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406784 00000100:00100000:1.0:1788876858.357840:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1788876858.357851:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f36b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532406784:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876858.357879:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876858.357984:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f36b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532406784:12345-0@lo:38:kworker.0 Request processed in 134us (11603us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876858.357993:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1788876858.359708:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532407168:0@lo:38:kworker.0 00000100:00100000:2.0:1788876858.359772:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876858.359920:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532407040:0@lo:400:kworker.0 00000100:00100000:1.0:1788876858.359973:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532407424:0@lo:400:kworker.0 00000100:00100000:0.0:1788876858.368968:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407680 00000100:00100000:0.0:1788876858.368992:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407680 00000100:00080000:0.0:1788876858.369078:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876858.369163:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407296 00000100:00100000:0.0:1788876858.369168:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407296 00000100:00080000:0.0:1788876858.369186:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876858.369212:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532406912 00000100:00100000:0.0:1788876858.369216:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532406912 00000100:00100000:0.0:1788876858.369243:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1788876858.369255:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532407680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876858.369413:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532407680:12345-0@lo:400:kworker.0 Request processed in 160us (23505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876858.369422:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1788876858.369443:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1788876858.369450:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532407296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876858.369491:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532407296:12345-0@lo:400:kworker.0 Request processed in 42us (23538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876858.369497:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1788876858.369521:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1788876858.369527:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532406912:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876858.369550:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876858.369593:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532406912:12345-0@lo:38:kworker.0 Request processed in 65us (23151us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876858.369628:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1788876858.369690:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532407296:0@lo:400:kworker.0 00000100:00100000:0.0:1788876858.369739:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532407680:0@lo:400:kworker.0 00000100:00100000:2.0:1788876858.378230:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532407552:0@lo:38:kworker.0 00000100:00100000:2.0:1788876858.378332:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876858.378405:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876858.378412:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876858.378417:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532406784:0@lo:38:kworker.0 00000100:00080000:2.0:1788876858.378433:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876858.378437:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876858.378439:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407168 00000100:00100000:2.0:1788876858.378440:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532406912:0@lo:38:kworker.0 00000100:00100000:3.0:1788876858.378447:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407168 00000100:00100000:3.0:1788876858.378504:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407552 00000100:00100000:3.0:1788876858.378508:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407552 00000100:00100000:3.0:1788876858.378538:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1788876858.378548:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532407168:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876858.378585:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876858.378666:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532407168:12345-0@lo:38:kworker.0 Request processed in 117us (18891us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876858.378674:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1788876858.378694:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1788876858.378698:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532407552:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876858.378707:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876858.378729:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532407552:12345-0@lo:38:kworker.0 Request processed in 30us (399us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876858.378735:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00080000:2.0:1788876858.379470:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876858.379477:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876858.379481:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532407168:0@lo:38:kworker.0 00000100:00080000:2.0:1788876858.379492:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876858.379496:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876858.379499:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532407552:0@lo:38:kworker.0 00010000:00010000:1.0:1788876858.536982:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876859.059860:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:3.0:1788876859.059897:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511282560 offset 0 length 224: 4 00000100:00100000:3.0:1788876859.059918:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876859.059951:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876859.059997:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876859.060041:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282944 00000100:00100000:3.0:1788876859.060053:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282944 00000100:00100000:3.0:1788876859.060126:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283072 00000100:00100000:3.0:1788876859.060130:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283072 00000100:00100000:3.0:1788876859.060157:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1353 00000100:00100000:3.0:1788876859.060167:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511282944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876859.060260:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511282944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876859.060269:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1353 00000100:00100000:3.0:1788876859.060291:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1354 00000100:00100000:2.0:1788876859.060760:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282688 00000100:00100000:2.0:1788876859.060767:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282688 00000100:00100000:2.0:1788876859.060807:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511282816 00000100:00100000:2.0:1788876859.060811:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511282816 00000100:00100000:2.0:1788876859.060853:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1797 00000100:00100000:2.0:1788876859.060861:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511282816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876859.060910:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511282816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876859.060917:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1797 00000100:00100000:2.0:1788876859.060932:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2605 00000100:00100000:2.0:1788876859.060936:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511282688:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788876859.060963:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876859.060991:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511282688:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 53us (1146us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876859.060997:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2605 00000100:00080000:0.0:1788876859.061255:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876859.061262:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876859.061264:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876859.061451:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511283072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876859.061627:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511283072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1327us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876859.061636:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1354 00010000:00010000:0.0:1788876859.570469:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876860.585494:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876860.904799:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876860.904821:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532407808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876860.904887:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876860.905044:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407808 00000100:00100000:2.0:1788876860.905052:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407808 00000100:00100000:2.0:1788876860.905108:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788876860.905115:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532407808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876860.905139:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876860.905179:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532407808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876860.905186:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:3.0:1788876860.905278:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876860.905314:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532407808:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876861.609900:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876861.930034:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876861.930057:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532407936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876861.930139:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876861.930199:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532407936 00000100:00100000:0.0:1788876861.930207:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532407936 00000100:00100000:0.0:1788876861.930276:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1788876861.930286:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532407936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876861.930338:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876861.930389:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532407936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876861.930406:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:0.0:1788876861.930440:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876861.930498:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532407936:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876862.649438:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876863.464776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876863.464784:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876863.464788:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876863.464795:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1846 00000100:00080000:3.0:1788876863.464802:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876863.464808:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876863.464831:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48d880 x1875771532408192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876863.464846:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876863.464849:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876863.464851:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876863.464854:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1846 00000100:00080000:3.0:1788876863.464857:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876863.464860:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876863.464871:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532408320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876863.464899:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876863.464903:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876863.464905:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876863.464908:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1846 00000100:00080000:3.0:1788876863.464911:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876863.464914:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876863.464924:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3027480 x1875771532408576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876863.464945:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876863.464948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876863.464950:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876863.464953:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1846 00000100:00080000:3.0:1788876863.464956:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788876863.464959:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876863.464969:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3027b80 x1875771532408960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876863.465005:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532408704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876863.465071:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876863.465121:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876863.465127:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532408448:0@lo:400:kworker.0 00000100:00100000:3.0:1788876863.465153:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876863.465182:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408448 00000100:00100000:3.0:1788876863.465189:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408448 00000100:00100000:3.0:1788876863.465249:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1788876863.465259:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876863.465306:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532408448:12345-0@lo:400:kworker.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876863.465314:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00080000:3.0:1788876863.465334:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876863.465375:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532408448:0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.465642:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532408832:0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.465673:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465698:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788876863.465705:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532408064:0@lo:400:kworker.0 00000400:00000100:2.0:1788876863.465723:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532408064 offset 0 length 224: 4 00000100:00100000:2.0:1788876863.465740:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532409088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.465759:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465797:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532408192:0@lo:38:kworker.0 00000100:00100000:2.0:1788876863.465821:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465837:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532408320:0@lo:38:kworker.0 00000100:00100000:2.0:1788876863.465856:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465871:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532408576:0@lo:38:kworker.0 00000100:00100000:2.0:1788876863.465888:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465902:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532408960:0@lo:38:kworker.0 00000100:00100000:2.0:1788876863.465920:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876863.465951:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408704 00000100:00100000:2.0:1788876863.465955:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408704 00000100:00100000:2.0:1788876863.465983:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409088 00000100:00100000:2.0:1788876863.465986:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409088 00000100:00100000:2.0:1788876863.465998:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408320 00000100:00100000:2.0:1788876863.466000:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408320 00000100:00100000:2.0:1788876863.466007:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408576 00000100:00100000:2.0:1788876863.466009:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408576 00000100:00100000:2.0:1788876863.466016:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408960 00000100:00100000:2.0:1788876863.466018:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408960 00000100:00100000:2.0:1788876863.466028:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:2.0:1788876863.466034:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532408704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.466071:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532408704:12345-0@lo:400:kworker.0 Request processed in 37us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876863.466078:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00100000:2.0:1788876863.466091:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:2.0:1788876863.466097:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532409088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.466126:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532409088:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876863.466132:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:2.0:1788876863.466143:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1788876863.466147:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876863.466165:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876863.466194:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408320:12345-0@lo:38:kworker.0 Request processed in 45us (337us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876863.466201:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1788876863.466211:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1788876863.466215:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876863.466224:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876863.466258:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408576:12345-0@lo:38:kworker.0 Request processed in 41us (368us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876863.466264:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1788876863.466275:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788876863.466279:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408960:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876863.466288:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876863.466309:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532408960:12345-0@lo:38:kworker.0 Request processed in 29us (388us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876863.466315:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1788876863.466335:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408192 00000100:00100000:2.0:1788876863.466338:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408192 00000100:00100000:2.0:1788876863.466357:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1788876863.466373:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532408192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876863.466383:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876863.466407:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532408192:12345-0@lo:38:kworker.0 Request processed in 43us (585us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876863.466413:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:2.0:1788876863.466438:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876863.466456:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876863.466461:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876863.466465:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532408192:0@lo:38:kworker.0 00000100:00080000:2.0:1788876863.466473:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876863.466476:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876863.466479:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532408320:0@lo:38:kworker.0 00000100:00080000:2.0:1788876863.466486:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876863.466489:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876863.466492:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532408576:0@lo:38:kworker.0 00000100:00080000:2.0:1788876863.466499:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876863.466502:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876863.466505:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532408960:0@lo:38:kworker.0 00000100:00100000:2.0:1788876863.466552:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532409088:0@lo:400:kworker.0 00000100:00100000:2.0:1788876863.466577:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532408704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876863.467998:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532408832 00000100:00100000:3.0:1788876863.468010:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532408832 00000100:00100000:3.0:1788876863.468076:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788876863.468086:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532408832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876863.468156:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532408832:12345-0@lo:400:kworker.0 Request processed in 73us (2482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876863.468163:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788876863.468208:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532408832:0@lo:400:kworker.0 00000100:00080000:0.0:1788876863.472463:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876863.660041:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788876864.198136:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511283200 offset 0 length 224: 4 00000100:00100000:1.0:1788876864.198178:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876864.198214:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876864.198244:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876864.198267:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876864.198337:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283584 00000100:00100000:2.0:1788876864.198346:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283584 00000100:00100000:2.0:1788876864.198419:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283712 00000100:00100000:2.0:1788876864.198422:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283712 00000100:00100000:2.0:1788876864.198446:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1357 00000100:00100000:2.0:1788876864.198455:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511283584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876864.198541:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511283584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876864.198548:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1357 00000100:00100000:2.0:1788876864.198566:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1358 00000100:00100000:2.0:1788876864.198587:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511283712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876864.198640:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511283712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876864.198646:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1358 00000100:00100000:2.0:1788876864.198667:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283456 00000100:00100000:2.0:1788876864.198671:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283456 00000100:00100000:2.0:1788876864.198698:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283328 00000100:00100000:2.0:1788876864.198701:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283328 00000100:00100000:2.0:1788876864.198716:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1800 00000100:00100000:2.0:1788876864.198722:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511283456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876864.198751:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511283456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876864.198758:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1800 00000100:00100000:2.0:1788876864.198770:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2609 00000100:00100000:2.0:1788876864.198774:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511283328:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788876864.198795:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876864.198819:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511283328:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 43us (551us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876864.198825:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2609 00000100:00080000:1.0:1788876864.200140:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876864.200148:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876864.200151:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00000400:0.0:1788876864.493113:0:3664:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876848/real 1788876848] req@ffff8a13fa48df80 x1875771532403328/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876864 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876864.493145:0:3664:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13fa48df80 x1875771532403328/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876864 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788876864.493154:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788876864.493158:0:3664:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788876864.493161:0:3664:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788876864.493164:0:3664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788876864.493168:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fa48df80 x1875771532403328/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876864 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876864.493177:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fa48ce00 x1875771532405248/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876869 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876864.496760:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13e7979880 x1875771532406656/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876874 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876864.496782:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a12c5591880 x1875771532408064/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876879 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788876864.496792:0:3664:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788876864.496795:0:3664:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788876864.496796:0:3664:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788876864.496798:0:3664:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1788876864.496852:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532406656:0@lo:400:kworker.0 00000100:00080000:0.0:1788876864.496889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876864.496893:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788876864.496896:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876864.496901:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1794 00000100:00080000:0.0:1788876864.496909:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876864.496942:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3bb80 x1875771532409216/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876864.496961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876864.496965:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876864.496967:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876864.496970:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1851 00000100:00080000:0.0:1788876864.496973:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876864.496976:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876864.499202:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3a680 x1875771532409344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876864.499221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876864.499224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876864.499226:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876864.499230:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1851 00000100:00080000:0.0:1788876864.499233:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876864.499238:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876864.499248:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39f80 x1875771532409472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876864.499556:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532405248:0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.499597:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876864.499633:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532409600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.499727:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876864.499809:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409600 00000100:00100000:3.0:1788876864.499818:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409600 00000100:00100000:3.0:1788876864.499964:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788876864.499976:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532409600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.500042:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532409600:12345-0@lo:400:kworker.0 Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876864.500050:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788876864.500293:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532409600:0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.500768:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532409216:0@lo:250:kworker.0 00000400:00000100:3.0:1788876864.500806:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532409216 offset 0 length 520: 4 00000100:00100000:3.0:1788876864.500837:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532409344:0@lo:38:kworker.0 00000100:00100000:3.0:1788876864.501215:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876864.501247:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532409472:0@lo:38:kworker.0 00000100:00100000:3.0:1788876864.501274:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876864.501317:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409344 00000100:00100000:3.0:1788876864.501327:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409344 00000100:00100000:3.0:1788876864.501361:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1788876864.501367:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532409344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876864.501391:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876864.501436:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532409344:12345-0@lo:38:kworker.0 Request processed in 67us (221us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876864.501445:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1788876864.501468:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409472 00000100:00100000:3.0:1788876864.501471:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409472 00000100:00100000:3.0:1788876864.501498:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:3.0:1788876864.501503:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532409472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876864.501512:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876864.501553:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532409472:12345-0@lo:38:kworker.0 Request processed in 49us (278us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876864.501560:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00080000:3.0:1788876864.501631:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876864.501637:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876864.501642:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532409344:0@lo:38:kworker.0 00000100:00080000:3.0:1788876864.501653:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876864.501657:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876864.501661:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532409472:0@lo:38:kworker.0 00000100:00100000:1.0:1788876864.502418:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532408064:0@lo:400:kworker.0 00000100:00100000:1.0:1788876864.502429:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532403328:0@lo:400:kworker.0 00000100:00080000:0.0:1788876864.505110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876864.505117:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876864.505121:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876864.505128:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1851 00000100:00080000:0.0:1788876864.505132:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876864.505139:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876864.505246:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfccf800 x1875771532409728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876864.505297:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876864.505312:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532409856:0@lo:400:kworker.0 00000100:00100000:1.0:1788876864.505396:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876864.505446:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409856 00000100:00100000:1.0:1788876864.505454:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409856 00000100:00100000:1.0:1788876864.505495:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1788876864.505503:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532409856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876864.505567:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532409856:12345-0@lo:400:kworker.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876864.505576:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1788876864.505654:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532409856:0@lo:400:kworker.0 00000100:00080000:1.0:1788876864.505697:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876864.505701:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876864.505703:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876864.505707:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1851 00000100:00080000:1.0:1788876864.505710:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876864.505714:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876864.505721:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876864.505728:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532409984:0@lo:400:kworker.0 00000100:00100000:1.0:1788876864.505759:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876864.505803:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfccc700 x1875771532410112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876864.505842:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532410240:0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.505845:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409984 00000100:00100000:3.0:1788876864.505861:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409984 00000100:00100000:1.0:1788876864.505868:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876864.505954:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788876864.505981:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876864.506169:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410240 00000100:00100000:0.0:1788876864.506176:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410240 00000100:00100000:0.0:1788876864.506211:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1788876864.506211:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532409984:12345-0@lo:400:kworker.0 Request processed in 110us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876864.506226:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.506231:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1788876864.506293:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532410240:12345-0@lo:400:kworker.0 Request processed in 67us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876864.506304:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1788876864.506316:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532410240:0@lo:400:kworker.0 00000100:00100000:3.0:1788876864.506340:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532409984:0@lo:400:kworker.0 00000100:00100000:0.0:1788876864.506361:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532409728:0@lo:38:kworker.0 00000100:00100000:0.0:1788876864.506395:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876864.506430:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532410112:0@lo:38:kworker.0 00000100:00100000:0.0:1788876864.506452:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876864.506480:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532409728 00000100:00100000:0.0:1788876864.506484:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532409728 00000100:00100000:0.0:1788876864.506500:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410112 00000100:00100000:0.0:1788876864.506502:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410112 00000100:00100000:0.0:1788876864.506529:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1788876864.506534:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532409728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876864.506552:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876864.506586:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532409728:12345-0@lo:38:kworker.0 Request processed in 51us (190us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876864.506592:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:0.0:1788876864.506625:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:0.0:1788876864.506630:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532410112:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876864.506639:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876864.506664:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532410112:12345-0@lo:38:kworker.0 Request processed in 33us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876864.506670:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00080000:0.0:1788876864.506697:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876864.506701:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876864.506704:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532409728:0@lo:38:kworker.0 00000100:00080000:0.0:1788876864.506711:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876864.506714:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876864.506716:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532410112:0@lo:38:kworker.0 00010000:00010000:2.0:1788876864.684662:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876865.016836:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876865.016871:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876865.016892:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788876865.016909:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511283840 offset 0 length 520: 4 00000100:00100000:0.0:1788876865.016934:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876865.016958:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284096 00000100:00100000:0.0:1788876865.016968:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284096 00000100:00100000:0.0:1788876865.017015:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511283968 00000100:00100000:0.0:1788876865.017018:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511283968 00000100:00100000:0.0:1788876865.017036:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1803 00000100:00100000:0.0:1788876865.017045:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511284096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876865.017117:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511284096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876865.017128:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1803 00000100:00100000:0.0:1788876865.017145:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2613 00000100:00100000:0.0:1788876865.017150:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511283968:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876865.017169:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876865.017192:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511283968:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 40us (257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876865.017198:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2613 00000100:00100000:3.0:1788876865.018392:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284224 00000100:00100000:3.0:1788876865.018400:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284224 00000100:00100000:3.0:1788876865.018489:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284352 00000100:00100000:3.0:1788876865.018492:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284352 00000100:00100000:3.0:1788876865.018527:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1361 00000100:00100000:3.0:1788876865.018535:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511284224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876865.018589:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511284224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876865.018596:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1361 00000100:00100000:3.0:1788876865.018628:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1362 00000100:00100000:3.0:1788876865.018636:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511284352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876865.018660:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511284352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876865.018666:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1362 00010000:00010000:1.0:1788876865.706875:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876866.024837:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876866.024858:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532410368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876866.024921:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876866.025005:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410368 00000100:00100000:2.0:1788876866.025014:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410368 00000100:00100000:2.0:1788876866.025073:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1788876866.025081:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532410368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876866.025107:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876866.025147:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532410368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876866.025154:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00080000:0.0:1788876866.025212:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876866.025255:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532410368:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876866.729629:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876867.048862:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532410496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876867.048930:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876867.049041:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410496 00000100:00100000:0.0:1788876867.049049:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410496 00000100:00100000:0.0:1788876867.049108:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788876867.049117:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532410496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876867.049145:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876867.049192:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532410496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876867.049198:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788876867.049253:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532410496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876867.049461:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876867.752753:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876868.779814:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876869.626158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876869.626167:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788876869.626170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876869.626174:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876869.626177:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876869.626185:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1852 00000100:00080000:3.0:1788876869.626189:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876869.626196:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876869.626230:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4036300 x1875771532410624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876869.626258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876869.626262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876869.626263:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876869.626266:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1852 00000100:00080000:3.0:1788876869.626268:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876869.626271:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876869.626280:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4036d80 x1875771532410752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876869.626310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876869.626314:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876869.626316:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876869.626319:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1852 00000100:00080000:3.0:1788876869.626321:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876869.626324:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876869.626333:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39f80 x1875771532411008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876869.626359:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876869.626362:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876869.626364:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876869.626367:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1852 00000100:00080000:3.0:1788876869.626369:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788876869.626372:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876869.626380:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3024e00 x1875771532411392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876869.626411:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.626469:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876869.626527:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876869.626533:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.626554:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876869.626576:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.626595:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876869.626639:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876869.626644:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.626663:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876869.626694:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411136 00000100:00100000:3.0:1788876869.626700:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411136 00000100:00100000:1.0:1788876869.626880:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532410624:0@lo:38:kworker.0 00000100:00100000:1.0:1788876869.626910:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876869.626938:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532410752:0@lo:38:kworker.0 00000100:00100000:1.0:1788876869.626955:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876869.626969:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532411008:0@lo:38:kworker.0 00000100:00100000:1.0:1788876869.626984:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876869.626996:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532411392:0@lo:38:kworker.0 00000100:00100000:1.0:1788876869.627010:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876869.627032:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411520 00000100:00100000:1.0:1788876869.627036:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411520 00000100:00100000:1.0:1788876869.627061:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410752 00000100:00100000:1.0:1788876869.627064:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410752 00000100:00100000:1.0:1788876869.627071:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411008 00000100:00100000:1.0:1788876869.627073:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411008 00000100:00100000:1.0:1788876869.627079:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411392 00000100:00100000:1.0:1788876869.627081:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411392 00000100:00100000:1.0:1788876869.627091:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1788876869.627098:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532411520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876869.627143:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532411520:12345-0@lo:400:kworker.0 Request processed in 45us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876869.627150:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:1.0:1788876869.627164:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1788876869.627168:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532410752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876869.627185:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876869.627209:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532410752:12345-0@lo:38:kworker.0 Request processed in 40us (253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876869.627215:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:1.0:1788876869.627224:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:1.0:1788876869.627227:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532411008:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876869.627235:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876869.627251:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532411008:12345-0@lo:38:kworker.0 Request processed in 23us (266us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876869.627256:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:1.0:1788876869.627264:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1788876869.627267:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532411392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876869.627275:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876869.627292:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532411392:12345-0@lo:38:kworker.0 Request processed in 23us (281us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876869.627297:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00080000:1.0:1788876869.627325:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876869.627330:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876869.627333:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532410752:0@lo:38:kworker.0 00000100:00080000:1.0:1788876869.627343:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876869.627345:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876869.627348:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532411008:0@lo:38:kworker.0 00000100:00080000:1.0:1788876869.627354:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876869.627357:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876869.627360:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532411392:0@lo:38:kworker.0 00000100:00100000:2.0:1788876869.627475:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410624 00000100:00100000:2.0:1788876869.627488:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410624 00000100:00100000:2.0:1788876869.627520:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1788876869.627525:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532410624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876869.627535:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876869.627566:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532410624:12345-0@lo:38:kworker.0 Request processed in 41us (656us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876869.627572:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1788876869.627710:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532410880 00000100:00100000:2.0:1788876869.627714:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532410880 00000100:00100000:2.0:1788876869.627746:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411264 00000100:00100000:2.0:1788876869.627749:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411264 00000100:00100000:2.0:1788876869.627765:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1788876869.627770:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876869.627801:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532410880:12345-0@lo:400:kworker.0 Request processed in 31us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876869.627807:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1788876869.627816:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1788876869.627821:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532411264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876869.627842:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532411264:12345-0@lo:400:kworker.0 Request processed in 21us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876869.627847:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1788876869.628001:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:3.0:1788876869.628009:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532411136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.628041:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532411136:12345-0@lo:400:kworker.0 Request processed in 34us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876869.628046:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00080000:3.0:1788876869.628063:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876869.628067:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876869.628069:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876869.628098:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.628108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.628130:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788876869.628139:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532411136:0@lo:400:kworker.0 00000100:00080000:1.0:1788876869.628365:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876869.628370:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876869.628373:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532410624:0@lo:38:kworker.0 00010000:00010000:2.0:1788876869.805374:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876870.323216:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876870.323266:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876870.323298:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876870.323329:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876870.323372:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284608 00000100:00100000:0.0:1788876870.323384:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284608 00000100:00100000:0.0:1788876870.323455:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284480 00000100:00100000:0.0:1788876870.323458:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284480 00000100:00100000:0.0:1788876870.323487:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1806 00000100:00100000:0.0:1788876870.323498:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511284608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876870.323595:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511284608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876870.323634:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1806 00000100:00100000:0.0:1788876870.323654:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2617 00000100:00100000:0.0:1788876870.323659:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511284480:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876870.323683:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876870.323724:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511284480:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 64us (395us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876870.323731:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2617 00000100:00100000:3.0:1788876870.332968:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284736 00000100:00100000:3.0:1788876870.332992:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284736 00000100:00100000:3.0:1788876870.333208:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284864 00000100:00100000:3.0:1788876870.333211:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284864 00000100:00100000:3.0:1788876870.333250:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1365 00000100:00100000:3.0:1788876870.333262:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511284736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876870.333372:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511284736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 112us (10173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876870.333380:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1365 00000100:00100000:3.0:1788876870.333401:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1366 00000100:00100000:3.0:1788876870.333407:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511284864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876870.333429:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511284864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (10130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876870.333435:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1366 00000100:00080000:3.0:1788876870.333458:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876870.333463:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876870.333466:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788876870.825518:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788876870.842495:0:51093:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788876870.842502:0:51093:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788876870.842503:0:51093:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788876870.842667:0:51093:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a13c4ebc800 00000020:01000004:1.0:1788876870.842686:0:51093:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788876870.842701:0:51093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788876870.843281:0:51093:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c25eb380) 00000020:00000080:1.0:1788876870.843305:0:51093:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788876871.011033:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.019501:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788876871.021406:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.021968:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.022461:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.022741:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.023055:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.023452:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.023697:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.023965:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.024271:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788876871.024576:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.025007:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.025403:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.027034:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788876871.028343:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.028575:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.028996:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788876871.029316:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788876871.029757:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788876871.031649:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.032014:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.034376:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788876871.037616:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.044280:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.044812:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.045509:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.046278:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.047026:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.047814:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.048456:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.049422:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.049804:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.050144:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.050940:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.051630:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.051957:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.052170:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.052543:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.052956:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.053387:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.053683:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.054002:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.054451:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788876871.055126:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.055618:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.055867:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788876871.058664:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876871.059149:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788876871.059724:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876871.060503:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788876871.060809:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788876871.061087:0:51093:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788876871.066094:0:51093:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788876871.068073:0:51093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788876871.068083:0:51093:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788876871.068097:0:51093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afa3a 00000020:01000004:2.0:1788876871.068105:0:51093:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788876871.068117:0:51093:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788876871.068122:0:51093:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13c4ebc800 from MGS 00000020:01000004:2.0:1788876871.068126:0:51093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788876871.068136:0:51093:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c5e38000) 00000020:00000080:2.0:1788876871.068147:0:51093:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788876871.069078:0:51093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c4ebc800 from MGS, refs=2 00080000:01000000:2.0:1788876871.069089:0:51093:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788876871.069102:0:51093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afa48 00010000:00010000:2.0:1788876871.069745:0:51093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788876871.084160:0:51093:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788876871.100358:0:51097:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788876871.100539:0:51093:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788876871.100637:0:51093:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788876871.102322:0:51093:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788876871.102580:0:51093:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788876871.103498:0:51093:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788876871.103505:0:51093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788876871.106549:0:51093:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788876871.106566:0:51093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788876871.107483:0:51093:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788876871.107492:0:51093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788876871.109808:0:51093:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788876871.109845:0:51093:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788876871.109848:0:51093:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788876871.109852:0:51093:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788876871.109929:0:51093:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 42, was 0): CONNECTING 00000100:00100000:0.0:1788876871.109936:0:51093:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1788876871.146101:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532411648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876871.146169:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876871.149051:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411648 00000100:00100000:2.0:1788876871.149067:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411648 00000100:00100000:2.0:1788876871.149151:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1788876871.149162:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532411648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876871.149204:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876871.149287:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532411648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876871.149294:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1788876871.149560:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532411648:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788876871.150447:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788876871.848778:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876872.169303:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532411776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876872.169375:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876872.169513:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532411776 00000100:00100000:0.0:1788876872.169520:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532411776 00000100:00100000:0.0:1788876872.169580:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788876872.169589:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532411776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876872.169639:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876872.169685:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532411776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876872.169692:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:3.0:1788876872.172978:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876872.173057:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532411776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876872.875466:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876873.897992:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876874.728871:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876864/real 1788876864] req@ffff8a13fad3bb80 x1875771532409216/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876874 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876874.728910:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13fad3bb80 x1875771532409216/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876874 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876874.728941:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.728950:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788876874.728972:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532409216:0@lo:250:kworker.0 00000100:00080000:0.0:1788876874.729148:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876874.729155:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788876874.729158:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876874.729164:0:24072:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1852 00000100:00080000:0.0:1788876874.729171:0:24072:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788876874.729178:0:24072:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876874.729217:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3036a00 x1875771532411904/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876874.729235:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876874.729238:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876874.729240:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876874.729243:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1857 00000100:00080000:0.0:1788876874.729246:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876874.729249:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876874.729264:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3035180 x1875771532412032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876874.729273:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876874.729276:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876874.729278:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876874.729281:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1857 00000100:00080000:0.0:1788876874.729284:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876874.729287:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876874.729299:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d3034e00 x1875771532412160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876874.729325:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876874.729329:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876874.729331:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876874.729335:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1857 00000100:00080000:0.0:1788876874.729337:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876874.729340:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876874.729354:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd07100 x1875771532412416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876874.729378:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876874.729381:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876874.729382:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876874.729385:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1857 00000100:00080000:0.0:1788876874.729388:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876874.729391:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876874.729400:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd06300 x1875771532412800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876874.729491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532412288:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.729558:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.729643:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876874.729649:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532412544:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.729674:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.729707:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532412928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.729729:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.729751:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876874.729756:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532412672:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.729773:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.729798:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412544 00000100:00100000:3.0:1788876874.729805:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412544 00000100:00100000:3.0:1788876874.729850:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412928 00000100:00100000:3.0:1788876874.729853:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412928 00000100:00100000:3.0:1788876874.729873:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:3.0:1788876874.729880:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532412544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.729921:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532412544:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876874.729928:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:3.0:1788876874.729945:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:3.0:1788876874.729951:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532412928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876874.729988:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412288 00000100:00100000:3.0:1788876874.729988:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532412928:12345-0@lo:400:kworker.0 Request processed in 37us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876874.729996:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412288 00000100:00100000:3.0:1788876874.729999:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00080000:3.0:1788876874.730027:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876874.730032:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876874.730035:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412672 00000100:00100000:2.0:1788876874.730040:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412672 00000100:00100000:3.0:1788876874.730066:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788876874.730075:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1788876874.730086:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532412288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.730098:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532412928:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.730139:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1788876874.730150:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532412288:12345-0@lo:400:kworker.0 Request processed in 65us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876874.730151:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532412672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876874.730168:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00080000:2.0:1788876874.730193:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876874.730193:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532412672:12345-0@lo:400:kworker.0 Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876874.730202:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1788876874.730222:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532412288:0@lo:400:kworker.0 00000100:00100000:3.0:1788876874.730236:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532412672:0@lo:400:kworker.0 10000000:01000000:2.0:1788876874.730260:0:51093:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1788876874.730276:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730286:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730292:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788876874.730312:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730321:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cac00/0xf5bf0f7e313af697 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af69e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730340:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730347:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730353:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730358:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730363:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a1400587200/0xf5bf0f7e313af60b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af612 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730373:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730379:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730385:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730405:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730411:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eb1cb800/0xf5bf0f7e313af619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af620 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730423:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00020000:1.0:1788876874.730430:0:3661:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a13d3036a00 x1875771532411904/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1788876874.730431:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730457:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730461:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730465:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efeff200/0xf5bf0f7e313af635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af63c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730474:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730480:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730485:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730488:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730492:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a1400586e00/0xf5bf0f7e313af643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af64a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730499:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730509:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730514:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730517:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730523:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313af65f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af666 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730536:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730545:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730550:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730553:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730556:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313af67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af682 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730564:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730570:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730575:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730577:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730580:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eb1ca000/0xf5bf0f7e313af6b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af6ba expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730596:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730640:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730645:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730649:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730653:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313af66d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af674 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730665:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730672:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730676:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1788876874.730679:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730683:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34000/0xf5bf0f7e313af689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af690 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730862:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730868:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730873:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788876874.730877:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730881:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34c00/0xf5bf0f7e313af627 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af62e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730888:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730893:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730898:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788876874.730901:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730904:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313af651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af658 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876874.730910:0:51093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876874.730916:0:51093:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876874.730921:0:51093:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788876874.730923:0:51093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1788876874.730926:0:51093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313af6a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313af6ac expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788876874.776094:0:51093:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 43, was 0): CONNECTING 00000100:00080000:1.0:1788876874.776100:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.776136:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1788876874.776145:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:0:1875771532411904:0@lo:250:kworker.0 00000100:00080000:2.0:1788876874.776240:0:51093:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876874.776250:0:51093:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1862 00000100:00080000:2.0:1788876874.776256:0:51093:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788876874.776263:0:51093:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00080000:3.0:1788876874.776364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876874.776370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788876874.776427:0:51093:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7875180 x1875771532413056/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876874.776453:0:51093:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788876874.776875:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532412032:0@lo:38:kworker.0 00000100:00100000:1.0:1788876874.776977:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876874.777046:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532412160:0@lo:38:kworker.0 00000100:00100000:1.0:1788876874.777083:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876874.777113:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532412416:0@lo:38:kworker.0 00000100:00100000:1.0:1788876874.777141:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876874.777157:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412160 00000100:00100000:0.0:1788876874.777174:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412160 00000100:00100000:0.0:1788876874.777215:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412416 00000100:00100000:0.0:1788876874.777218:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412416 00000100:00100000:0.0:1788876874.777238:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1788876874.777245:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532412160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876874.777267:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876874.778946:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412032 00000100:00100000:2.0:1788876874.778957:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412032 00000100:00100000:2.0:1788876874.778995:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1788876874.779002:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532412032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876874.779021:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876874.780413:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532412160:12345-0@lo:38:kworker.0 Request processed in 3162us (3324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876874.780424:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1788876874.780467:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1788876874.780474:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532412416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876874.780491:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876874.780530:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532412416:12345-0@lo:38:kworker.0 Request processed in 55us (3391us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876874.780537:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00080000:1.0:1788876874.781422:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.781436:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876874.781453:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532412416:0@lo:38:kworker.0 00000100:00100000:1.0:1788876874.781473:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532412800:0@lo:38:kworker.0 00000100:00100000:1.0:1788876874.781549:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876874.781633:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532412800 00000100:00100000:1.0:1788876874.781642:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532413056:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788876874.781645:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532412800 00000100:00100000:1.0:1788876874.781690:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876874.781731:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.781736:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876874.781741:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532412160:0@lo:38:kworker.0 00000100:00100000:0.0:1788876874.781807:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1788876874.781815:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532412800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876874.781895:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788876874.782045:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.782051:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876874.782055:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532412032:0@lo:38:kworker.0 00000100:00080000:1.0:1788876874.782067:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876874.782070:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876874.782073:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532412800:0@lo:38:kworker.0 00000100:00100000:2.0:1788876874.783757:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413056 00000100:00100000:2.0:1788876874.783769:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413056 00000100:00100000:2.0:1788876874.783807:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788876874.783814:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532413056:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788876874.783850:0:51099:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 1862 last 0 00000020:00000080:2.0:1788876874.783880:0:51099:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313afa4f 00000100:00100000:3.0:1788876874.785843:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532412032:12345-0@lo:38:kworker.0 Request processed in 6823us (8849us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876874.786581:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532412800:12345-0@lo:38:kworker.0 Request processed in 4755us (5022us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876874.786596:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00080000:2.0:1788876874.787033:0:51099:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876874.787052:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1788876874.787287:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532413056:12345-0@lo:250:mount.lustre.0 Request processed in 3469us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876874.787298:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788876874.787487:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 20 00000100:00080000:1.0:1788876874.787497:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:1.0:1788876874.787505:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788876874.787509:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788876874.787513:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788876874.787516:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788876874.787542:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788876874.787557:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532413056:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788876874.787676:0:51093:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1788876874.787789:0:51093:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788876874.787826:0:51093:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788876874.787831:0:51093:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788876874.787996:0:51093:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788876874.788335:0:51093:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788876874.788339:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788876874.788341:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876874.788342:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876874.788344:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876874.788345:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876874.788346:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876874.788347:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876874.788349:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876874.788351:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876874.788352:0:51093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788876874.788354:0:51093:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788876874.788356:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788876874.788357:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876874.788358:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876874.788359:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876874.788360:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876874.788361:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876874.788362:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876874.788363:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876874.788364:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876874.788365:0:51093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788876874.788387:0:51093:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788876874.788403:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788876874.788459:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876874.788491:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b82540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876874.788634:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413184 00000100:00100000:1.0:1788876874.788641:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413184 00000100:00100000:1.0:1788876874.788682:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788876874.788808:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:51093:x1875771532413184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788876874.788917:0:51101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788876874.788920:0:51101:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788876874.788923:0:51101:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000000:0.0:1788876874.789299:0:8:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:0.0:1788876874.789312:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788876874.789314:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876874.789316:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788876874.789318:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876874.789319:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876874.789320:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876874.789321:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876874.789322:0:8:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876874.789323:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876874.789324:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876874.789361:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788876874.789370:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788876874.789372:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876874.789373:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788876874.789374:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876874.789375:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876874.789377:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876874.789377:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876874.789379:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876874.789380:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876874.789381:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876874.789395:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788876874.789400:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788876874.789401:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876874.789402:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788876874.789404:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876874.789405:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876874.789406:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876874.789407:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876874.789408:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876874.789409:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876874.789410:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876874.789431:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788876874.789470:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532413568:0@lo:253:kworker.0 00000100:00100000:0.0:1788876874.789510:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.789627:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532413312:0@lo:253:kworker.0 00000100:00100000:3.0:1788876874.789661:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.789675:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876874.789680:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532413440:0@lo:253:kworker.0 00000100:00100000:3.0:1788876874.789816:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.789915:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413568 00000100:00100000:3.0:1788876874.789920:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413568 00000100:00100000:3.0:1788876874.789942:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413312 00000100:00100000:3.0:1788876874.789945:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413312 00000100:00100000:3.0:1788876874.789956:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413440 00000100:00100000:3.0:1788876874.789958:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413440 00000100:00100000:3.0:1788876874.789970:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788876874.789978:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532413568:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788876874.789996:0:51099:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:1.0:1788876874.790369:0:51103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788876874.790494:0:51101:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 79 20000000:01000000:0.0:1788876874.800273:0:51104:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788876874.800280:0:51104:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788876874.800284:0:51104:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788876874.800287:0:51104:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788876874.800663:0:51104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788876874.800961:0:51101:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788876874.800988:0:51101:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788876874.802491:0:51099:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788876874.805033:0:51099:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788876874.805050:0:51099:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788876874.805234:0:51103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788876874.805239:0:51103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788876874.805265:0:51103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805287:0:51103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876874.805296:0:51103:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000057302s 00010000:00010000:1.0:1788876874.805300:0:51103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805307:0:51103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805314:0:51103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805320:0:51103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805325:0:51103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876874.805329:0:51103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805338:0:51103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805349:0:51103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805358:0:51103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.805369:0:51103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876874.806285:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51093:x1875771532413184:12345-0@lo:253:mount.lustre.0 Request processed in 17588us (17818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876874.806297:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788876874.806344:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788876874.806356:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532413312:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788876874.806387:0:51101:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788876874.806401:0:51101:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788876874.807042:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788876874.807060:0:51093:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788876874.807063:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788876874.807064:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876874.807066:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876874.807067:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876874.807068:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876874.807070:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876874.807071:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876874.807072:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876874.807074:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876874.807076:0:51093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788876874.807102:0:51093:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13c4ebc800 from lustre-MDT0000 10000000:01000000:3.0:1788876874.807143:0:51093:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788876874.807145:0:51093:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788876874.807159:0:51093:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a13c4ebc800 10000000:01000000:3.0:1788876874.807222:0:51093:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788876874.807230:0:51093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a13c4ebc800 10000000:01000000:3.0:1788876874.807234:0:51093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788876874.807238:0:51093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c4ebc800 from 1 10000000:01000000:3.0:1788876874.807241:0:51093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788876874.807282:0:51093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.807292:0:51093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.807300:0:51093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876874.807319:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788876874.807334:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3664:x1875771532413568:12345-0@lo:253:kworker.0 Request processed in 17356us (17823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876874.807347:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788876874.807352:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788876874.807516:0:3664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788876874.807519:0:3664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788876874.807520:0:3664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876874.807521:0:3664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876874.807522:0:3664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1788876874.807574:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db240 going to sleep for 11 seconds 00000020:01000004:1.0:1788876874.807630:0:3664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876874.807631:0:3664:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788876874.807632:0:3664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876874.807634:0:3664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788876874.807638:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532413568:0@lo:253:kworker.0 00000100:00100000:0.0:1788876874.807732:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413696 00000100:00100000:0.0:1788876874.807738:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413696 00000100:00100000:2.0:1788876874.807880:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788876874.807952:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532413440:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788876874.807976:0:51100:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788876874.814476:0:51101:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788876874.814558:0:51100:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788876874.815002:0:51101:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788876874.816378:0:51103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876874.816387:0:51103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1788876874.820101:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532413312:12345-0@lo:253:kworker.0 Request processed in 13739us (30430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876874.820125:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788876874.820298:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788876874.820314:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:51093:x1875771532413696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876874.820331:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876874.820355:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313afa64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afa5d expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820385:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313afa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afa5d expref: 7 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820396:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313afa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afa5d expref: 7 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820403:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7961a00, rc 0) 00000100:00100000:3.0:1788876874.820437:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:51093:x1875771532413696:12345-0@lo:101:mount.lustre.0 Request processed in 130us (13084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876874.820454:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788876874.820511:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876874.820529:0:51093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820537:0:51093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876874.820554:0:51093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876874.820565:0:51093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820572:0:51093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876874.820580:0:51093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788876874.820597:0:51093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788876874.820636:0:51093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a13c4ebc800 10000000:01000000:3.0:1788876874.820640:0:51093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788876874.820645:0:51093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788876874.820647:0:51093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788876874.820676:0:51093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820684:0:51093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.820848:0:51093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876874.820870:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876874.820904:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788876874.820972:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788876874.820976:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788876874.820978:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876874.820979:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876874.820981:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876874.820982:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876874.820983:0:3662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876874.820985:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876874.820986:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788876874.820989:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532413312:0@lo:253:kworker.0 00000100:00100000:3.0:1788876874.821064:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876874.821069:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413824 00000100:00100000:0.0:1788876874.821076:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413824 00000100:00100000:0.0:1788876874.821109:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788876874.821117:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:51093:x1875771532413824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876874.821125:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876874.821137:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313afa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afa6b expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876874.821350:0:51100:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788876874.821356:0:51100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788876874.821991:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3662:x1875771532413440:12345-0@lo:253:kworker.0 Request processed in 14101us (32173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876874.822000:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1788876874.822127:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1788876874.822130:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788876874.822131:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876874.822132:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876874.822134:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876874.822135:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876874.822137:0:3662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788876874.822138:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876874.822139:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788876874.822143:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532413440:0@lo:253:kworker.0 00010000:00010000:1.0:1788876874.822628:0:51103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822642:0:51103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876874.822661:0:51103:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006275695s 00010000:00010000:1.0:1788876874.822666:0:51103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822674:0:51103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822682:0:51103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822789:0:51103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822795:0:51103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876874.822799:0:51103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822807:0:51103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822822:0:51103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822830:0:51103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876874.822837:0:51103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afa79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876874.823062:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313afa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afa6b expref: 7 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876874.823076:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313afa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afa6b expref: 7 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876874.823083:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221200, rc 0) 00000100:00100000:0.0:1788876874.823139:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:51093:x1875771532413824:12345-0@lo:101:mount.lustre.0 Request processed in 2023us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876874.823146:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788876874.823294:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876874.823309:0:51093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876874.823317:0:51093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876874.823388:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876874.823414:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.823455:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db240 going to sleep for 11 seconds 00000100:00100000:2.0:1788876874.823508:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532413952 00000100:00100000:2.0:1788876874.823514:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532413952 00000100:00100000:2.0:1788876874.823549:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788876874.823558:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:51093:x1875771532413952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876874.823738:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51093:x1875771532413952:12345-0@lo:501:mount.lustre.0 Request processed in 181us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876874.823746:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788876874.823872:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532413952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876874.823900:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532414080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876874.823950:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.823978:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876874.824068:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414080 00000100:00100000:0.0:1788876874.824072:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414080 00000100:00100000:0.0:1788876874.824104:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788876874.824110:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51093:x1875771532414080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876874.824702:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51093:x1875771532414080:12345-0@lo:503:mount.lustre.0 Request processed in 590us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876874.824709:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788876874.824737:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532414080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876874.829555:0:51105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51105:1875771532414208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876874.829668:0:51105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876874.829809:0:51105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876874.830837:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414208 00000100:00100000:1.0:1788876874.830846:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414208 00000100:00100000:1.0:1788876874.830900:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788876874.830911:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51105:x1875771532414208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876874.832937:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51105:x1875771532414208:12345-0@lo:502:llog_process_th.0 Request processed in 2021us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876874.832950:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788876874.833037:0:51105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51105:1875771532414208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788876874.833071:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876874.833082:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876874.833084:0:51105:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788876874.833090:0:51105:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788876874.833093:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876874.833106:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c3f60000) 00000020:00000080:3.0:1788876874.833295:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788876874.833302:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788876874.833384:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788876874.833392:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afa87 00000020:00000080:3.0:1788876874.833872:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788876874.833879:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788876874.833883:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876874.833885:0:51105:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788876874.833887:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788876874.833891:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788876874.833893:0:51105:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788876874.833896:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788876874.833904:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c3f63380) 00000020:00000080:3.0:1788876874.833917:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788876874.833921:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788876874.833923:0:51105:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788876874.833926:0:51105:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788876874.833932:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788876874.833977:0:51105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c4ebc800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788876874.833989:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c3f619c0) 00000020:00000080:3.0:1788876874.833998:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788876874.834047:0:51105:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788876874.834052:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afa9c 00000020:00000080:3.0:1788876874.834309:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788876874.834316:0:51105:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788876874.834321:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313afaa3 00080000:01000000:3.0:1788876874.834326:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788876874.834329:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afaaa 00010000:00010000:3.0:1788876874.921072:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876875.011461:0:51105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1788876875.011596:0:51105:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 81604378624 lx: 0 gen 1 00000001:00080000:2.0:1788876875.011686:0:51105:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 77309411332 srv lr: 81604378624 lx: 0 gen 4 00000001:00000004:0.0:1788876875.014764:0:51105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 20, last_transno is 81604378624 00000001:00080000:0.0:1788876875.014931:0:51105:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1788876875.014994:0:51105:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13e7d65cc0: xid 1875771511276672, transno 81604378629, client gen 4, slot idx 0 00000001:00080000:0.0:1788876875.015006:0:51105:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13e7d653c0: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:0.0:1788876875.015011:0:51105:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13e7d65000: xid 1875771511276928, transno 81604378630, client gen 4, slot idx 2 00000001:00080000:0.0:1788876875.015016:0:51105:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13e7d65b40: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:0.0:1788876875.015795:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a12c4e34d40) 00000020:00000080:0.0:1788876875.015818:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788876875.015885:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788876875.015892:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afac6 00000020:00000080:0.0:1788876875.017437:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788876875.022996:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313afacd 00000020:00000080:2.0:1788876875.025326:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788876875.025339:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.025345:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.025348:0:51105:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788876875.025352:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788876875.025355:0:51105:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788876875.025357:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876875.025358:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876875.025360:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788876875.025362:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.025365:0:51105:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788876875.025367:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876875.025371:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.025373:0:51105:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788876875.025377:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788876875.025423:0:51105:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788876875.025439:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.025454:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.025455:0:51105:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788876875.025459:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876875.025462:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.025463:0:51105:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788876875.025466:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788876875.025471:0:51105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:2.0:1788876875.025497:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788876875.025514:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a12c5e3cd40) 00000020:00000080:2.0:1788876875.025535:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788876875.025541:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788876875.025625:0:51105:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788876875.025632:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788876875.025639:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afadb 00010000:00080000:2.0:1788876875.025672:0:51105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c2593800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1788876875.032805:0:51105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788876875.038528:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876875.038542:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788876875.038583:0:51105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788876875.038641:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afae2 00000100:00080000:0.0:1788876875.038651:0:51105:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788876875.038657:0:51105:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a12c2593800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.038714:0:51105:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd05f80 x1875771532414336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876875.038735:0:51105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788876875.038789:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876875.038793:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.038795:0:51105:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788876875.038798:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788876875.038801:0:51105:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788876875.038802:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876875.038804:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876875.038805:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788876875.038807:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.038809:0:51105:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788876875.038811:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788876875.038815:0:51105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788876875.038818:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.038819:0:51105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788876875.038821:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788876875.038824:0:51105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1788876875.038844:0:51105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788876875.038846:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876875.038858:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c4e30000) 00000020:00000080:0.0:1788876875.038873:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788876875.038878:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788876875.038936:0:51105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788876875.038943:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788876875.038948:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afaf0 00010000:00080000:0.0:1788876875.038985:0:51105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13c5f98000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788876875.039277:0:51105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1788876875.040287:0:51105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788876875.040316:0:51105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788876875.040545:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876875.040638:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876875.040713:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414336 00000100:00100000:1.0:1788876875.040721:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414336 00000100:00100000:1.0:1788876875.040750:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1788876875.040757:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532414336:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788876875.040781:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1862 last 0 00000020:00000080:1.0:1788876875.040816:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afaf7 00000004:00100000:1.0:1788876875.040831:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788876875.040915:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a13d1516000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876875.040967:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532414336:12345-0@lo:38:llog_process_th.0 Request processed in 209us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.040975:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1788876875.041010:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788876875.041018:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788876875.041024:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788876875.041029:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788876875.041032:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c2593800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788876875.041044:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876875.041096:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876875.041104:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532414464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876875.041143:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876875.041708:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414464 00000100:00100000:3.0:1788876875.041713:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414464 00000100:00100000:3.0:1788876875.041748:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788876875.041756:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532414464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876875.041782:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876875.041827:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532414464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.041834:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788876875.041883:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532414464:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788876875.050394:0:51105:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 18, last_idx 19 00000040:00080000:0.0:1788876875.059654:0:51105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788876875.059690:0:51105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].20, 64 off9472 00000040:00080000:1.0:1788876875.062238:0:51105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x50:0x0].1, 64 off8256 00000040:00080000:1.0:1788876875.067098:0:51111:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:1.0:1788876875.067106:0:51111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788876875.067298:0:51111:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1788876875.067319:0:51111:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4c:0x0] at index 19 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788876875.067453:0:51111:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:1.0:1788876875.067457:0:51111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788876875.072815:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876875.073925:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876875.073994:0:51105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788876875.074019:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afafe 00000100:00080000:2.0:1788876875.074030:0:51105:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876875.074036:0:51105:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13c5f98000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876875.074075:0:51105:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5c2d80 x1875771532414592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876875.074105:0:51105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788876875.074209:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.074215:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.074217:0:51105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788876875.074220:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788876875.074223:0:51105:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788876875.074225:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876875.074226:0:51105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788876875.074228:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788876875.074230:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.074232:0:51105:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788876875.074234:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788876875.074239:0:51105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788876875.074242:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.074243:0:51105:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788876875.074247:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788876875.074251:0:51105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1788876875.074277:0:51105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788876875.074280:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788876875.074293:0:51105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c5e3b380) 00000020:00000080:2.0:1788876875.074311:0:51105:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788876875.074315:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788876875.074386:0:51105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788876875.074393:0:51105:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788876875.074398:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afb0c 00010000:00080000:2.0:1788876875.074428:0:51105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13f4438000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:1.0:1788876875.074668:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414592:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788876875.074737:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.074817:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414592 00000100:00100000:0.0:1788876875.074825:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414592 00000100:00100000:0.0:1788876875.074868:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1788876875.074877:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3661:x1875771532414592:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788876875.074906:0:43961:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1862 last 0 00000020:00000080:0.0:1788876875.074933:0:43961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afb13 00002000:00100000:0.0:1788876875.074949:0:43961:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13c5f99000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788876875.074953:0:43961:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788876875.074956:0:43961:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788876875.075044:0:43961:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788876875.075066:0:43961:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876875.075134:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532414592:12345-0@lo:8:llog_process_th.0 Request processed in 257us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.075142:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:1.0:1788876875.075355:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788876875.075363:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788876875.075370:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788876875.075375:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788876875.075378:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f98000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788876875.075400:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788876875.075406:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414592:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788876875.075430:0:51111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788876875.075494:0:51111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1862970891026ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788876875.075500:0:51111:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788876875.076077:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876875.076090:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532414720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876875.076140:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876875.076396:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414720 00000100:00100000:1.0:1788876875.076402:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414720 00000100:00100000:1.0:1788876875.076461:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1788876875.076470:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532414720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876875.076491:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876875.076530:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532414720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.076536:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:1.0:1788876875.076553:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876875.076579:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532414720:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788876875.077746:0:51094:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788876875.078111:0:51105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1788876875.079931:0:51105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788876875.079959:0:51105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788876875.082580:0:51105:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 18, last_idx 19 00000040:00080000:2.0:1788876875.084381:0:51105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788876875.084412:0:51105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].20, 64 off9472 00000040:00080000:2.0:1788876875.085792:0:51105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x52:0x0].1, 64 off8256 00000040:00080000:1.0:1788876875.086276:0:51113:0:(llog.c:805:llog_process_thread()) index: 19, lh_last_idx: 20 synced_idx: 0 lgh_last_idx: 20 00000040:00080000:1.0:1788876875.086282:0:51113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788876875.086415:0:51113:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 19, last_idx 20 00000040:00080000:1.0:1788876875.086431:0:51113:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x4e:0x0] at index 19 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788876875.086561:0:51113:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 20 synced_idx: 20 lgh_last_idx: 20 00000040:00080000:1.0:1788876875.086564:0:51113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788876875.087879:0:51105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876875.087892:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876875.087933:0:51105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788876875.087967:0:51105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afb1a 00000100:00080000:2.0:1788876875.087978:0:51105:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876875.087984:0:51105:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13f4438000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876875.088035:0:51105:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5c0700 x1875771532414848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876875.088090:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414848:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788876875.088180:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876875.088438:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414848 00000100:00100000:3.0:1788876875.088453:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414848 00000100:00080000:2.0:1788876875.088455:0:51105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788876875.088492:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1788876875.088499:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3661:x1875771532414848:12345-0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788876875.088508:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.088515:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.088518:0:51105:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788876875.088521:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876875.088525:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00080000:3.0:1788876875.088525:0:43959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1862 last 0 00000020:00000080:2.0:1788876875.088529:0:51105:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788876875.088532:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788876875.088534:0:51105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788876875.088536:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.088538:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.088539:0:51105:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788876875.088542:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876875.088544:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.088545:0:51105:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788876875.088548:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:00000080:3.0:1788876875.088560:0:43959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313afb21 00002000:00100000:3.0:1788876875.088573:0:43959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a12c49fa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788876875.088577:0:43959:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:2.0:1788876875.088579:0:51105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51105:1875771532414976:0@lo:502:llog_process_th.0 00002000:00100000:3.0:1788876875.088580:0:43959:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788876875.088653:0:51105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.088672:0:51105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d29ea240 going to sleep for 11 seconds 00002000:00080000:3.0:1788876875.088682:0:43959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788876875.088709:0:43959:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876875.088864:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532414976 00000100:00100000:0.0:1788876875.088868:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532414976 00000100:00100000:0.0:1788876875.088908:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788876875.088918:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51105:x1875771532414976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.089032:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51105:x1875771532414976:12345-0@lo:502:llog_process_th.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.089039:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788876875.089264:0:51105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51105:1875771532414976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788876875.089358:0:51105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876875.089363:0:51105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876875.089368:0:51105:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788876875.089372:0:51105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788876875.089502:0:51093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788876875.089732:0:51093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788876875.089754:0:51093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876875.089852:0:51093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876875.089867:0:51093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c4ebc800 from 1 10000000:01000000:0.0:1788876875.089870:0:51093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876875.089899:0:51093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876875.089932:0:51093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876875.089945:0:51093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876875.089983:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788876875.090020:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.090072:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.090126:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415104 00000100:00100000:2.0:1788876875.090133:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415104 00000100:00100000:2.0:1788876875.090301:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788876875.090316:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:51093:x1875771532415104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876875.090344:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876875.090399:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb28 expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.090432:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 9 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.090453:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 9 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.090466:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:0.0:1788876875.090575:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876875.090592:0:51093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876875.090652:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:51093:x1875771532415104:12345-0@lo:101:mount.lustre.0 Request processed in 225us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.090661:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788876875.090771:0:51093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876875.091343:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532414848:12345-0@lo:8:llog_process_th.0 Request processed in 2841us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.091352:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1788876875.091359:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788876875.091367:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788876875.091374:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788876875.091378:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788876875.091381:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f4438000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788876875.091395:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788876875.091401:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532414848:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1788876875.091420:0:51113:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788876875.091437:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532415232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876875.091481:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876875.091523:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415232 00000100:00100000:3.0:1788876875.091528:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415232 00000100:00080000:1.0:1788876875.091558:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788876875.091587:0:51113:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1862986984432ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788876875.091593:0:51113:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788876875.091648:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1788876875.091769:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532415232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876875.091792:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876875.091831:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532415232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.091902:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1788876875.093960:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415360:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788876875.094021:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.094072:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788876875.094930:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415360 00000100:00100000:3.0:1788876875.094939:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415360 00000100:00100000:3.0:1788876875.094992:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788876875.095001:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:51093:x1875771532415360:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788876875.095021:0:51101:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788876875.095040:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788876875.095044:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788876875.095048:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788876875.095050:0:51101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 82 00000100:00100000:3.0:1788876875.096354:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:51093:x1875771532415360:12345-0@lo:256:mount.lustre.0 Request processed in 1349us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.096365:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788876875.098071:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532415232:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788876875.098143:0:51094:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788876875.101319:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415360:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788876875.112638:0:51093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788876875.112670:0:51093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.112837:0:51093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876875.112849:0:51093:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c4ebc800 from 1 10000000:01000000:3.0:1788876875.112852:0:51093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876875.112896:0:51093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.112905:0:51093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.112916:0:51093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876875.112941:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876875.113017:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876875.113063:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db780 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.113184:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415488 00000100:00100000:2.0:1788876875.113193:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415488 00000100:00100000:2.0:1788876875.113250:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788876875.113260:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:51093:x1875771532415488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876875.113274:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876875.113289:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313afb3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb36 expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.113318:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313afb3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb36 expref: 10 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.113329:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313afb3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb36 expref: 10 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.113338:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c000, rc 0) 00000100:00100000:2.0:1788876875.113386:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532415488:12345-0@lo:101:mount.lustre.0 Request processed in 128us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.113393:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788876875.114700:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876875.114725:0:51093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876875.114738:0:51093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876875.114818:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876875.114874:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.114901:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876875.116537:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415616 00000100:00100000:3.0:1788876875.116553:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415616 00000100:00100000:3.0:1788876875.116650:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788876875.116661:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532415616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876875.116986:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532415616:12345-0@lo:501:mount.lustre.0 Request processed in 326us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.116994:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788876875.117411:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876875.117471:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876875.117524:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.117549:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876875.118323:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415744 00000100:00100000:3.0:1788876875.118329:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415744 00000100:00100000:3.0:1788876875.118370:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788876875.118378:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532415744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876875.118493:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532415744:12345-0@lo:503:mount.lustre.0 Request processed in 115us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.118501:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788876875.118642:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532415744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876875.122578:0:51115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51115:1875771532415872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.122723:0:51115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.122759:0:51115:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788876875.122920:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532415872 00000100:00100000:3.0:1788876875.122927:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532415872 00000100:00100000:3.0:1788876875.122978:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788876875.122989:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51115:x1875771532415872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876875.125290:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51115:x1875771532415872:12345-0@lo:502:llog_process_th.0 Request processed in 2294us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.125302:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788876875.126457:0:51115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51115:1875771532415872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876875.126506:0:51115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876875.126520:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.126523:0:51115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788876875.126531:0:51115:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13c4ebc800 00000020:00000080:0.0:1788876875.126535:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788876875.126543:0:51115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876875.126547:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.126548:0:51115:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788876875.126550:0:51115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876875.126553:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876875.126556:0:51115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788876875.126559:0:51115:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13c4ebc800 00000020:00000080:0.0:1788876875.126561:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788876875.126704:0:51115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51115:1875771532416000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.126769:0:51115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.126859:0:51115:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c36710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.140653:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416000 00000100:00100000:2.0:1788876875.140668:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416000 00000100:00100000:3.0:1788876875.140810:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788876875.140821:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51115:x1875771532416000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876875.140996:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51115:x1875771532416000:12345-0@lo:502:llog_process_th.0 Request processed in 177us (14226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.141004:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788876875.141238:0:51115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51115:1875771532416000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876875.141278:0:51115:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876875.141286:0:51115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876875.141289:0:51115:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788876875.141294:0:51115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788876875.141480:0:51093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788876875.141503:0:51093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876875.141515:0:51093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.141525:0:51093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876875.141574:0:51093:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788876875.141578:0:51093:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a13c4ebc800 10000000:01000000:3.0:1788876875.141580:0:51093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a13c4ebc800 10000000:01000000:3.0:1788876875.141584:0:51093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788876875.141590:0:51093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c4ebc800 from 1 10000000:01000000:3.0:1788876875.141593:0:51093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788876875.141646:0:51093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.141655:0:51093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876875.141669:0:51093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876875.141701:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788876875.141741:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876875.141774:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b98c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876875.141943:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416128 00000100:00100000:1.0:1788876875.141948:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416128 00000100:00100000:1.0:1788876875.141989:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788876875.141997:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:51093:x1875771532416128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876875.142006:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876875.142020:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afb4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb44 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.142041:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb44 expref: 11 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.142051:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afb4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb44 expref: 11 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.142060:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72600, rc 0) 00000100:00100000:1.0:1788876875.142094:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532416128:12345-0@lo:101:mount.lustre.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.142100:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788876875.142171:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876875.142184:0:51093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.142193:0:51093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876875.142247:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876875.142273:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.142294:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416256 00000100:00100000:2.0:1788876875.142297:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416256 00000100:00100000:2.0:1788876875.142330:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876875.142338:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532416256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876875.142434:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532416256:12345-0@lo:501:mount.lustre.0 Request processed in 97us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.142511:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788876875.142542:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d29eaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.142554:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876875.142580:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876875.142667:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.142684:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416384 00000100:00100000:2.0:1788876875.142698:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416384 00000100:00100000:2.0:1788876875.142717:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788876875.142723:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532416384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876875.142789:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532416384:12345-0@lo:503:mount.lustre.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.142796:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788876875.142826:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.142837:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532416384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876875.147004:0:51117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532416512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876875.147121:0:51117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876875.147164:0:51117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2401480 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.147334:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416512 00000100:00100000:2.0:1788876875.147343:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416512 00000100:00100000:2.0:1788876875.147401:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788876875.147411:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532416512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876875.147555:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532416512:12345-0@lo:502:llog_process_th.0 Request processed in 145us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.147563:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788876875.148737:0:51117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532416512:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788876875.148813:0:51117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788876875.148830:0:51117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c25e8000) 00000020:00000080:1.0:1788876875.148855:0:51117:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788876875.148946:0:51117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c4ebc800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788876875.148951:0:51117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13c4ebc800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788876875.148954:0:51117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13c4ebc800 4 00010000:00080000:1.0:1788876875.148981:0:51117:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13f07af000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788876875.152569:0:51117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788876875.156971:0:51117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788876875.157021:0:51117:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788876875.157035:0:51117:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313afb59 00000100:00080000:0.0:1788876875.157046:0:51117:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788876875.157052:0:51117:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13f07af000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.157090:0:51117:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd04700 x1875771532416640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876875.157124:0:51117:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788876875.157163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876875.157167:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876875.157170:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876875.157174:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1862 00000100:00080000:0.0:1788876875.157177:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876875.157181:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.157196:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd04000 x1875771532416768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876875.157205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876875.157208:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876875.157210:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876875.157213:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1862 00000100:00080000:0.0:1788876875.157222:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876875.157226:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.157236:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd07b80 x1875771532416896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876875.157268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876875.157271:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876875.157273:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876875.157276:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1862 00000100:00080000:0.0:1788876875.157279:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876875.157282:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.157293:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd07100 x1875771532417152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876875.157320:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876875.157324:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876875.157326:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876875.157329:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1862 00000100:00080000:0.0:1788876875.157332:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876875.157335:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876875.157345:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd05180 x1875771532417536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876875.158985:0:51117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532418176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.159069:0:51117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.159109:0:51117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788876875.160137:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532417664:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160195:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160233:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788876875.160239:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532417408:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160265:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160284:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532418048:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160308:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160335:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532416640:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876875.160362:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160380:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532416768:0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.160407:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160424:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532416896:0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.160453:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160472:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532417152:0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.160493:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160508:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532417536:0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.160526:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.160559:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417408 00000100:00100000:0.0:1788876875.160566:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417408 00000100:00100000:0.0:1788876875.160626:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418048 00000100:00100000:0.0:1788876875.160630:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418048 00000100:00100000:0.0:1788876875.160651:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1788876875.160659:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532417408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160720:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532417408:12345-0@lo:400:kworker.0 Request processed in 61us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.160727:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1788876875.160743:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1788876875.160749:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532418048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160777:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532418048:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.160782:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1788876875.160802:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417664 00000100:00100000:0.0:1788876875.160806:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417664 00000100:00100000:0.0:1788876875.160824:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416640 00000100:00100000:0.0:1788876875.160826:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416640 00000100:00100000:0.0:1788876875.160833:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416896 00000100:00100000:0.0:1788876875.160835:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416896 00000100:00100000:0.0:1788876875.160842:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417152 00000100:00100000:0.0:1788876875.160844:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417152 00000100:00100000:0.0:1788876875.160849:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417536 00000100:00100000:0.0:1788876875.160851:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417536 00000100:00100000:0.0:1788876875.160861:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1788876875.160867:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532417664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.160896:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532417664:12345-0@lo:400:kworker.0 Request processed in 29us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.160901:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1788876875.160913:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1788876875.160917:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532416640:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788876875.160959:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532416640:12345-0@lo:38:llog_process_th.0 Request processed in 39us (595us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876875.160964:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1788876875.160975:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1788876875.160979:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532416896:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.161006:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532416896:12345-0@lo:38:kworker.0 Request processed in 26us (563us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876875.161013:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1788876875.161030:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1788876875.161035:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532417152:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.161060:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532417152:12345-0@lo:38:kworker.0 Request processed in 24us (566us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876875.161066:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1788876875.161077:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788876875.161080:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532417536:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788876875.161235:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532417536:12345-0@lo:38:kworker.0 Request processed in 152us (707us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788876875.161241:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1788876875.161290:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532417408:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.161299:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532418048:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.161307:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532417664:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.161331:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788876875.161337:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07af000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876875.161340:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788876875.161343:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532416640:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788876875.161350:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876875.161353:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788876875.161355:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532416896:0@lo:38:kworker.0 00000100:00080000:0.0:1788876875.161361:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876875.161363:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788876875.161366:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532417152:0@lo:38:kworker.0 00000100:00080000:0.0:1788876875.161372:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876875.161374:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788876875.161376:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532417536:0@lo:38:kworker.0 00000100:00100000:1.0:1788876875.162274:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418176 00000100:00100000:1.0:1788876875.162282:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418176 00000100:00100000:1.0:1788876875.162326:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788876875.162334:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532418176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876875.162493:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532418176:12345-0@lo:502:llog_process_th.0 Request processed in 160us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.162501:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788876875.162764:0:51117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532418176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.162823:0:51117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532418304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876875.162866:0:51117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.162904:0:51117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.162949:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418304 00000100:00100000:2.0:1788876875.162954:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418304 00000100:00100000:2.0:1788876875.162988:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788876875.162996:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532418304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876875.163068:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51117:x1875771532418304:12345-0@lo:502:llog_process_th.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.163075:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788876875.163673:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532417280:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.163707:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.163730:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532417920:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.163753:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.163775:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788876875.163781:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532417024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.163802:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.163820:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532417792:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.163845:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.163877:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417920 00000100:00100000:2.0:1788876875.163882:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417920 00000100:00100000:2.0:1788876875.163909:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417024 00000100:00100000:2.0:1788876875.163913:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417024 00000100:00100000:2.0:1788876875.163933:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1788876875.163941:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.163978:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532417920:12345-0@lo:400:kworker.0 Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.163984:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1788876875.163996:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1788876875.164002:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.164027:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532417024:12345-0@lo:400:kworker.0 Request processed in 26us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.164035:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1788876875.164057:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532416768 00000100:00100000:2.0:1788876875.164060:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532416768 00000100:00100000:2.0:1788876875.164081:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417792 00000100:00100000:2.0:1788876875.164084:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417792 00000100:00100000:2.0:1788876875.164098:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1788876875.164103:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532416768:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788876875.164148:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532416768:12345-0@lo:38:kworker.0 Request processed in 44us (3739us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788876875.164237:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1788876875.164251:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1788876875.164258:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532417792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.164289:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532417792:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.164295:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1788876875.164331:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532417024:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.164340:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532417792:0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.164349:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532417920:0@lo:400:kworker.0 00000100:00080000:2.0:1788876875.164382:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876875.164386:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788876875.164390:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532416768:0@lo:38:kworker.0 00000100:00100000:2.0:1788876875.164406:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532417280 00000100:00100000:2.0:1788876875.164409:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532417280 00000100:00100000:2.0:1788876875.164435:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:2.0:1788876875.164452:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532417280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876875.164490:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532417280:12345-0@lo:400:kworker.0 Request processed in 49us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.164496:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:2.0:1788876875.164521:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532417280:0@lo:400:kworker.0 00000100:00100000:0.0:1788876875.166414:0:51117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51117:1875771532418304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788876875.166471:0:51117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788876875.170831:0:51093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788876875.170872:0:51093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788876875.170894:0:51093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.170907:0:51093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788876875.170960:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788876875.170963:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876875.170964:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876875.170966:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876875.170967:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876875.170968:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876875.170970:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876875.170971:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876875.170973:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876875.170974:0:51093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788876875.170978:0:51093:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788876875.170981:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788876875.170982:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876875.170983:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876875.170984:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876875.170985:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876875.170987:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876875.170988:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876875.170989:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876875.170990:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876875.170991:0:51093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788876875.171015:0:51093:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788876875.171034:0:51093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532418432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788876875.171100:0:51093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.171148:0:51093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234240 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.171331:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418432 00000100:00100000:2.0:1788876875.171339:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418432 00000100:00100000:2.0:1788876875.171390:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788876875.171399:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532418432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788876875.171425:0:51100:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788876875.171439:0:51100:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788876875.173020:0:51100:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876875.173036:0:51100:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788876875.173291:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:51093:x1875771532418432:12345-0@lo:253:mount.lustre.0 Request processed in 1890us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.173300:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:2.0:1788876875.173405:0:51103:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788876875.173410:0:51103:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788876875.173428:0:51103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.173453:0:51103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 10 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.173463:0:51103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.173495:0:51103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 10 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876875.173508:0:51103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 10 pid: 51100 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876875.173520:0:51103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:51103:1875771532418560:0@lo:104: 00000100:00100000:2.0:1788876875.173554:0:51103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.173581:0:51103:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876875.173639:0:51093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:51093:1875771532418432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788876875.173650:0:51093:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788876875.173653:0:51093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788876875.173655:0:51093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876875.173656:0:51093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876875.173658:0:51093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876875.173659:0:51093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876875.173660:0:51093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876875.173661:0:51093:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876875.173663:0:51093:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876875.173665:0:51093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876875.173666:0:51093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788876875.173678:0:51093:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788876875.173773:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418560 00000100:00100000:1.0:1788876875.173779:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418560 00000100:00100000:1.0:1788876875.173824:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788876875.173833:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:51103:x1875771532418560:12345-0@lo:104: 00010000:00010000:1.0:1788876875.173846:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.173893:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788876875.173899:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:51103:x1875771532418560:12345-0@lo:104: Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.173905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1788876875.173923:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876875.173929:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.173936:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876875.173940:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.173953:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876875.173961:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876875.173966:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788876875.173994:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174000:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876875.174019:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174027:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220a00/0xf5bf0f7e313afb28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313afb2f expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174042:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876875.174044:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876875.174046:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876875.174068:0:51103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:51103:1875771532418560:0@lo:104: 00010000:00010000:1.0:1788876875.174081:0:51103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876875.174100:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532418688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876875.174141:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876875.174184:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418688 00000100:00100000:1.0:1788876875.174188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418688 00010000:00010000:1.0:1788876875.174205:0:6526:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 11 pid: 51100 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876875.174239:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788876875.174245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3663:x1875771532418688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876875.174258:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876875.174263:0:6526:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 11 pid: 51100 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174274:0:6526:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 11 pid: 51100 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174286:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afb2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313afb28 expref: 11 pid: 51100 timeout: 1963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174299:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174306:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876875.174316:0:6526:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006275695s 00010000:00010000:1.0:1788876875.174320:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174326:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174333:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174339:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174344:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8ca00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876875.174349:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174356:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174369:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174377:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876875.174404:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3663:x1875771532418688:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876875.174410:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:1.0:1788876875.174426:0:51103:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174432:0:51103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876875.174438:0:51103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afb60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 51103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876875.175127:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532418688:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788876875.215143:0:51093:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:0.0:1788876875.216336:0:51093:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788876875.216477:0:51123:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:2.0:1788876875.216482:0:51123:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:2.0:1788876875.217153:0:51124:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788876875.217945:0:51093:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788876875.219410:0:51125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532418816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876875.219486:0:51125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.219521:0:51125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7e4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788876875.221119:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418816 00000100:00100000:3.0:1788876875.221131:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418816 00000100:00100000:3.0:1788876875.221204:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1788876875.221224:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532418816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876875.221341:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532418816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876875.221349:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1788876875.221551:0:51125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532418816:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788876875.221588:0:51125:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788876875.221663:0:51125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532418944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788876875.221712:0:51125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876875.221728:0:51125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3b18240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876875.223858:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532418944 00000100:00100000:0.0:1788876875.223870:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532418944 00000100:00100000:0.0:1788876875.223917:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1788876875.223926:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532418944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224088:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532418944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 162us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.224096:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1788876875.224144:0:51125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532418944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224252:0:51125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532419072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224288:0:51125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.224311:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419072 00000100:00100000:0.0:1788876875.224314:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419072 00000100:00100000:0.0:1788876875.224329:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1788876875.224334:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532419072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224377:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532419072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.224384:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1788876875.224400:0:51125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:0.0:1788876875.224413:0:51125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532419072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224490:0:51125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532419200:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.224556:0:51125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876875.224576:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419200 00000100:00100000:0.0:1788876875.224579:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419200 00000100:00100000:0.0:1788876875.224597:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1788876875.224633:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532419200:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876875.227644:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:51125:x1875771532419200:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 3032us (3078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.227657:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1788876875.227714:0:51125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c36716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876875.227746:0:51125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:51125:1875771532419200:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788876875.232910:0:51093:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788876875.232953:0:51093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788876875.234335:0:51093:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788876875.234351:0:51093:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788876875.234418:0:51093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876875.239845:0:51093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788876875.240418:0:51093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:2.0:1788876875.241922:0:51124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788876875.242008:0:51124:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788876875.244869:0:51125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788876875.244959:0:51125:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788876875.244965:0:51125:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788876875.245846:0:51093:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788876875.245967:0:51093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788876875.247017:0:51093:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x47:0x0] (8/32) registered 00010000:00080000:1.0:1788876875.249547:0:51093:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 81604378630 00010000:00080000:2.0:1788876875.255341:0:51126:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 51126 00010000:02000000:2.0:1788876875.255916:0:51126:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1788876875.256335:0:51093:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788876875.256356:0:51093:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788876875.256374:0:51093:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788876875.256398:0:51093:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788876875.257388:0:51093:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788876875.257693:0:51093:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:3.0:1788876875.264075:0:51126:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788876875.264085:0:51126:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788876875.444522:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876875.444571:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876875.444596:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876875.444638:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876875.444760:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285120 00000100:00100000:2.0:1788876875.444770:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285120 00000100:00100000:2.0:1788876875.444824:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511284992 00000100:00100000:2.0:1788876875.444828:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511284992 00000100:00100000:2.0:1788876875.444847:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1811 00000100:00100000:2.0:1788876875.444856:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511285120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876875.444923:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511285120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.444931:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1811 00000100:00100000:2.0:1788876875.444947:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2625 00000100:00100000:2.0:1788876875.444952:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511284992:12345-192.168.203.11@tcp:38:kworker.0 00010000:00080000:2.0:1788876875.444973:0:8722:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13ff33b000, cookie 0xf5bf0f7e313afab8 00010000:00080000:2.0:1788876875.445216:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t81604378631 exp ffff8a13ff33b000 cur 1863 last 1788876875 00010000:02000400:2.0:1788876875.445228:0:8722:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1788876875.445234:0:8722:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788876875.445252:0:8722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788876875.445835:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00080000:2.0:1788876875.445999:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876875.446037:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511284992:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 1082us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876875.446044:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2625 00000100:00100000:0.0:1788876875.448859:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285504 00000100:00100000:0.0:1788876875.448871:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285504 00000100:00100000:0.0:1788876875.448910:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1788876875.448920:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1875771511285504:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:0.0:1788876875.448944:0:51101:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 1863 last 0 00000020:00000080:0.0:1788876875.448974:0:51101:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313afb67 00000100:00080000:0.0:1788876875.449118:0:51101:0:(import.c:65:import_set_state_nolock()) ffff8a13ff364800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876875.449173:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511285504:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 254us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.449181:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1788876875.462222:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285376 00000100:00100000:0.0:1788876875.462237:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285376 00000100:00100000:0.0:1788876875.462290:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285248 00000100:00100000:0.0:1788876875.462294:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285248 00000100:00100000:0.0:1788876875.462322:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1373 00000100:00100000:0.0:1788876875.462332:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511285376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876875.462401:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511285376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (17830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.462409:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1373 00000100:00100000:0.0:1788876875.462428:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1374 00000100:00100000:0.0:1788876875.462435:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511285248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876875.462475:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511285248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (17878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876875.462483:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1374 00000100:00080000:1.0:1788876875.463772:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876875.463779:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876875.463781:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876875.469798:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876875.469837:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278464 00000100:00100000:1.0:1788876875.469846:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278464 00000100:00100000:1.0:1788876875.469890:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2626 00000100:00100000:1.0:1788876875.469900:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511278464:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:1.0:1788876875.469918:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 81604378631, current: 81604378631, replaying 00000100:00100000:1.0:1788876875.469931:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511278464:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 34us (142us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876875.469937:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2626 00010000:00080000:3.0:1788876875.477506:0:51126:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1788876875.945357:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876876.265226:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876876.265251:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532419328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876876.265328:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876876.265375:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419328 00000100:00100000:2.0:1788876876.265383:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419328 00000100:00080000:1.0:1788876876.265426:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876876.265463:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1788876876.265472:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532419328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876876.265510:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876876.265576:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532419328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.265586:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788876876.265683:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532419328:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1788876876.392798:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788876876.392805:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c4ebc800 from 83 10000000:01000000:1.0:1788876876.392810:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788876876.392854:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.392866:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.392876:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.392901:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.392968:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.393018:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876876.393068:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419456 00000100:00100000:3.0:1788876876.393077:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419456 00000100:00100000:3.0:1788876876.393141:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788876876.393150:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532419456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.393162:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876876.393176:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7960e00/0xf5bf0f7e313afb75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb6e expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.393198:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7960e00/0xf5bf0f7e313afb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb6e expref: 11 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.393212:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7960e00/0xf5bf0f7e313afb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb6e expref: 11 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.393219:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960e00, rc 0) 00000100:00100000:3.0:1788876876.393257:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532419456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876876.393263:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788876876.393592:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.393715:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.393724:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.393772:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.393805:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.393828:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876876.398301:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419584 00000100:00100000:0.0:1788876876.398319:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419584 00000100:00100000:0.0:1788876876.398401:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788876876.398412:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532419584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788876876.398474:0:51099:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788876876.398499:0:51099:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788876876.398502:0:51099:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 83 00000100:00100000:0.0:1788876876.398693:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532419584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 282us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876876.398701:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788876876.399307:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788876876.400785:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876876.400801:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.400814:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.400825:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788876876.400828:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:1.0:1788876876.400831:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788876876.400867:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.400875:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.400885:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.400909:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.400973:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.401022:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876876.404362:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419712 00000100:00100000:0.0:1788876876.404388:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419712 00000100:00100000:0.0:1788876876.404459:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788876876.404470:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532419712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876876.404490:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876876.404508:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313afb83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb7c expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.404541:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313afb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb7c expref: 12 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.404567:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313afb83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb7c expref: 12 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.404577:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221a00, rc 0) 00000100:00100000:0.0:1788876876.404681:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532419712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876876.404689:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788876876.404728:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.404749:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.404759:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.404830:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.404864:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.404889:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.404953:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419840 00000100:00100000:2.0:1788876876.404958:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419840 00000100:00100000:2.0:1788876876.404990:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788876876.404997:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532419840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.405142:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532419840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.405149:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788876876.406728:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.406787:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.406855:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.406894:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.407210:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532419968 00000100:00100000:1.0:1788876876.407218:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532419968 00000100:00100000:1.0:1788876876.407271:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788876876.407286:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532419968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.407413:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532419968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.407420:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788876876.408143:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532419968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788876876.408951:0:51177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1788876876.409155:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1788876876.409180:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788876876.409190:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.409201:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.409211:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788876876.409214:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1788876876.409217:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788876876.409253:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.409262:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.409277:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.409300:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.409358:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.409400:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876876.412186:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420096 00000100:00100000:0.0:1788876876.412201:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420096 00000100:00100000:0.0:1788876876.412276:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788876876.412287:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532420096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876876.412306:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876876.412330:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220c00/0xf5bf0f7e313afb91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb8a expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.412363:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220c00/0xf5bf0f7e313afb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb8a expref: 13 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.412377:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220c00/0xf5bf0f7e313afb91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb8a expref: 13 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.412387:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220c00, rc 0) 00000100:00100000:0.0:1788876876.412478:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876876.412484:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788876876.412690:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.412710:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.412721:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.412794:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.412830:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.412864:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876876.412920:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420224 00000100:00100000:0.0:1788876876.412926:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420224 00000100:00100000:0.0:1788876876.412962:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788876876.412969:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.413126:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876876.413134:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788876876.413250:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.413281:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.413331:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.413357:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876876.414286:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420352 00000100:00100000:0.0:1788876876.414296:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420352 00000100:00100000:0.0:1788876876.414345:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788876876.414354:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.421788:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 7428us (8448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.421806:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788876876.421934:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876876.431643:0:51178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788876876.431803:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788876876.431827:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788876876.431839:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.431852:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876876.431861:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788876876.431864:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:3.0:1788876876.431867:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876876.431907:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.431916:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.431927:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.431952:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.432019:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.432054:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.432546:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420480 00000100:00100000:1.0:1788876876.432555:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420480 00000100:00100000:1.0:1788876876.432622:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788876876.432632:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532420480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.432646:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.432659:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72a00/0xf5bf0f7e313afb9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afb98 expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.432683:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72a00/0xf5bf0f7e313afb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb98 expref: 14 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.432693:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72a00/0xf5bf0f7e313afb9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afb98 expref: 14 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.432702:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72a00, rc 0) 00000100:00100000:1.0:1788876876.432745:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.432752:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788876876.433194:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.433209:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.433217:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.433275:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.433306:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.433328:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876876.433341:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420608 00000100:00100000:3.0:1788876876.433344:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420608 00000100:00100000:3.0:1788876876.433368:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788876876.433374:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.433488:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876876.433495:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788876876.433525:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.433551:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.433623:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.433635:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2419180 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.433820:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420736 00000100:00100000:1.0:1788876876.433825:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420736 00000100:00100000:1.0:1788876876.433858:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788876876.433865:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.433949:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.433955:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788876876.433997:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876876.434643:0:51180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788876876.434688:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788876876.434709:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788876876.434717:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434726:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.434735:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788876876.434737:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:1.0:1788876876.434739:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788876876.434762:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434770:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434777:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.434791:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.434821:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.434845:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.434858:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420864 00000100:00100000:1.0:1788876876.434862:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420864 00000100:00100000:1.0:1788876876.434887:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788876876.434894:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532420864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.434902:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.434914:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313afbad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afba6 expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434935:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313afbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afba6 expref: 15 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434944:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313afbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afba6 expref: 15 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.434957:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73600, rc 0) 00000100:00100000:1.0:1788876876.434984:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532420864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.434989:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788876876.435019:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.435031:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.435039:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.435077:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.435100:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.435112:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.435123:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532420992 00000100:00100000:1.0:1788876876.435126:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532420992 00000100:00100000:1.0:1788876876.435145:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788876876.435150:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532420992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.435242:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532420992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.435249:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788876876.435277:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532420992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.435303:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.435339:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.435353:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.435364:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421120 00000100:00100000:1.0:1788876876.435367:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421120 00000100:00100000:1.0:1788876876.435387:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788876876.435393:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532421120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.435469:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532421120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.435476:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788876876.435509:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876876.438557:0:51181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788876876.439714:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788876876.439746:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788876876.439757:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.439768:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876876.439778:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788876876.439781:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788876876.439784:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788876876.439822:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.439830:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.439844:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876876.439868:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.439931:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876876.439971:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c61a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.441745:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421248 00000100:00100000:1.0:1788876876.441756:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421248 00000100:00100000:1.0:1788876876.441836:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788876876.441847:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532421248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.441865:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.441885:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313afbbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbb4 expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.441913:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313afbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbb4 expref: 16 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.441926:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313afbbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbb4 expref: 16 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.441935:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73000, rc 0) 00000100:00100000:1.0:1788876876.442059:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.442065:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788876876.448025:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.448055:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.448069:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876876.448236:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.448299:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876876.448343:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c61a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876876.448462:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421376 00000100:00100000:3.0:1788876876.448468:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421376 00000100:00100000:3.0:1788876876.448516:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788876876.448525:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.448741:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876876.448754:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788876876.451656:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.451720:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.451790:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876876.451832:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c61a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.451922:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421504 00000100:00100000:1.0:1788876876.451928:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421504 00000100:00100000:1.0:1788876876.451983:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788876876.451993:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.452949:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 952us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.452960:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788876876.453055:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876876.453922:0:51183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1788876876.454082:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1788876876.454106:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788876876.454117:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.454128:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876876.454137:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788876876.454140:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:3.0:1788876876.454142:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876876.454187:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.454196:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.454205:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.454228:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.454284:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.454319:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.454455:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421632 00000100:00100000:1.0:1788876876.454462:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421632 00000100:00100000:1.0:1788876876.454509:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788876876.454519:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532421632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.454531:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.454546:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73800/0xf5bf0f7e313afbc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbc2 expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.454572:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73800/0xf5bf0f7e313afbc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbc2 expref: 17 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.454584:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73800/0xf5bf0f7e313afbc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbc2 expref: 17 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.454594:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73800, rc 0) 00000100:00100000:1.0:1788876876.455242:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532421632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 721us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.455250:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788876876.461597:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.461653:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.461666:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.461758:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.461842:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.461881:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.461968:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421760 00000100:00100000:1.0:1788876876.461975:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421760 00000100:00100000:1.0:1788876876.462022:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788876876.462031:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532421760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.462170:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532421760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.462178:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788876876.462322:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.462353:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.462397:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.462424:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.462467:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532421888 00000100:00100000:1.0:1788876876.462471:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532421888 00000100:00100000:1.0:1788876876.462531:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788876876.462539:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532421888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.462643:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532421888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.462650:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788876876.462736:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532421888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876876.474704:0:51185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788876876.475700:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788876876.475730:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788876876.475743:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.475757:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.475775:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788876876.475778:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:1.0:1788876876.475782:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788876876.475828:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.475837:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.475848:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.475879:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.475965:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.476033:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876876.476227:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422016 00000100:00100000:3.0:1788876876.476236:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422016 00000100:00100000:3.0:1788876876.476301:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788876876.476311:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532422016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.476325:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876876.476341:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7960600/0xf5bf0f7e313afbd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbd0 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.476366:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7960600/0xf5bf0f7e313afbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbd0 expref: 18 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.476378:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7960600/0xf5bf0f7e313afbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbd0 expref: 18 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.476387:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960600, rc 0) 00000100:00100000:3.0:1788876876.477507:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1190us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876876.477518:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788876876.481805:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876876.481843:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.481856:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876876.481953:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.482036:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.482134:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.486983:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422144 00000100:00100000:2.0:1788876876.486998:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422144 00000100:00100000:2.0:1788876876.487069:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788876876.487080:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.487356:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (5320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.487364:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788876876.487451:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.487505:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.487572:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.487631:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.487953:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422272 00000100:00100000:2.0:1788876876.487958:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422272 00000100:00100000:2.0:1788876876.487994:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788876876.488001:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.488099:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.488107:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788876876.488250:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876876.497916:0:51187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788876876.498161:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788876876.498199:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876876.498212:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.498225:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876876.498236:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788876876.498239:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 80 10000000:01000000:0.0:1788876876.498241:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876876.498281:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.498289:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.498300:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876876.498325:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.498406:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.498458:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3b18240 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.498580:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422400 00000100:00100000:1.0:1788876876.498589:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422400 00000100:00100000:1.0:1788876876.498671:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788876876.498681:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532422400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.498696:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.498709:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313afbe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbde expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.498734:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313afbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbde expref: 19 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.498743:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313afbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbde expref: 19 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.498752:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72400, rc 0) 00000100:00100000:1.0:1788876876.498790:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532422400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.498797:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788876876.499942:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876876.499962:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.499972:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876876.500038:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.500095:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.500134:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3b18240 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.500243:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422528 00000100:00100000:1.0:1788876876.500249:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422528 00000100:00100000:1.0:1788876876.500287:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788876876.500295:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532422528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788876876.500313:0:51101:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788876876.500329:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788876876.500333:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1788876876.500336:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1788876876.500339:0:51101:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1788876876.500342:0:51101:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 83 00000100:00100000:1.0:1788876876.500418:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532422528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.500426:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788876876.500497:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788876876.500568:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788876876.500575:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.500584:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876876.500592:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788876876.500594:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1788876876.500597:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788876876.500649:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.500657:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.500665:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876876.500677:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.500707:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.500725:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c67b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.500793:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422656 00000100:00100000:1.0:1788876876.500798:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422656 00000100:00100000:1.0:1788876876.500821:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788876876.500827:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532422656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.500835:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.500847:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313afbf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbec expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.500865:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313afbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbec expref: 20 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.500875:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313afbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbec expref: 20 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.500883:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73200, rc 0) 00000100:00100000:1.0:1788876876.500910:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532422656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.500916:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788876876.500987:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876876.500998:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.501005:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876876.501058:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876876.501086:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876876.501983:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c67b8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.516992:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422784 00000100:00100000:1.0:1788876876.517006:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422784 00000100:00100000:1.0:1788876876.517068:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788876876.517078:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532422784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.517271:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532422784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (16183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.517278:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788876876.517342:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.517395:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.517461:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.517490:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.517502:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532422912 00000100:00100000:1.0:1788876876.517505:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532422912 00000100:00100000:1.0:1788876876.517526:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788876876.517532:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532422912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.518254:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532422912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 720us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.518261:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788876876.518335:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532422912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788876876.519120:0:51190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788876876.519361:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788876876.519387:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788876876.519396:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.519406:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.519415:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788876876.519417:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:1.0:1788876876.519419:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788876876.519459:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.519468:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.519477:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.519495:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.519534:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.519568:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.519962:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423040 00000100:00100000:2.0:1788876876.519969:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423040 00000100:00100000:2.0:1788876876.520012:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788876876.520019:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532423040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876876.520031:0:51100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876876.520042:0:51100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afc01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afbfa expref: -99 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.520065:0:51100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbfa expref: 21 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.520076:0:51100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afc01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afbfa expref: 21 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.520084:0:51100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8ca00, rc 0) 00000100:00100000:2.0:1788876876.520123:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532423040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.520129:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788876876.520325:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.520339:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.520347:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.520360:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788876876.520364:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.520370:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.520376:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788876876.520377:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:1.0:1788876876.520380:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788876876.520395:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.520407:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.520414:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.520425:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.520458:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.520484:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.524010:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423168 00000100:00100000:2.0:1788876876.524026:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423168 00000100:00100000:2.0:1788876876.524086:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788876876.524098:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532423168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876876.524115:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876876.524136:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afc0f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afc08 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.524178:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afc0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc08 expref: 22 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.524190:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afc0f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc08 expref: 22 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876876.524200:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c400, rc 0) 00000100:00100000:2.0:1788876876.524281:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532423168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876876.524289:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788876876.524482:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.524501:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.524512:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876876.524535:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788876876.524540:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.524548:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876876.524556:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788876876.524559:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:3.0:1788876876.524562:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876876.524589:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.524596:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.524640:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.524660:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.524695:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.524726:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.524834:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423296 00000100:00100000:1.0:1788876876.524839:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423296 00000100:00100000:1.0:1788876876.524868:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788876876.524875:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532423296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876876.524882:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876876.524891:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313afc1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afc16 expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.524904:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313afc1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc16 expref: 23 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.524912:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313afc1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc16 expref: 23 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.524919:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72c00, rc 0) 00000100:00100000:1.0:1788876876.524949:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.524955:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788876876.525020:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.525030:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.525038:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.525088:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.525112:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.525137:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.525234:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423424 00000100:00100000:1.0:1788876876.525238:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423424 00000100:00100000:1.0:1788876876.525270:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788876876.525276:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.525373:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.525378:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788876876.525537:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.525561:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.525626:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.525640:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876876.525698:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423552 00000100:00100000:1.0:1788876876.525702:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423552 00000100:00100000:1.0:1788876876.525722:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788876876.525727:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.525789:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876876.525795:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788876876.525890:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876876.526744:0:51192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788876876.527011:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788876876.527035:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788876876.527046:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.527057:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876876.527067:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788876876.527070:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:1.0:1788876876.527073:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788876876.527102:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.527110:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876876.527122:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876876.527141:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876876.527206:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876876.527243:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7e609c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876876.529461:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423680 00000100:00100000:3.0:1788876876.529474:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423680 00000100:00100000:3.0:1788876876.529534:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788876876.529544:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532423680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.529559:0:51099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876876.529577:0:51099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313afc2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313afc24 expref: -99 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.529624:0:51099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313afc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc24 expref: 24 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.529636:0:51099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313afc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313afc24 expref: 24 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.529645:0:51099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7960a00, rc 0) 00000100:00100000:3.0:1788876876.529714:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532423680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876876.529721:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788876876.529771:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876876.529793:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.529804:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876876.529878:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876876.529912:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876876.529938:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876876.530049:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423808 00000100:00100000:2.0:1788876876.530054:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423808 00000100:00100000:2.0:1788876876.530089:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788876876.530096:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532423808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876876.530189:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532423808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (275us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876876.530197:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788876876.530354:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532423808:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788876876.530386:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788876876.530393:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876876.530401:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876876.968762:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876877.288817:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532423936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876877.288884:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876877.288954:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532423936 00000100:00100000:3.0:1788876877.288961:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532423936 00000100:00100000:3.0:1788876877.289027:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788876877.289038:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532423936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876877.289064:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876877.289105:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532423936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876877.289111:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788876877.289172:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532423936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788876877.291033:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876877.361351:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.365570:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285632 00000100:00100000:2.0:1788876877.365630:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285632 00000100:00100000:3.0:1788876877.367827:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1788876877.367845:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511285632:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876877.367867:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876877.367891:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313afc32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048989 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876877.367930:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313afc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048989 expref: 6 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876877.367944:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313afc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048989 expref: 6 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876877.367954:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7961c00, rc 0) 00000100:00100000:3.0:1788876877.368042:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511285632:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 202us (6774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876877.368050:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1788876877.371829:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.376449:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285760 00000100:00100000:2.0:1788876877.376469:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285760 00000100:00100000:2.0:1788876877.376553:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1788876877.376567:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511285760:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788876877.376624:0:51099:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788876877.376647:0:51099:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788876877.376651:0:51099:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788876877.376654:0:51099:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788876877.376657:0:51099:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788876877.376660:0:51099:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 83 00000100:00100000:2.0:1788876877.378845:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511285760:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 2268us (7014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876877.378861:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1788876877.390865:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876877.391837:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511285888 00000100:00100000:1.0:1788876877.391856:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511285888 00000100:00100000:1.0:1788876877.391927:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1788876877.391940:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511285888:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876877.391961:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876877.391985:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313afc39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048990 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876877.392023:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313afc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048990 expref: 7 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876877.392036:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313afc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048990 expref: 7 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876877.392049:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34c00, rc 0) 00000100:00100000:1.0:1788876877.392130:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511285888:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 192us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876877.392137:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:0.0:1788876877.400478:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.400840:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286016 00000100:00100000:2.0:1788876877.400853:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286016 00000100:00100000:2.0:1788876877.400920:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1788876877.400933:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511286016:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876877.401337:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511286016:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 405us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876877.401347:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1788876877.423582:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876877.423723:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286144 00000100:00100000:0.0:1788876877.423735:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286144 00000100:00100000:0.0:1788876877.423792:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1788876877.423803:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511286144:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876877.423978:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511286144:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 177us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876877.423988:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1788876877.449030:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.450311:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286272 00000100:00100000:2.0:1788876877.450336:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286272 00000100:00100000:2.0:1788876877.450416:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1788876877.450428:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511286272:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876877.450460:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876877.450486:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313afc40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048997 expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.450525:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313afc40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048997 expref: 9 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.450539:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313afc40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048997 expref: 9 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.450550:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8de00, rc 0) 00000100:00100000:2.0:1788876877.450658:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286272:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 230us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876877.450665:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1788876877.468570:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.468736:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286400 00000100:00100000:2.0:1788876877.468749:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286400 00000100:00100000:2.0:1788876877.468810:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1788876877.468821:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286400:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876877.469009:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286400:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 189us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876877.469018:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1788876877.494540:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876877.494585:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286528 00000100:00100000:0.0:1788876877.494598:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286528 00000100:00100000:0.0:1788876877.494684:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1788876877.494697:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286528:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876877.494889:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286528:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 193us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876877.494898:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1788876877.520230:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.523316:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286656 00000100:00100000:2.0:1788876877.523336:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286656 00000100:00100000:2.0:1788876877.523410:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1788876877.523420:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511286656:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876877.523448:0:51101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876877.523470:0:51101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313afc47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc3704899e expref: -99 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.523505:0:51101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313afc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704899e expref: 10 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.523519:0:51101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313afc47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704899e expref: 10 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876877.523530:0:51101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8cc00, rc 0) 00000100:00100000:2.0:1788876877.523628:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511286656:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 210us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876877.523636:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1788876877.527498:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876877.527865:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286784 00000100:00100000:2.0:1788876877.527879:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286784 00000100:00100000:2.0:1788876877.527953:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1788876877.527965:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511286784:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876877.528447:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511286784:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 482us (960us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876877.528458:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:1.0:1788876878.004924:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876879.020845:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.041689:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876880.361284:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876880.361291:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876880.361295:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876880.361306:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876880.361326:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd04e00 x1875771532424192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876880.361342:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876880.361346:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876880.361347:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876880.361350:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876880.361362:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd04000 x1875771532424320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876880.361375:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876880.361378:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876880.361380:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876880.361384:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876880.361392:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd06300 x1875771532424576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876880.361414:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876880.361427:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876880.361428:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876880.361433:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876880.361443:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd07b80 x1875771532424960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876880.361471:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788876880.361475:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876880.361476:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f07af000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876880.361481:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13f07af000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876880.361491:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f408aa00 x1875771532425600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876880.361520:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532424448:0@lo:400:kworker.0 00000100:00100000:0.0:1788876880.361590:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.361653:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532425216:0@lo:400:kworker.0 00000100:00100000:0.0:1788876880.361679:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.361700:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788876880.361706:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532424064:0@lo:400:kworker.0 00000100:00100000:0.0:1788876880.361732:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.361751:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532425088:0@lo:400:kworker.0 00000100:00100000:0.0:1788876880.361775:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.361805:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425216 00000100:00100000:0.0:1788876880.361812:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425216 00000100:00100000:0.0:1788876880.361853:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1788876880.361876:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876880.361930:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532425216:12345-0@lo:400:kworker.0 Request processed in 56us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876880.361938:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1788876880.361977:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532425216:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364279:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532424704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364336:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.364372:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532425344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364399:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.364433:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788876880.364439:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532424832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364465:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.364485:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532425472:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364508:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.364543:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424064 00000100:00100000:3.0:1788876880.364549:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424064 00000100:00100000:3.0:1788876880.364593:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788876880.364616:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532424064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364666:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532424064:12345-0@lo:400:kworker.0 Request processed in 65us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.364673:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788876880.364709:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424448 00000100:00100000:3.0:1788876880.364713:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424448 00000100:00100000:3.0:1788876880.364741:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425344 00000100:00100000:3.0:1788876880.364743:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425344 00000100:00100000:3.0:1788876880.364756:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424832 00000100:00100000:3.0:1788876880.364758:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424832 00000100:00100000:3.0:1788876880.364772:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425472 00000100:00100000:3.0:1788876880.364774:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425472 00000100:00100000:3.0:1788876880.364788:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1788876880.364793:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532424448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364822:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532424448:12345-0@lo:400:kworker.0 Request processed in 29us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.364827:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1788876880.364837:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1788876880.364843:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532425344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364883:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532425344:12345-0@lo:400:kworker.0 Request processed in 41us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.364889:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1788876880.364899:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1788876880.364906:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532424832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364931:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532424832:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.364937:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1788876880.364947:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1788876880.364953:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532425472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.364977:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532425472:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.364982:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1788876880.365025:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532424064:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.365038:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532424448:0@lo:400:kworker.0 00000100:00080000:3.0:1788876880.365063:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876880.365067:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876880.365091:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532424832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.365101:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532425472:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.365110:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532425344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.366993:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532424192:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.367051:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367080:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532424320:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.367104:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367139:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532424576:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.367161:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367179:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532424960:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.367215:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367234:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532425600:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.367258:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367285:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532425728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876880.367307:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.367343:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424192 00000100:00100000:3.0:1788876880.367350:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424192 00000100:00100000:3.0:1788876880.367378:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425728 00000100:00100000:3.0:1788876880.367381:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425728 00000100:00100000:3.0:1788876880.367401:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1788876880.367407:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532424192:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.367440:0:6545:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a13c3006800, cookie 0xf5bf0f7e313afab1 00010000:00080000:3.0:1788876880.367446:0:6545:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a13c3006800 cur 1868 last 1788876875 00000004:00100000:3.0:1788876880.367464:0:6545:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876880.367621:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a13c3005800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876880.367674:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532424192:12345-0@lo:38:kworker.0 Request processed in 265us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.367681:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1788876880.367697:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1788876880.367704:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532425728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876880.367726:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876880.367756:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532425728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.367762:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1788876880.367780:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425088 00000100:00100000:3.0:1788876880.367784:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425088 00000100:00100000:3.0:1788876880.367807:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424704 00000100:00100000:3.0:1788876880.367809:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424704 00000100:00100000:3.0:1788876880.367820:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424320 00000100:00100000:3.0:1788876880.367823:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424320 00000100:00100000:3.0:1788876880.367830:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424576 00000100:00100000:3.0:1788876880.367832:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424576 00000100:00100000:3.0:1788876880.367839:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532424960 00000100:00100000:3.0:1788876880.367841:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532424960 00000100:00100000:3.0:1788876880.367848:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425600 00000100:00100000:3.0:1788876880.367850:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425600 00000100:00100000:3.0:1788876880.367872:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1788876880.367880:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532425088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.367910:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532425088:12345-0@lo:400:kworker.0 Request processed in 32us (6134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.367921:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:3.0:1788876880.367933:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1788876880.367939:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532424704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.367968:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532424704:12345-0@lo:400:kworker.0 Request processed in 30us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.367974:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:3.0:1788876880.367986:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1788876880.367990:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532424320:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.368002:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1868 last 0 00000020:00000080:3.0:1788876880.368037:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313afc4e 00000004:00100000:3.0:1788876880.368045:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876880.368063:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a13f4440800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876880.368091:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532424320:12345-0@lo:38:kworker.0 Request processed in 100us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.368098:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1788876880.368112:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1788876880.368116:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532424576:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.368128:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1868 last 0 00000020:00000080:3.0:1788876880.368153:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313afc55 00000004:00100000:3.0:1788876880.368159:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876880.368174:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a13c720d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876880.368200:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532424576:12345-0@lo:38:kworker.0 Request processed in 83us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.368207:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1788876880.368220:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1788876880.368223:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532424960:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.368235:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1868 last 0 00000020:00000080:3.0:1788876880.368256:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313afc5c 00000004:00100000:3.0:1788876880.368262:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876880.368277:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a13c5fff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876880.368303:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532424960:12345-0@lo:38:kworker.0 Request processed in 78us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.368310:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:3.0:1788876880.368322:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:3.0:1788876880.368327:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532425600:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.368338:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1868 last 0 00000020:00000080:3.0:1788876880.368356:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313afc63 00000004:00100000:3.0:1788876880.368362:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876880.368375:0:6541:0:(import.c:65:import_set_state_nolock()) ffff8a13c5ff9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876880.368401:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532425600:12345-0@lo:38:kworker.0 Request processed in 72us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.368406:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00010000:00080000:3.0:1788876880.368439:0:51126:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788876880.368444:0:51126:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 81604378631 00000020:00080000:3.0:1788876880.368449:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.368452:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 81604378631, next_transno: 81604378631 00010000:00080000:3.0:1788876880.368456:0:51126:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (81604378631) 00000020:00080000:3.0:1788876880.368458:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.368469:0:51126:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511278464 t81604378631 from 192.168.203.11@tcp req@ffff8a13f45d9180 x1875771511278464/t0(81604378631) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:271/0 lens 528/0 e 0 to 0 dl 1788876886 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.368540:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876880.368576:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532425088:0@lo:400:kworker.0 00000100:00100000:3.0:1788876880.368630:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532425728:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788876880.368656:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 20 00000100:00080000:3.0:1788876880.368665:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788876880.368670:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788876880.368673:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1788876880.368676:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788876880.368679:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788876880.368705:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532424704:0@lo:400:kworker.0 00000004:00080000:2.0:1788876880.371361:0:51126:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2840us 00000100:00100000:3.0:1788876880.372078:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532424192:0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.372116:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13cfd04000 x1875771532424320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.374113:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 20 00000100:00080000:3.0:1788876880.376387:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a13cfd04000 x1875771532424320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.376402:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876880.376408:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876880.376412:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876880.376427:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532424320:0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.376463:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13cfd06300 x1875771532424576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.376484:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 20 00010000:00080000:0.0:1788876880.377268:0:51339:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788876880.377274:0:51339:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788876880.377279:0:51339:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788876880.377729:0:51339:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:3.0:1788876880.379707:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13cfd06300 x1875771532424576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.379719:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876880.379725:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876880.379728:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876880.379734:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532424576:0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.379766:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13cfd07b80 x1875771532424960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.379782:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 20 00000100:00080000:3.0:1788876880.386010:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13cfd07b80 x1875771532424960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876905 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.386023:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876880.386030:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876880.386034:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876880.386040:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532424960:0@lo:38:kworker.0 00010000:00080000:3.0:1788876880.386073:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13f408aa00 x1875771532425600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.386089:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 20 00000100:00080000:3.0:1788876880.386097:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788876880.386101:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788876880.386104:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07af000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788876880.386108:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532425600:0@lo:38:kworker.0 00000100:00100000:3.0:1788876880.386159:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532425856:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876880.386213:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876880.386736:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425856 00000100:00100000:2.0:1788876880.386744:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425856 00000100:00100000:0.0:1788876880.387040:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1788876880.387051:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532425856:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788876880.387071:0:13623:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13f43c0000 x1875771532425856/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:276/0 lens 224/0 e 0 to 0 dl 1788876891 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876880.387081:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532425856:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (868us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788876880.387087:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00010000:00010000:2.0:1788876880.393108:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393140:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393156:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393170:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393177:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393184:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393593:0:51126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393619:0:51126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393627:0:51126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393633:0:51126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876880.393638:0:51126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393646:0:51126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393659:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1100) 00010000:00010000:2.0:1788876880.393662:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876880.393665:0:51126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393672:0:51126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d200/0xf5bf0f7e313afc6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876880.393688:0:51126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e86918ee reply state 000000009647fda4 transno 81604378631 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393698:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.393705:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13c86a1d00) 00010000:00010000:2.0:1788876880.393707:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876880.393710:0:51126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1788876880.393814:0:51126:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788876880.393833:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876880.393837:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378632 00000020:00080000:2.0:1788876880.393841:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788876880.393843:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378632 00000001:00080000:3.0:1788876880.397128:0:51094:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 81604378631 is committed 00000100:00100000:3.0:1788876880.397394:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.397432:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511278976 00000100:00100000:3.0:1788876880.397440:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511278976 00000100:00100000:3.0:1788876880.397491:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2631 00000100:00100000:3.0:1788876880.397502:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2394:x1875771511278976:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:3.0:1788876880.397522:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 81604378632, current: 81604378632, replaying 00000100:00100000:3.0:1788876880.397535:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2394:x1875771511278976:12345-192.168.203.11@tcp:36:rm.0 Request processed in 36us (146us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876880.397542:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2631 00000020:00080000:3.0:1788876880.397563:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.397567:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 81604378632, next_transno: 81604378632 00010000:00080000:3.0:1788876880.397571:0:51126:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (81604378632) 00000020:00080000:3.0:1788876880.397574:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.397583:0:51126:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511278976 t81604378632 from 192.168.203.11@tcp req@ffff8a13cfd7c000 x1875771511278976/t0(81604378632) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:276/0 lens 512/0 e 0 to 0 dl 1788876891 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788876880.397678:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397693:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397706:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397722:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397730:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397736:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397818:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397827:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.397834:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398195:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398205:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398212:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398218:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876880.398221:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398228:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398240:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13c86a1d00) 00010000:00010000:2.0:1788876880.398242:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876880.398246:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.398251:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afc71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398495:0:51126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398503:0:51126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398509:0:51126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398514:0:51126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876880.398516:0:51126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398526:0:51126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398535:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x10f:0x0].0x0 (ffff8a13ca177900) 00010000:00010000:3.0:1788876880.398538:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788876880.398541:0:51126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398547:0:51126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961800/0xf5bf0f7e313afc86 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x10f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398565:0:51126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398572:0:51126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398577:0:51126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398582:0:51126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876880.398585:0:51126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398592:0:51126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398842:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ca177800) 00010000:00010000:3.0:1788876880.398847:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876880.398852:0:51126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398874:0:51126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961e00/0xf5bf0f7e313afc78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876880.398889:0:51126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000afd99f8 reply state 00000000b05a485e transno 81604378632 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398901:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.398908:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13c86a1d00) 00010000:00010000:3.0:1788876880.398911:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876880.398914:0:51126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788876880.398985:0:51126:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788876880.399001:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.399004:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378633 00000020:00080000:3.0:1788876880.399007:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.399010:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378633 00000100:00100000:3.0:1788876880.401220:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.401252:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511280640 00000100:00100000:3.0:1788876880.401261:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511280640 00000100:00100000:3.0:1788876880.401305:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2632 00000100:00100000:3.0:1788876880.401315:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511280640:12345-192.168.203.11@tcp:36:multiop.0 00010000:00080000:3.0:1788876880.401332:0:6540:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 81604378633, current: 81604378633, replaying 00000100:00100000:3.0:1788876880.401343:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511280640:12345-192.168.203.11@tcp:36:multiop.0 Request processed in 30us (132us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876880.401349:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2632 00000020:00080000:3.0:1788876880.401368:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.401373:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 81604378633, next_transno: 81604378633 00010000:00080000:3.0:1788876880.401377:0:51126:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (81604378633) 00000020:00080000:3.0:1788876880.401380:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.401389:0:51126:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511280640 t81604378633 from 192.168.203.11@tcp req@ffff8a13cfd7ea00 x1875771511280640/t0(81604378633) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:276/0 lens 520/0 e 0 to 0 dl 1788876891 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788876880.401875:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.401892:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.401903:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.401917:0:51126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.401923:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.401929:0:51126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402268:0:51126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402276:0:51126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402282:0:51126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402291:0:51126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876880.402295:0:51126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402302:0:51126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402314:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ca177200) 00010000:00010000:3.0:1788876880.402317:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876880.402321:0:51126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402326:0:51126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960c00/0xf5bf0f7e313afc8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876880.402342:0:51126:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9b76713 reply state 000000008e32ff65 transno 81604378633 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402351:0:51126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.402357:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13ca177300) 00010000:00010000:3.0:1788876880.402359:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876880.402362:0:51126:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788876880.402460:0:51126:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788876880.402477:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.402480:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378634 00000020:00080000:3.0:1788876880.402484:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.402486:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378634 00000100:00100000:2.0:1788876880.408374:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.408500:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511281024 00000100:00100000:3.0:1788876880.408510:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511281024 00000100:00100000:3.0:1788876880.408568:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2633 00000100:00100000:3.0:1788876880.408578:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511281024:12345-192.168.203.11@tcp:101:multiop.0 00010000:00080000:3.0:1788876880.408625:0:6539:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 81604378634, current: 81604378634, replaying 00000100:00100000:3.0:1788876880.408641:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511281024:12345-192.168.203.11@tcp:101:multiop.0 Request processed in 65us (277us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876880.408647:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2633 00000020:00080000:3.0:1788876880.408665:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.408669:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 81604378634, next_transno: 81604378634 00010000:00080000:3.0:1788876880.408673:0:51126:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (81604378634) 00000020:00080000:3.0:1788876880.408677:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.408688:0:51126:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511281024 t81604378634 from 192.168.203.11@tcp req@ffff8a13d3034e00 x1875771511281024/t0(81604378634) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:276/0 lens 664/0 e 0 to 0 dl 1788876891 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1788876880.408713:0:51126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876880.408739:0:51126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313afc9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048982 expref: -99 pid: 51126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876880.408853:0:51126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x110:0x0]: returning size 0 00000004:00080000:3.0:1788876880.408886:0:51126:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x200001b71:0x110:0x0], cookie = 0xf5bf0f7e313afa2c 00000004:00080000:3.0:1788876880.408890:0:51126:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xf5bf0f7e313afa2c in new mfd 00010000:00010000:3.0:1788876880.408973:0:51126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313afc9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048982 expref: 12 pid: 51126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.408987:0:51126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ca177b00) 00010000:00010000:3.0:1788876880.408989:0:51126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788876880.408995:0:51126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0031c00/0xf5bf0f7e313afc9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048982 expref: 12 pid: 51126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.409019:0:51126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c0031c00, rc 0) 00010000:00080000:3.0:1788876880.409080:0:51126:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788876880.409096:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.409099:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378635 00000020:00080000:3.0:1788876880.409102:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.409104:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 81604378635 00000100:00100000:3.0:1788876880.475774:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876880.475874:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511286912 00000100:00100000:1.0:1788876880.475885:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511286912 00000100:00100000:1.0:1788876880.475944:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1814 00000100:00100000:1.0:1788876880.476118:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2394:x1875771511286912:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1788876880.476159:0:8722:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13cfd7c700 x1875771511286912/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:276/0 lens 224/0 e 0 to 0 dl 1788876891 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876880.476182:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2394:x1875771511286912:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 230us (420us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876880.476190:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1814 00000020:00080000:3.0:1788876880.476246:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.476251:0:51126:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 81604378635 00010000:00080000:3.0:1788876880.476254:0:51126:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788876880.476257:0:51126:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876880.476265:0:51126:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788876880.476268:0:51126:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788876880.476383:0:51126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 20, last_transno is 85899345920 00000001:00100000:2.0:1788876880.478425:0:51094:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:2.0:1788876880.478437:0:51094:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788876880.478458:0:51094:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 81604378634 is committed 00010000:00010000:3.0:1788876880.478626:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478642:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478652:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478659:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876880.478664:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478672:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478690:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478698:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961400/0xf5bf0f7e313afc7f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478725:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478732:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478738:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478743:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0030a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876880.478747:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478753:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478762:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.478768:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c0030a00/0xf5bf0f7e313afc94 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51126 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788876880.478851:0:51126:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1788876880.478902:0:51126:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1788876880.478918:0:51126:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a13f43c0000 x1875771532425856/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:276/0 lens 224/0 e 0 to 0 dl 1788876891 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788876880.479041:0:51126:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13cfd7c700 x1875771511286912/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:276/0 lens 224/0 e 0 to 0 dl 1788876891 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1788876880.479102:0:51126:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788876880.482770:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788876880.482789:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a13f4089180 x1875771532425856/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876896 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.482801:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a13f4089180 x1875771532425856/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876896 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876880.482807:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876880.482822:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876880.482826:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532425856:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876880.482909:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532425984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876880.482988:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.483045:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532425984 00000100:00100000:3.0:1788876880.483052:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532425984 00000100:00100000:3.0:1788876880.483113:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1788876880.483124:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532425984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876880.483163:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876880.483208:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532425984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.483215:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1788876880.483255:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532425984:0@lo:41:osp-pre-0-1.0 00000004:00000080:1.0:1788876880.518988:0:51126:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620886b3e10 00100000:10000000:1.0:1788876880.519000:0:51126:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788876880.525628:0:51114:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876880.525681:0:51114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:51114:1875771532426112:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876880.525744:0:51114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876880.525777:0:51114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2884b40 going to sleep for 11 seconds 00000004:00080000:0.0:1788876880.526962:0:51112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:0.0:1788876880.526999:0:51112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:51112:1875771532426240:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788876880.527059:0:51112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.527092:0:51112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2736b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788876880.527179:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426112 00000100:00100000:1.0:1788876880.527188:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426112 00000100:00100000:1.0:1788876880.527245:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426240 00000100:00100000:1.0:1788876880.527248:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426240 00000100:00100000:0.0:1788876880.527406:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1788876880.527432:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:51114:x1875771532426112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788876880.527460:0:43960:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -146 00002000:02000040:0.0:1788876880.527465:0:43960:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:705) 00000100:00100000:1.0:1788876880.528625:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788876880.528639:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:51112:x1875771532426240:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788876880.528684:0:10319:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -146 00002000:02000040:1.0:1788876880.528689:0:10319:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:705) 00002000:00010000:0.0:1788876880.557266:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.557277:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557296:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.557300:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.557307:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557326:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557339:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557348:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557370:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876880.557495:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.557501:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557510:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.557513:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.557517:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557526:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557541:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557549:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557563:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788876880.557598:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.557622:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557630:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.557633:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.557638:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557648:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557656:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557664:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557682:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788876880.557716:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.557722:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557730:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.557733:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.557737:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557746:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557755:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557763:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557772:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788876880.557805:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.557810:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557817:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.557822:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.557826:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557835:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557843:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.557852:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558478:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788876880.558525:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.558531:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558541:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.558544:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.558548:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558558:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558566:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558573:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558581:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788876880.558638:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.558644:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558652:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.558654:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.558658:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558666:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558673:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558679:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558686:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788876880.558723:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.558728:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558737:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.558740:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.558744:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558754:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558761:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558769:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558778:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1788876880.558809:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876880.558815:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558823:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:0.0:1788876880.558826:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876880.558830:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558839:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.558852:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559842:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788876880.559852:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559873:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.559877:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559891:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559909:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559916:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bef5e16/0xf5bf0f7e313afca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559937:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788876880.559941:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559949:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.559952:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559961:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559970:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559978:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b00b61be/0xf5bf0f7e313afcb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.559995:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788876880.559999:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560006:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560010:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560018:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560028:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560035:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c7a749/0xf5bf0f7e313afcb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560048:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788876880.560051:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560059:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560062:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560076:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560085:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560094:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033c3aad6/0xf5bf0f7e313afcbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560105:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876880.560109:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560116:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560119:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560133:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560143:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560151:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbdb5b5/0xf5bf0f7e313afcc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560168:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876880.560172:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560179:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560182:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560191:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560200:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560208:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025346c8b/0xf5bf0f7e313afccc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560220:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876880.560223:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560230:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560233:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560246:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560257:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560265:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000857bf5f3/0xf5bf0f7e313afcd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560276:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.560280:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560287:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.560290:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560298:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560307:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560315:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2a90966/0xf5bf0f7e313afcda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.560332:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.560333:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.560335:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876880.560400:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.560447:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.560474:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.560508:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876880.560538:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287168 00000100:00100000:3.0:1788876880.560547:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287168 00000100:00100000:3.0:1788876880.560618:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1815 00000100:00100000:3.0:1788876880.560629:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511287168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876880.560695:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511287168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.560703:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1815 00000100:00100000:3.0:1788876880.560727:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287424 00000100:00100000:3.0:1788876880.560731:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287424 00000100:00100000:3.0:1788876880.560752:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287296 00000100:00100000:3.0:1788876880.560755:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287296 00000100:00100000:3.0:1788876880.560782:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1379 00000100:00100000:3.0:1788876880.560789:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511287424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876880.560815:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511287424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.560822:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1379 00000100:00100000:3.0:1788876880.560833:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1380 00000100:00100000:3.0:1788876880.560839:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511287296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876880.560861:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511287296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.560867:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1380 00000100:00080000:3.0:1788876880.560886:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876880.560890:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876880.560892:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876880.561196:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876880.561225:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788876880.561326:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287040 00000100:00100000:2.0:1788876880.561331:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287040 00000100:00100000:2.0:1788876880.561374:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1788876880.561382:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511287040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876880.562195:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511287040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 812us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876880.562204:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00010000:00010000:3.0:1788876880.564242:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.564252:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564266:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.564271:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564282:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564302:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564310:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313afce1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564369:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564372:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564374:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.564463:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.564470:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564480:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.564484:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.564491:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564502:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564510:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564517:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564532:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.564539:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.564543:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564550:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0030a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.564553:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564561:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564571:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564578:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313afce8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564590:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564592:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564593:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.564660:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.564665:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564673:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.564676:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.564680:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564689:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564696:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564703:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564718:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.564725:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.564728:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564734:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.564737:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564744:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564754:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564760:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313afcef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564774:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564775:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.564777:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.564812:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.564817:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564824:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.564827:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.564831:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564840:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564847:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.564853:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567699:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.567713:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.567720:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567730:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.567735:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567746:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567767:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567782:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313afcf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.567806:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.567808:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.567810:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.572406:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.573262:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.573281:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.573287:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.573294:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.573310:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.573322:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.573331:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788876880.573402:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788876880.573966:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.573979:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.573985:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.573995:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.574000:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.574009:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.574026:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.574033:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313afcfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.574053:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.574055:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.574056:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.577642:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.577654:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577671:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.577675:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.577682:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577697:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577708:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577716:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577734:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.577747:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.577752:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577760:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.577764:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577775:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577791:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577800:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313afd04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577821:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.577824:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.577826:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.577905:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.577911:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577919:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.577923:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.577927:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577936:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577945:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577952:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577965:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.577971:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.577975:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577987:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.577990:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.577999:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578010:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578018:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313afd0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578031:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578032:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578034:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578072:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578077:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578086:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578089:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578093:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578103:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578111:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578119:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578131:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578137:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578140:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578147:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578150:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578158:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578169:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578176:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313afd12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578189:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578191:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578193:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578226:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578232:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578239:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578243:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578247:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578257:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578265:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578272:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578283:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578289:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578292:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578299:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578303:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578317:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578326:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578335:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313afd19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578347:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578348:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578349:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578384:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578389:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578398:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578401:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578406:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578431:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578440:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578450:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578464:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578470:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578473:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578480:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578483:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578492:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578503:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578512:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313afd20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578525:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578527:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578529:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578566:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578572:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578579:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578582:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578587:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578596:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578622:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578630:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578642:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578648:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578651:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578658:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578662:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578670:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578681:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578689:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313afd27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578701:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578703:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578704:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578737:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578742:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578750:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578753:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578758:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578767:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578775:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578783:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578800:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578806:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578809:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578817:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578820:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578828:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578839:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578847:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313afd2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578857:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578859:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.578860:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.578893:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.578898:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578906:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.578909:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.578914:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578923:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578931:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578940:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578950:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.578956:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.578959:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578967:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.578970:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578978:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.578988:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579002:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088f3dc65/0xf5bf0f7e313afd35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579015:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579017:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579018:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579051:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579056:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579064:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579068:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579071:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579081:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579090:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579097:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579108:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579114:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579117:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579125:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579128:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579137:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579147:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579154:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f747cf/0xf5bf0f7e313afd3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579166:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579168:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579170:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579202:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579207:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579216:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579219:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579223:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579236:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579245:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579253:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579265:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579270:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579274:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579281:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579284:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579293:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579303:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579311:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c7c3d/0xf5bf0f7e313afd43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579323:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579325:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579326:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579364:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579370:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579378:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579382:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579386:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579394:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579402:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579410:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579435:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579441:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579444:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579456:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579459:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579467:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579478:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579486:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3a3fe28/0xf5bf0f7e313afd4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579500:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579502:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579503:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579538:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579544:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579552:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579555:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579559:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579569:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579577:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579585:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579597:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579619:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579623:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579631:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579634:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579642:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579653:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579661:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000330bd166/0xf5bf0f7e313afd51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579674:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579675:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579677:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579712:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579718:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579726:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579729:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579733:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579742:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579751:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579759:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579770:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579776:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579779:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579786:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579789:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579803:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579813:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579820:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc9b5c68/0xf5bf0f7e313afd58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579833:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579835:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579836:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.579868:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.579873:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579881:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.579884:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.579888:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579897:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579905:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579912:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579923:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.579929:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.579932:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579938:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.579940:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579947:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579955:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579961:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003966b38b/0xf5bf0f7e313afd5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.579971:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579973:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.579974:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.580005:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.580010:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580018:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.580021:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.580024:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580033:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580040:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580048:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580058:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.580063:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.580066:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580072:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.580074:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580081:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580091:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580097:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000130f7ca9/0xf5bf0f7e313afd66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580108:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580110:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580112:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.580143:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.580147:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580154:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.580157:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.580161:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580168:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580175:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580182:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580197:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.580202:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.580205:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580211:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.580214:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580221:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580230:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580236:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9277175/0xf5bf0f7e313afd6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580246:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580248:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580249:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.580280:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.580284:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580291:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.580294:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.580298:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580306:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580313:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580319:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580330:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788876880.580335:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.580338:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580344:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.580347:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580354:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580363:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580374:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6e733d/0xf5bf0f7e313afd74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.580387:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580388:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.580389:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.581978:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.581989:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.582015:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.582025:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582040:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.582045:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.582051:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582068:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582079:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582088:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582115:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876880.582381:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.582387:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582397:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.582400:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.582404:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.582412:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585003:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876880.585019:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585033:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.585039:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585050:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585072:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585087:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba933059/0xf5bf0f7e313afd7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.585107:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876880.585110:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876880.585112:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788876880.586494:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.586506:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586521:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.586525:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.586531:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586545:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586555:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586563:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586586:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788876880.586694:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788876880.586699:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586708:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:3.0:1788876880.586711:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788876880.586715:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586724:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586730:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586737:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.586751:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876880.587471:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587481:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587496:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876880.587501:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587509:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.587515:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587524:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587541:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587549:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097faddb3/0xf5bf0f7e313afd89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587573:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.587577:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587582:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.587586:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587594:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587623:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587631:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5bde24/0xf5bf0f7e313afd90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587645:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.587647:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.587649:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.587655:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.587818:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.587830:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.587836:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.587845:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.587849:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588089:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588102:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588111:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d677d3/0xf5bf0f7e313afd82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588154:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588156:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588158:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.588229:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.588235:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588245:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.588249:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.588254:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588265:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588273:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588281:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588295:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.588301:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.588305:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588312:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.588316:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588324:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588334:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588347:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36789dc/0xf5bf0f7e313afd97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588359:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588361:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588363:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.588402:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.588563:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588573:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.588577:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.588582:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588592:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588669:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588678:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588742:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.588750:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.588755:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588763:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.588766:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588775:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588787:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588794:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be322353/0xf5bf0f7e313afd9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.588807:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588809:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.588811:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.588853:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.589112:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.589121:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.589125:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.589187:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.589206:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.589215:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.589223:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788876880.589373:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788876880.589392:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.589399:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.589403:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590629:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.590635:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590647:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590665:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590678:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553b174a/0xf5bf0f7e313afda5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590698:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.590699:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.590701:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.590782:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.590789:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590799:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.590803:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.590809:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590820:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590830:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.590838:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788876880.591828:0:43960:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00010000:00010000:1.0:1788876880.592007:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.592022:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.592027:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592037:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.592040:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592049:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592062:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592070:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc6279cf/0xf5bf0f7e313afdac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592085:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592087:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592089:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876880.592261:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:51114:x1875771532426112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64826us (66512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.592270:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1788876880.592322:0:51114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:51114:1875771532426112:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788876880.592337:0:51114:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:3.0:1788876880.592396:0:51114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:51114:1875771532426496:0@lo:5:osp-pre-1-0.0 00002000:00010000:1.0:1788876880.592490:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.592496:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592506:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.592509:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.592515:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592531:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592541:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592549:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592564:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.592572:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.592576:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592583:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.592586:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592593:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592620:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592628:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfacf0ad/0xf5bf0f7e313afdb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592642:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592644:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592645:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.592692:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.592698:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592706:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.592709:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.592713:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592721:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592728:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592735:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592747:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.592754:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.592757:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592770:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.592773:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592780:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592790:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592795:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017f7dffe/0xf5bf0f7e313afdba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592806:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592807:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.592809:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.592844:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.592848:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.592855:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=1868s v=(0 0) 00000100:00100000:3.0:1788876880.593055:0:51114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.593114:0:51114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2736900 going to sleep for 11 seconds 00000100:00100000:3.0:1788876880.593140:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532426368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876880.593163:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876880.593196:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426368 00000100:00100000:3.0:1788876880.593202:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426368 00000100:00100000:3.0:1788876880.593241:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1788876880.593249:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532426368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876880.593273:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491902272 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876880.593307:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532426368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876880.593313:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1788876880.593346:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532426368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876880.593365:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426496 00000100:00100000:3.0:1788876880.593368:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426496 00010000:00010000:1.0:1788876880.593398:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.593404:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593488:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593499:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593507:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593522:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.593530:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.593534:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593542:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.593545:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593554:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593566:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593574:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1163998/0xf5bf0f7e313afdc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593588:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593590:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593592:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.593672:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.593677:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593684:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.593688:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.593692:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593700:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593707:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593714:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593724:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.593731:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.593735:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593741:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.593745:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593759:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593769:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593776:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af6ca721/0xf5bf0f7e313afdc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593788:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593790:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593791:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.593825:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.593830:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593838:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.593841:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.593845:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593853:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593873:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593880:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593892:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.593898:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.593901:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593908:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.593911:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593918:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593926:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593933:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c4a3e54/0xf5bf0f7e313afdcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593945:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593946:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.593948:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.593986:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.593991:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.593999:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.594003:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.594007:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594016:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594022:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594029:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594040:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.594046:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.594049:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594056:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.594060:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594068:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594078:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594085:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7ed1e2/0xf5bf0f7e313afdd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594096:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594098:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594099:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.594136:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.594141:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594148:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.594151:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.594155:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594163:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594170:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594177:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594194:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.594199:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.594203:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594209:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.594212:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594220:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594229:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594236:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313afddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594247:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594248:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594249:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.594282:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.594287:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594294:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.594298:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.594301:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594309:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594317:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594324:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594335:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.594341:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.594345:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594351:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.594355:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594362:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594371:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594384:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313afde4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.594397:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594398:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.594400:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.597641:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.597655:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597674:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.597680:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.597687:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597702:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597712:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597721:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597742:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.597758:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.597764:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597771:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.597776:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597785:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597800:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597809:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313afdeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597829:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.597831:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.597832:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.597896:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.597902:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597910:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.597914:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.597918:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597932:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597939:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597946:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597960:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.597967:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.597971:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597978:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.597981:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597989:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.597999:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598007:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003892a438/0xf5bf0f7e313afdf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598023:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.598024:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.598026:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.598066:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.598072:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598079:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.598082:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.598086:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598093:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598101:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598107:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598119:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.598126:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788876880.598331:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788876880.598350:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:51114:x1875771532426496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788876880.598397:0:43958:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00010000:00010000:1.0:1788876880.598946:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598961:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.598964:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598973:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598986:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.598994:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000001a4c46/0xf5bf0f7e313afdf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599011:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.599013:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.599014:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.599077:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.599083:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599091:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.599094:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.599099:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599109:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599118:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599125:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599214:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.599222:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.599227:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599234:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.599238:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599246:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599257:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599265:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a7e2d90/0xf5bf0f7e313afe00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599280:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.599282:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.599284:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.599323:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.599329:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599337:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.599340:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.599344:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599353:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599361:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599369:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599382:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.599389:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.599393:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599400:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.599403:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599962:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599975:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599982:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e549a8/0xf5bf0f7e313afe07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.599999:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.600001:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.600003:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.600064:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.600070:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600078:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.600080:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.600085:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600095:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600104:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600112:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600240:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876880.600283:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.600289:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600299:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.600302:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.600306:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600316:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600325:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.600335:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876880.603982:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:51114:x1875771532426496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5633us (10919us total) trans 4294967568 rc 0/0 00000100:00100000:0.0:1788876880.603994:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1788876880.604084:0:51114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:51114:1875771532426496:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788876880.604099:0:51114:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00010000:00010000:3.0:1788876880.608220:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876880.608234:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608247:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.608253:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608266:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608285:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608295:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccd40453/0xf5bf0f7e313afe0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608317:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.608321:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608327:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.608330:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608336:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608345:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.608353:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.608354:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.608356:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.610316:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876880.610328:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f01aecff/0xf5bf0f7e313afe15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788876880.610478:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.610485:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610497:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.610501:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.610508:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610522:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610532:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610541:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610557:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.610568:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.610575:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610583:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.610587:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610597:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610636:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610644:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcb2b1cb/0xf5bf0f7e313afe1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610658:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.610660:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.610662:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.610700:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.610706:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610714:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.610718:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.610722:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610731:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610739:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610748:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610763:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.610769:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.610773:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610781:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.610784:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610792:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610801:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610808:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313afe23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610818:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.610820:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.610822:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.610976:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.610982:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.610990:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.610994:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.610998:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611007:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611015:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611021:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611034:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.611041:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.611044:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611050:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.611053:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611060:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611070:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611076:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313afe2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611089:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.611090:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.611092:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.611207:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.611213:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611220:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.611222:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.611226:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611233:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611240:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611245:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611261:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876880.611268:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876880.611271:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611277:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876880.611280:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611288:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611298:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611306:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313afe31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611318:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.611319:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.611321:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876880.611359:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.611364:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611372:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.611376:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.611379:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611387:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611394:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611400:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611633:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876880.611672:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.611676:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611684:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.611686:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.611691:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611698:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611706:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.611713:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615805:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876880.615819:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615834:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.615839:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615851:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615886:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615894:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313afe38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615915:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876880.615919:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615926:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876880.615930:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615938:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615947:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876880.615955:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.615957:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876880.615959:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876880.617616:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876880.617628:0:10319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b28ba66d/0xf5bf0f7e313afe3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788876880.617755:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.617762:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617776:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.617781:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.617787:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617800:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617809:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617817:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617837:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876880.617882:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.617887:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617894:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.617897:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.617901:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617909:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617917:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617923:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.617931:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788876880.618018:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.618023:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618030:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.618033:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.618037:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618045:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618052:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618058:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618067:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788876880.618102:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.618107:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618114:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.618117:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.618121:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618143:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618152:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618159:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618168:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788876880.618204:0:10319:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876880.618209:0:10319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618217:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=1868s v=(0 0) 00010000:00010000:1.0:1788876880.618219:0:10319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876880.618223:0:10319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618231:0:10319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618238:0:10319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618245:0:10319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876880.618253:0:10319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1788876880.619270:0:10319:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:1.0:1788876880.619361:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:51112:x1875771532426240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90723us (92297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876880.619371:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00010000:00010000:2.0:1788876880.622556:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788876880.622570:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622583:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.622589:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622614:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622637:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622644:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313afe46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622673:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788876880.622677:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622683:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.622686:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622693:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622701:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622707:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313afe4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622719:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788876880.622722:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622729:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.622732:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622739:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622746:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622754:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000add7761/0xf5bf0f7e313afe54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622764:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876880.622768:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622773:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.622776:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622784:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622792:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622799:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008282bd2d/0xf5bf0f7e313afe5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622830:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876880.622834:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622839:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876880.622842:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622849:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622870:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622878:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d28d4/0xf5bf0f7e313afe62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876880.622890:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876880.622892:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876880.622894:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876880.624534:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876880.627563:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876880.627773:0:51112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:51112:1875771532426240:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876880.627791:0:51112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:0.0:1788876880.627874:0:51112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:51112:1875771532426752:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788876880.627937:0:51112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.627967:0:51112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788876880.627983:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532426624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876880.628011:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876880.628055:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426752 00000100:00100000:0.0:1788876880.628061:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426752 00000100:00100000:0.0:1788876880.628103:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788876880.628112:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:51112:x1875771532426752:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788876880.628281:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:2.0:1788876880.630679:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426624 00000100:00100000:2.0:1788876880.630693:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426624 00000100:00100000:2.0:1788876880.630744:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1788876880.630754:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532426624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876880.630777:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646912 pending 896 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876880.630924:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532426624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876880.630933:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1788876880.635374:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:51112:x1875771532426752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7253us (7427us total) trans 8589934860 rc 0/0 00000100:00100000:0.0:1788876880.635387:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788876880.636313:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532426624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876880.636352:0:51112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:51112:1875771532426752:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876880.636364:0:51112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00000001:00100000:0.0:1788876880.884509:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:1.0:1788876880.945560:0:51380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788876881.075069:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876881.386500:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532426880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876881.386565:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876881.387073:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532426880 00000100:00100000:2.0:1788876881.387082:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532426880 00000100:00100000:2.0:1788876881.387132:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1788876881.387141:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532426880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876881.387162:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876881.387208:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532426880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876881.387215:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788876881.387902:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532426880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876882.090420:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788876882.229088:0:51432:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876882.230268:0:51432:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788876882.410037:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876882.410066:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876882.410145:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876882.410246:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427008 00000100:00100000:2.0:1788876882.410256:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427008 00000100:00100000:2.0:1788876882.410327:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1788876882.410337:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876882.410373:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876882.410436:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876882.410443:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1788876882.410495:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427008:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876882.410551:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876883.113136:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788876883.264241:0:51482:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788876883.264482:0:51482:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788876884.137997:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876885.162537:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876885.413459:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876885.413563:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287552 00000100:00100000:2.0:1788876885.413574:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287552 00000100:00100000:2.0:1788876885.413681:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2634 00000100:00100000:2.0:1788876885.413692:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38815:x1875771511287552:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876885.413712:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876885.413736:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afe69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489a5 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788876885.413759:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788876885.413807:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876885.413822:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876885.413838:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876885.413894:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876885.413898:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876885.413946:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876885.413975:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d400/0xf5bf0f7e313afe69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489a5 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876885.413997:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489a5 expref: 7 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876885.414005:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:2.0:1788876885.414008:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876885.414011:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8ce00, rc 0) 00000100:00100000:2.0:1788876885.414087:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38815:x1875771511287552:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 397us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876885.414096:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2634 00000100:00100000:2.0:1788876885.429805:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876885.429906:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287680 00000100:00100000:1.0:1788876885.429916:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287680 00000100:00100000:1.0:1788876885.429980:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2635 00000100:00100000:1.0:1788876885.429992:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38815:x1875771511287680:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876885.430036:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876885.430110:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:38815:x1875771511287680:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876885.430117:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2635 00000100:00100000:0.0:1788876885.440024:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876885.440149:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287808 00000100:00100000:3.0:1788876885.440158:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287808 00000100:00100000:3.0:1788876885.440228:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2636 00000100:00100000:3.0:1788876885.440249:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38815:x1875771511287808:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1788876885.440290:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00080000:1.0:1788876885.440377:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876885.440576:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:38815:x1875771511287808:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 338us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.440584:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2636 00000100:00100000:3.0:1788876885.443297:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876885.443432:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511287936 00000100:00100000:2.0:1788876885.443441:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511287936 00000100:00100000:2.0:1788876885.443503:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1092 00000100:00100000:2.0:1788876885.443512:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38815:x1875771511287936:12345-192.168.203.11@tcp:13:lfs.0 00000100:00080000:1.0:1788876885.443627:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788876885.443687:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876885.443752:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38815:x1875771511287936:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 241us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876885.443759:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1092 00000100:00100000:0.0:1788876885.446487:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876885.447455:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288064 00000100:00100000:2.0:1788876885.447467:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288064 00000100:00080000:1.0:1788876885.447627:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876885.447702:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1093 00000100:00100000:2.0:1788876885.447719:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38815:x1875771511288064:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876885.447750:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876885.447836:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38815:x1875771511288064:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 125us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876885.447843:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1093 00000100:00100000:1.0:1788876885.481040:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532427392:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.481124:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876885.481194:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.481230:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.481238:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.481269:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532428416:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.481283:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876885.481310:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.481316:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532427648:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.481364:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788876885.481375:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788876885.481948:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427392 00000100:00100000:0.0:1788876885.481957:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427392 00000100:00100000:0.0:1788876885.482013:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788876885.482023:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532427392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876885.482640:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532427264:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.490498:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.490561:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532428160:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.490625:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.490653:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.490675:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.490762:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427904 00000100:00100000:3.0:1788876885.490769:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427904 00000100:00100000:3.0:1788876885.490815:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428416 00000100:00100000:3.0:1788876885.490819:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428416 00000100:00100000:3.0:1788876885.490839:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788876885.490846:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.490894:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427904:12345-0@lo:400:kworker.0 Request processed in 49us (9664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.490902:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788876885.490918:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788876885.490924:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.490952:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532428416:12345-0@lo:400:kworker.0 Request processed in 28us (9644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493096:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1788876885.493168:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427136 00000100:00100000:3.0:1788876885.493177:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427136 00000100:00100000:3.0:1788876885.493232:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788876885.493241:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532427136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493317:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532427136:12345-0@lo:400:kworker.0 Request processed in 76us (12034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493323:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788876885.493369:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427648 00000100:00100000:3.0:1788876885.493373:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427648 00000100:00100000:3.0:1788876885.493408:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428160 00000100:00100000:3.0:1788876885.493411:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428160 00000100:00100000:3.0:1788876885.493426:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428672 00000100:00100000:3.0:1788876885.493429:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428672 00000100:00100000:3.0:1788876885.493441:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:3.0:1788876885.493447:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532427648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493480:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532427648:12345-0@lo:400:kworker.0 Request processed in 33us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493487:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:3.0:1788876885.493499:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:3.0:1788876885.493505:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532428160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493533:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532428160:12345-0@lo:400:kworker.0 Request processed in 29us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493540:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:3.0:1788876885.493551:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:3.0:1788876885.493557:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532428672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493583:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532428672:12345-0@lo:400:kworker.0 Request processed in 27us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493589:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00080000:3.0:1788876885.493620:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876885.493624:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788876885.493626:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876885.493629:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876885.493666:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532427136:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493681:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532427648:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493692:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532428160:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493704:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.493729:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876885.493740:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532428800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876885.493771:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.493804:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428800 00000100:00100000:3.0:1788876885.493808:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428800 00000100:00100000:3.0:1788876885.493833:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1788876885.493840:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532428800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876885.493858:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876885.493891:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532428800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.493897:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1788876885.493927:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532428800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876885.494084:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876885.494094:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532428928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876885.494120:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.494145:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428928 00000100:00100000:3.0:1788876885.494148:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428928 00000100:00100000:3.0:1788876885.494170:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788876885.494176:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532428928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876885.494189:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876885.494221:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532428928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.494227:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788876885.494252:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532428928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876885.499084:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876885.499167:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532428032:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.499226:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876885.499277:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428032 00000100:00100000:1.0:1788876885.499284:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428032 00000100:00100000:1.0:1788876885.499361:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:1.0:1788876885.499376:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532428032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.499446:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532428032:12345-0@lo:400:kworker.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876885.499453:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00080000:1.0:1788876885.500790:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876885.500853:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532428032:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.500870:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532428544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.500936:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876885.500991:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427520 00000100:00100000:1.0:1788876885.500996:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427520 00000100:00100000:1.0:1788876885.501054:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428544 00000100:00100000:1.0:1788876885.501058:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428544 00000100:00100000:1.0:1788876885.501243:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1788876885.501257:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.501340:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1788876885.501352:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532428544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.501358:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532427520:12345-0@lo:400:kworker.0 Request processed in 97us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.501402:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532428544:12345-0@lo:400:kworker.0 Request processed in 44us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.501410:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1788876885.501456:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00080000:1.0:1788876885.501479:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876885.501482:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876885.501501:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532428544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.501515:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.501529:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532428416:0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.501558:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788876885.503901:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532427392:12345-0@lo:400:kworker.0 Request processed in 21865us (22763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876885.503915:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:2.0:1788876885.505105:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876885.505170:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532427776:0@lo:400:kworker.0 00000100:00100000:2.0:1788876885.505252:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876885.505294:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427776 00000100:00100000:2.0:1788876885.505304:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427776 00000100:00100000:2.0:1788876885.505686:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:2.0:1788876885.505696:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532427776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876885.505859:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532427392:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.506364:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532427264 00000100:00100000:3.0:1788876885.506371:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532427264 00000100:00100000:3.0:1788876885.506430:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1788876885.506439:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.506496:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532427264:12345-0@lo:400:kworker.0 Request processed in 58us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.506504:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1788876885.506545:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532428288:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.506576:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.506634:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532428288 00000100:00100000:3.0:1788876885.506638:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532428288 00000100:00100000:3.0:1788876885.506665:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1788876885.506672:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.506730:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532428288:12345-0@lo:400:kworker.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.506737:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1788876885.506768:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532428288:0@lo:400:kworker.0 00000100:00100000:3.0:1788876885.506791:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532427264:0@lo:400:kworker.0 00000100:00100000:2.0:1788876885.507863:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532427776:12345-0@lo:400:kworker.0 Request processed in 2163us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876885.507883:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00080000:0.0:1788876885.508022:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876885.508457:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532427776:0@lo:400:kworker.0 00000100:00100000:0.0:1788876885.688740:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876885.689402:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288192 00000100:00100000:3.0:1788876885.689413:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288192 00000100:00100000:3.0:1788876885.689524:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1788876885.689535:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511288192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876885.689643:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511288192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 110us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.689654:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1788876885.993890:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876885.993923:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876885.994020:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876885.994121:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429056 00000100:00100000:0.0:1788876885.994135:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429056 00000100:00100000:0.0:1788876885.994233:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1788876885.994250:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532429056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876885.994279:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876885.994404:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532429056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876885.994414:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1788876885.994594:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876885.994790:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532429184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876885.994859:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876885.994932:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429184 00000100:00100000:3.0:1788876885.994942:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429184 00000100:00100000:3.0:1788876885.995010:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1788876885.995023:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532429184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876885.995052:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876885.995129:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532429184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876885.995137:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1788876885.995190:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532429184:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788876886.003054:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967568 is committed 00000001:00080000:1.0:1788876886.008685:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934860 is committed 00010000:00010000:0.0:1788876886.184909:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876886.505774:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876886.505797:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532429312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876886.505869:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876886.505957:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429312 00000100:00100000:3.0:1788876886.505964:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429312 00000100:00100000:3.0:1788876886.506016:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1788876886.506025:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532429312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876886.506048:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876886.506095:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532429312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876886.506114:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1788876886.506429:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532429312:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788876887.212564:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876887.528895:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876887.528922:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532429440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876887.529010:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876887.529087:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429440 00000100:00100000:2.0:1788876887.529243:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429440 00000100:00080000:0.0:1788876887.530190:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876887.530341:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788876887.530359:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532429440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876887.530407:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876887.530524:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532429440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 172us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876887.530533:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1788876887.535476:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532429440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788876888.234058:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876889.267788:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876890.293449:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876890.601109:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876890.601136:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532429568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876890.601235:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876890.601327:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429568 00000100:00100000:3.0:1788876890.601336:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429568 00000100:00100000:3.0:1788876890.601405:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1788876890.601417:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532429568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876890.601459:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876890.601515:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532429568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.601523:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1788876890.601560:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532429952:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.601591:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876890.601669:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532429568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876890.601693:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532430464:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.601723:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876890.601745:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532430976:0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.601759:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430464 00000100:00100000:2.0:1788876890.601765:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430464 00000100:00100000:3.0:1788876890.601766:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876890.601793:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788876890.601801:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532430080:0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.601820:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430976 00000100:00100000:3.0:1788876890.601822:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876890.601827:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430976 00000100:00100000:3.0:1788876890.601845:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532430592:0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.601851:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430080 00000100:00100000:2.0:1788876890.601855:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430080 00000100:00100000:3.0:1788876890.601870:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876890.601889:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1788876890.601890:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532431104:0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.601902:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532430464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.601913:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876890.601948:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1788876890.601957:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532430976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.601994:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532430976:12345-0@lo:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.602000:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1788876890.602015:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1788876890.602021:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532430080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.602044:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532430080:12345-0@lo:400:kworker.0 Request processed in 24us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.602050:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1788876890.602082:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532430080:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.602090:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967568 gen 2 00000100:00100000:3.0:1788876890.602101:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532430976:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602276:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532429824:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602308:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602338:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532430336:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602357:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602379:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532430848:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602398:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602416:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788876890.602421:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602447:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602468:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532430208:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602488:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602505:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532430720:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602528:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876890.602538:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532431232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876890.602556:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788876890.602581:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876890.602586:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876890.602597:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429952 00000100:00100000:0.0:1788876890.602629:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429952 00000100:00100000:2.0:1788876890.602660:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532430464:12345-0@lo:400:kworker.0 Request processed in 760us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.602661:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430592 00000100:00100000:0.0:1788876890.602665:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430592 00000100:00100000:2.0:1788876890.602672:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1788876890.602690:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430848 00000100:00100000:0.0:1788876890.602692:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431104 00000100:00100000:2.0:1788876890.602696:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430848 00000100:00100000:0.0:1788876890.602697:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431104 00000100:00100000:0.0:1788876890.602714:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430336 00000100:00100000:0.0:1788876890.602717:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430336 00000100:00100000:2.0:1788876890.602735:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788876890.602736:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430208 00000100:00100000:0.0:1788876890.602740:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430208 00000100:00100000:2.0:1788876890.602746:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532430848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.602753:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532430720 00000100:00100000:0.0:1788876890.602757:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532430720 00000100:00100000:0.0:1788876890.602772:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1788876890.602780:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532429952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.602792:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532430848:12345-0@lo:400:kworker.0 Request processed in 49us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876890.602800:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1788876890.602821:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532429952:12345-0@lo:400:kworker.0 Request processed in 40us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876890.602829:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1788876890.602840:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.602876:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532430592:12345-0@lo:400:kworker.0 Request processed in 39us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.602935:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429824 00000100:00100000:3.0:1788876890.602940:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429824 00000100:00100000:3.0:1788876890.602966:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431232 00000100:00100000:3.0:1788876890.602969:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431232 00000100:00100000:3.0:1788876890.602981:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1788876890.602987:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3665:x1875771532429824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.603020:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3665:x1875771532429824:12345-0@lo:400:kworker.0 Request processed in 33us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.603026:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1788876890.603038:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1788876890.603043:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532431232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876890.603065:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876890.603089:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532431232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.603095:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1788876890.603548:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532430592:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.603562:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532430464:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.603573:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532429952:0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.603735:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532429696 00000100:00100000:3.0:1788876890.603741:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532429696 00000100:00100000:3.0:1788876890.603779:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788876890.603788:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532429696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876890.603838:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532429696:12345-0@lo:400:kworker.0 Request processed in 51us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876890.603844:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788876890.603877:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876890.603883:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876890.603885:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876890.604482:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1788876890.604509:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1788876890.604518:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532431104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604572:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532431104:12345-0@lo:400:kworker.0 Request processed in 56us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.604578:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1788876890.604591:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1788876890.604599:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532430336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604645:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532430336:12345-0@lo:400:kworker.0 Request processed in 48us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.604652:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1788876890.604665:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1788876890.604672:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604700:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532430208:12345-0@lo:400:kworker.0 Request processed in 29us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.604706:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1788876890.604716:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1788876890.604722:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532430720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604745:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532430720:12345-0@lo:400:kworker.0 Request processed in 23us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.604751:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1788876890.604792:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604805:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532430208:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604815:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532430720:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604833:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532431232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876890.604843:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532429824:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604853:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532430336:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604863:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934860 gen 2 00000100:00100000:0.0:1788876890.604876:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532430848:0@lo:400:kworker.0 00000100:00100000:0.0:1788876890.604918:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532431104:0@lo:400:kworker.0 00000100:00100000:2.0:1788876890.612379:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:3.0:1788876890.799574:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876890.799812:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288320 00000100:00100000:0.0:1788876890.799826:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288320 00000100:00100000:0.0:1788876890.799903:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1788876890.799916:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511288320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876890.800015:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511288320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.800024:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:2.0:1788876890.801449:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876890.801544:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876890.801572:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876890.801721:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288704 00000100:00100000:1.0:1788876890.801732:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288704 00000100:00100000:1.0:1788876890.801810:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1389 00000100:00100000:1.0:1788876890.801821:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511288704:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876890.801901:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511288704:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 81us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876890.801909:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1389 00000100:00100000:2.0:1788876890.802144:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876890.802387:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288832 00000100:00100000:1.0:1788876890.802393:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288832 00000100:00100000:1.0:1788876890.802435:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1390 00000100:00100000:1.0:1788876890.802443:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511288832:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876890.802494:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511288832:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876890.802501:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1390 00000100:00080000:2.0:1788876890.803005:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876890.803010:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876890.805322:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288448 00000100:00100000:0.0:1788876890.805344:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288448 00000100:00100000:0.0:1788876890.805590:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288576 00000100:00100000:0.0:1788876890.805594:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288576 00000100:00100000:1.0:1788876890.806254:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1828 00000100:00100000:1.0:1788876890.806273:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511288448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876890.806393:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511288448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 127us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876890.806402:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1828 00000100:00080000:2.0:1788876890.806684:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876890.806691:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876890.811063:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1829 00000100:00100000:0.0:1788876890.811081:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511288576:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876890.811769:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511288576:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 689us (10192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876890.811779:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1829 00000100:00100000:0.0:1788876891.113650:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876891.113684:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876891.113785:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876891.113956:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431360 00000100:00100000:2.0:1788876891.113969:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431360 00000100:00100000:2.0:1788876891.114039:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1788876891.114051:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532431360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876891.114253:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876891.114265:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532431488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876891.114303:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788876891.115479:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876891.115579:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532431360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1527us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876891.115592:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788876891.118875:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876891.128445:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431488 00000100:00100000:2.0:1788876891.128476:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431488 00000100:00100000:2.0:1788876891.128581:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788876891.128595:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532431488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876891.128664:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876891.128783:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532431488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (14477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876891.128796:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1788876891.129746:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532431488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788876891.304881:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876891.627594:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876891.627674:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532431616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876891.627782:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876891.627979:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431616 00000100:00100000:1.0:1788876891.627992:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431616 00000100:00100000:1.0:1788876891.628069:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1788876891.628080:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532431616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876891.628112:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876891.628183:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532431616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876891.628191:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1788876891.629955:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532431616:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876892.329755:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876892.654506:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532431744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876892.654571:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876892.654758:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431744 00000100:00100000:3.0:1788876892.654766:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431744 00000100:00100000:3.0:1788876892.654819:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788876892.654828:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532431744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876892.654849:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876892.654890:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532431744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876892.654896:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:1.0:1788876892.654944:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876892.654976:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532431744:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788876892.893500:0:51675:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788876893.355426:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876894.376841:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788876894.791364:0:51724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1788876895.400820:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876895.721085:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532432256:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721158:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721369:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532432768:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721397:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721421:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532433280:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721441:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721467:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788876895.721473:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532431872:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721500:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721519:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721539:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721552:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532432896:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721570:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721587:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532433408:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721637:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721662:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721684:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721699:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532432640:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721718:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721732:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532433152:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721751:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721765:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788876895.721770:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532432000:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721791:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721806:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532432512:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721824:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721848:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532433024:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.721869:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876895.721898:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432768 00000100:00100000:1.0:1788876895.721905:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432768 00000100:00100000:2.0:1788876895.722020:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432256 00000100:00100000:2.0:1788876895.722024:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432256 00000100:00100000:2.0:1788876895.722128:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433280 00000100:00100000:2.0:1788876895.722132:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433280 00000100:00100000:2.0:1788876895.722151:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432640 00000100:00100000:2.0:1788876895.722154:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432640 00000100:00100000:2.0:1788876895.722170:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433152 00000100:00100000:2.0:1788876895.722173:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433152 00000100:00100000:2.0:1788876895.722261:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1788876895.722270:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532432256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722324:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532432256:12345-0@lo:400:kworker.0 Request processed in 55us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.722330:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1788876895.722356:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1788876895.722363:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532433280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722389:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532433280:12345-0@lo:400:kworker.0 Request processed in 28us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.722396:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1788876895.722405:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1788876895.722410:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532432640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722437:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532432640:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.722443:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1788876895.722454:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1788876895.722459:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532433152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722482:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532433152:12345-0@lo:400:kworker.0 Request processed in 23us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.722488:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1788876895.722525:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532432256:0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722539:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532433280:0@lo:400:kworker.0 00000100:00080000:2.0:1788876895.722582:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876895.722586:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876895.722589:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876895.722624:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532432640:0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.722633:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532433152:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.722782:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432384 00000100:00100000:1.0:1788876895.722787:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432384 00000100:00100000:1.0:1788876895.722813:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432896 00000100:00100000:1.0:1788876895.722816:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432896 00000100:00100000:1.0:1788876895.722839:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433408 00000100:00100000:1.0:1788876895.722842:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433408 00000100:00100000:1.0:1788876895.722854:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432128 00000100:00100000:1.0:1788876895.722856:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432128 00000100:00100000:1.0:1788876895.722865:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432512 00000100:00100000:1.0:1788876895.722868:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432512 00000100:00100000:1.0:1788876895.722879:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:1.0:1788876895.722885:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532432768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.723200:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532431872 00000100:00100000:0.0:1788876895.723205:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532431872 00000100:00100000:0.0:1788876895.723234:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788876895.723241:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532431872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876895.723360:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788876895.723369:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532432384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.723427:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532432768:12345-0@lo:400:kworker.0 Request processed in 541us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876895.723434:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:1.0:1788876895.723450:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:1.0:1788876895.723456:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532432896:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788876895.723564:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876895.723569:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876895.723595:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532432000 00000100:00100000:2.0:1788876895.723616:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532432000 00000100:00100000:2.0:1788876895.723644:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433024 00000100:00100000:2.0:1788876895.723648:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433024 00000100:00100000:2.0:1788876895.723661:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788876895.723667:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.723708:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532432000:12345-0@lo:400:kworker.0 Request processed in 40us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.723714:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788876895.723726:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788876895.723733:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532433024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.723759:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532433024:12345-0@lo:400:kworker.0 Request processed in 27us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.723765:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788876895.723789:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1788876895.723795:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.724119:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532431872:12345-0@lo:400:kworker.0 Request processed in 876us (2615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876895.724128:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788876895.724166:0:6540:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788876895.724175:0:6540:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1788876895.724207:0:15659:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788876895.724215:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1788876895.724222:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532432128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.724257:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532432128:12345-0@lo:400:kworker.0 Request processed in 35us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876895.724263:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1788876895.724276:0:15659:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788876895.724282:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1788876895.724289:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532432512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.724315:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532432512:12345-0@lo:400:kworker.0 Request processed in 27us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876895.724321:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1788876895.724537:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532433536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876895.724574:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876895.724793:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532431872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876895.725648:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532432384:12345-0@lo:400:kworker.0 Request processed in 2278us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876895.725659:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:3.0:1788876895.725693:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433536 00000100:00100000:3.0:1788876895.725699:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433536 00000100:00100000:3.0:1788876895.725728:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788876895.725734:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532433536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876895.725762:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876895.725812:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532433536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876895.725818:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1788876895.725901:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532433536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876895.725918:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876895.725936:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532433664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876895.725967:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876895.725994:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433664 00000100:00100000:3.0:1788876895.725997:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433664 00000100:00100000:3.0:1788876895.726019:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1788876895.726024:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532433664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876895.726040:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876895.726301:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532433664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876895.726308:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1788876895.726338:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532433664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876895.726393:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532432000:0@lo:400:kworker.0 00000100:00100000:3.0:1788876895.726407:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788876895.726416:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532433024:0@lo:400:kworker.0 00000100:00100000:3.0:1788876895.726426:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532432128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.726558:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788876895.726714:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532432896:12345-0@lo:400:kworker.0 Request processed in 3256us (5141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876895.726722:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1788876895.726819:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532433408:12345-0@lo:400:kworker.0 Request processed in 3023us (5180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.726827:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1788876895.729240:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532432896:0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.729264:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532433408:0@lo:400:kworker.0 00000100:00100000:0.0:1788876895.729278:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532432768:0@lo:400:kworker.0 00000100:00100000:2.0:1788876895.920294:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876895.920392:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876895.920424:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876895.920456:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876895.920500:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876895.920530:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289216 00000100:00100000:2.0:1788876895.920540:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289216 00000100:00100000:2.0:1788876895.920593:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289088 00000100:00100000:2.0:1788876895.920596:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289088 00000100:00100000:2.0:1788876895.920657:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1836 00000100:00100000:2.0:1788876895.920667:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511289216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876895.920728:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511289216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.920735:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1836 00000100:00100000:2.0:1788876895.920752:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1837 00000100:00100000:2.0:1788876895.920758:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511289088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876895.920780:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511289088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.920786:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1837 00000100:00080000:2.0:1788876895.920802:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876895.920805:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876895.920929:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289472 00000100:00100000:2.0:1788876895.920933:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289472 00000100:00100000:2.0:1788876895.920961:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289344 00000100:00100000:2.0:1788876895.920964:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289344 00000100:00100000:2.0:1788876895.920984:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1395 00000100:00100000:2.0:1788876895.920990:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511289472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876895.921019:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511289472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.921036:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1395 00000100:00100000:2.0:1788876895.921049:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1396 00000100:00100000:2.0:1788876895.921056:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511289344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876895.921080:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511289344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876895.921086:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1396 00000100:00080000:2.0:1788876895.921107:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876895.921112:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876895.923482:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511288960 00000100:00100000:3.0:1788876895.923495:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511288960 00000100:00100000:3.0:1788876895.923557:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1788876895.923566:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511288960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876895.923657:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511288960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876895.923664:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1788876896.233044:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876896.233065:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532433792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876896.233132:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876896.235406:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433792 00000100:00100000:1.0:1788876896.235417:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433792 00000100:00100000:1.0:1788876896.235482:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:1.0:1788876896.235494:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532433792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876896.235524:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876896.235618:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532433792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876896.235625:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1788876896.237630:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532433920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876896.237698:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876896.237766:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532433792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876896.238033:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532433920 00000100:00100000:0.0:1788876896.238040:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532433920 00000100:00100000:0.0:1788876896.238089:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1788876896.238098:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532433920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876896.238121:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876896.238178:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532433920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876896.238185:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1788876896.238438:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532433920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788876896.424843:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876896.744982:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532434048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876896.745057:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876896.745216:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434048 00000100:00100000:1.0:1788876896.745223:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434048 00000100:00100000:1.0:1788876896.745284:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1788876896.745295:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532434048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876896.745324:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876896.745383:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532434048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876896.745390:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1788876896.745939:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532434048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876897.096275:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876897.098845:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289600 00000100:00100000:1.0:1788876897.098860:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289600 00000100:00100000:1.0:1788876897.098947:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2637 00000100:00100000:1.0:1788876897.098958:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39284:x1875771511289600:12345-192.168.203.11@tcp:41:lfs.0 00000100:00080000:2.0:1788876897.099108:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788876897.099270:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876897.099355:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39284:x1875771511289600:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 398us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876897.099363:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2637 00000100:00100000:1.0:1788876897.101840:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876897.102087:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289728 00000100:00100000:2.0:1788876897.102097:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289728 00000100:00100000:2.0:1788876897.102184:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2638 00000100:00100000:2.0:1788876897.102195:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39284:x1875771511289728:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876897.102229:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876897.102294:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39284:x1875771511289728:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 101us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876897.102301:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2638 00000100:00080000:0.0:1788876897.102421:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876897.111285:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876897.111383:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289856 00000100:00100000:0.0:1788876897.111393:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289856 00000100:00100000:0.0:1788876897.111461:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1105 00000100:00100000:0.0:1788876897.111472:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39284:x1875771511289856:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876897.111494:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876897.111562:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39284:x1875771511289856:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876897.111569:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1105 00000100:00080000:2.0:1788876897.111767:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876897.116938:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876897.117077:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511289984 00000100:00100000:1.0:1788876897.117088:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511289984 00000100:00100000:1.0:1788876897.117172:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1106 00000100:00100000:1.0:1788876897.117185:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39284:x1875771511289984:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876897.117211:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876897.117450:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39284:x1875771511289984:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 267us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876897.117459:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1106 00000100:00080000:2.0:1788876897.117524:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876897.217476:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876897.217571:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511290112 00000100:00100000:0.0:1788876897.217581:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511290112 00000100:00100000:0.0:1788876897.217673:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2639 00000100:00100000:0.0:1788876897.217684:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39300:x1875771511290112:12345-192.168.203.11@tcp:101:ls.0 00010000:00010000:0.0:1788876897.217702:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876897.217724:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afe77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489ac expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217787:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217802:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217818:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217834:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217842:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217848:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217935:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217944:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.217951:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876897.217999:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x110:0x0]: returning size 0 00000004:00200000:0.0:1788876897.218002:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876897.218038:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218049:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218068:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218075:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218082:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218088:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876897.218092:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218099:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218111:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:0.0:1788876897.218114:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876897.218118:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218135:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afe7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218150:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218155:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218162:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218166:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876897.218169:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218175:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218183:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13fae0b800) 00010000:00010000:0.0:1788876897.218185:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876897.218188:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218194:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afe85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218223:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afe77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ac expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218237:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ac expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876897.218243:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x110:0x0].0x0 (ffff8a13fae0b400) 00010000:00010000:0.0:1788876897.218246:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788876897.218248:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220000, rc 0) 00000100:00100000:0.0:1788876897.218306:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39300:x1875771511290112:12345-192.168.203.11@tcp:101:ls.0 Request processed in 623us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876897.218316:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2639 00000100:00100000:3.0:1788876897.254688:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876897.254799:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511290368 00000100:00100000:2.0:1788876897.254809:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511290368 00000100:00100000:2.0:1788876897.254853:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 742 00000100:00100000:2.0:1788876897.254862:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:38489:x1875771511290368:12345-192.168.203.11@tcp:35:multiop.0 00000100:00100000:2.0:1788876897.255131:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:38489:x1875771511290368:12345-192.168.203.11@tcp:35:multiop.0 Request processed in 262us (444us total) trans 85899345921 rc 0/0 00000100:00100000:2.0:1788876897.255139:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 742 00000100:00100000:3.0:1788876897.268476:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876897.272574:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511290624 00000100:00100000:2.0:1788876897.272588:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511290624 00000100:00100000:2.0:1788876897.272718:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2640 00000100:00100000:2.0:1788876897.272729:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39304:x1875771511290624:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876897.272785:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876897.272809:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afe8c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x110:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ac expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272833:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x110:0x0].0x0 (ffff8a13fae0b400) 00010000:00010000:2.0:1788876897.272851:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8ce00/0xf5bf0f7e313afe70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489a5 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272860:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad200) 00010000:00010000:2.0:1788876897.272868:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876897.272890:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272903:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272913:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272924:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272931:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.272936:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273039:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273054:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273062:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273255:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273264:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273272:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273283:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273290:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273296:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273319:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876897.273351:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273358:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273365:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273372:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8c200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876897.273376:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273384:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273393:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x110:0x0].0x0 (ffff8a13c86a1b00) 00010000:00010000:2.0:1788876897.273396:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876897.273399:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273410:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313afea1 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x110:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273424:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273431:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273437:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273442:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876897.273445:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273451:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273459:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1300) 00010000:00010000:2.0:1788876897.273461:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876897.273464:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273470:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313afe93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876897.273482:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c23e907 reply state 00000000fc9f368c transno 85899345922 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273493:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876897.273501:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13c86a1400) 00010000:00010000:2.0:1788876897.273504:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876897.273506:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876897.273667:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39304:x1875771511290624:12345-192.168.203.11@tcp:36:rm.0 Request processed in 938us (5199us total) trans 85899345922 rc 0/0 00000100:00100000:2.0:1788876897.273676:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2640 00010000:00010000:3.0:1788876897.273736:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876897.273744:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876897.273751:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8da00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876897.273754:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876897.273762:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876897.273772:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x110:0x0].0x0 (ffff8a13c86a1b00) 00010000:00010000:3.0:1788876897.273775:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788876897.273778:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876897.273785:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313afea8 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x110:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876897.273798:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876897.273800:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876897.273802:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876897.448851:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876897.769422:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876897.769444:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532434176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876897.769513:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876897.769655:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434176 00000100:00100000:3.0:1788876897.769664:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434176 00000100:00100000:3.0:1788876897.769739:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1788876897.769748:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532434176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876897.769770:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876897.769816:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532434176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876897.770547:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00080000:0.0:1788876897.770679:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876897.770725:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532434176:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876898.472817:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876899.501679:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876900.530495:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876900.841711:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532434304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876900.841784:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.841859:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434304 00000100:00100000:3.0:1788876900.841866:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434304 00000100:00100000:3.0:1788876900.841906:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1788876900.841914:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532434304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876900.841945:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876900.841988:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532434304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.841995:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1788876900.842038:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f45d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532434304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876900.842814:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532434688:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.842851:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.842872:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532435200:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.842890:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.842902:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532435712:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.842918:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.842933:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788876900.842937:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.842960:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.842981:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532435072:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843000:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.843015:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532435584:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843034:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876900.843056:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434688 00000100:00100000:0.0:1788876900.843061:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434688 00000100:00100000:0.0:1788876900.843094:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435072 00000100:00100000:0.0:1788876900.843097:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435072 00000100:00100000:0.0:1788876900.843125:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:0.0:1788876900.843131:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532434688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843170:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532434688:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876900.843177:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:0.0:1788876900.843190:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1788876900.843197:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532435072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843221:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532435072:12345-0@lo:400:kworker.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876900.843227:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:0.0:1788876900.843243:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434560 00000100:00100000:0.0:1788876900.843247:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434560 00000100:00100000:0.0:1788876900.843268:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788876900.843274:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843299:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532434560:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876900.843306:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788876900.843348:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876900.843411:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843424:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532435072:0@lo:400:kworker.0 00000100:00100000:0.0:1788876900.843433:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.843842:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532434432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876900.843873:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.843894:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.843912:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.843927:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.843943:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.843957:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.843974:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.843989:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788876900.843994:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532434816:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844012:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.844025:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532435328:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844041:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.844054:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532435840:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844069:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876900.844098:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435200 00000100:00100000:3.0:1788876900.844102:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435200 00000100:00100000:3.0:1788876900.844132:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435712 00000100:00100000:3.0:1788876900.844135:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435712 00000100:00100000:3.0:1788876900.844150:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434816 00000100:00100000:3.0:1788876900.844153:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434816 00000100:00100000:3.0:1788876900.844167:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435840 00000100:00100000:3.0:1788876900.844169:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435840 00000100:00100000:3.0:1788876900.844186:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1788876900.844192:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844226:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532435200:12345-0@lo:400:kworker.0 Request processed in 34us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844233:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1788876900.844245:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1788876900.844250:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532435712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844273:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532435712:12345-0@lo:400:kworker.0 Request processed in 23us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844278:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1788876900.844287:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1788876900.844292:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532434816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844316:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532434816:12345-0@lo:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844338:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1788876900.844348:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1788876900.844353:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844376:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532435840:12345-0@lo:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844381:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1788876900.844399:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435584 00000100:00100000:3.0:1788876900.844402:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435584 00000100:00100000:3.0:1788876900.844420:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434432 00000100:00100000:3.0:1788876900.844422:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434432 00000100:00100000:3.0:1788876900.844432:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1788876900.844437:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.844465:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532435584:12345-0@lo:400:kworker.0 Request processed in 28us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844471:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1788876900.844481:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:3.0:1788876900.844486:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532434432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876900.844506:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876900.844532:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532434432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.844538:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:3.0:1788876900.844567:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532434944 00000100:00100000:3.0:1788876900.844570:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532434944 00000100:00100000:3.0:1788876900.844590:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435456 00000100:00100000:3.0:1788876900.844593:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435456 00000100:00100000:2.0:1788876900.845691:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435968 00000100:00100000:2.0:1788876900.845698:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435968 00000100:00100000:2.0:1788876900.845728:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532435328 00000100:00100000:2.0:1788876900.845732:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532435328 00000100:00100000:2.0:1788876900.845749:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1788876900.845756:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532434944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876900.845800:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532434944:12345-0@lo:400:kworker.0 Request processed in 45us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876900.845807:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1788876900.845821:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1788876900.845826:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532435968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876900.845850:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532435968:12345-0@lo:400:kworker.0 Request processed in 24us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876900.845857:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1788876900.845869:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:2.0:1788876900.845875:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876900.845898:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532435328:12345-0@lo:400:kworker.0 Request processed in 23us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876900.845903:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00080000:2.0:1788876900.845922:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876900.845925:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876900.845928:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876900.845931:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876900.846285:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788876900.846295:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846344:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532435456:12345-0@lo:400:kworker.0 Request processed in 51us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876900.846351:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788876900.846400:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532434816:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846412:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532435328:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846423:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532435840:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846440:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532434432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876900.846450:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846460:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846468:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846521:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846531:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532435200:0@lo:400:kworker.0 00000100:00100000:3.0:1788876900.846540:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532435712:0@lo:400:kworker.0 00000100:00100000:1.0:1788876901.041855:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876901.041909:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876901.041951:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876901.041973:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876901.042002:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876901.042041:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511290880 00000100:00100000:1.0:1788876901.042052:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511290880 00000100:00100000:1.0:1788876901.042108:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291008 00000100:00100000:1.0:1788876901.042112:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291008 00000100:00100000:1.0:1788876901.042135:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1844 00000100:00100000:1.0:1788876901.042145:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511290880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876901.042219:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511290880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876901.042227:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1844 00000100:00100000:1.0:1788876901.042243:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1845 00000100:00100000:1.0:1788876901.042249:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511291008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876901.042269:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511291008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876901.042275:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1845 00000100:00100000:1.0:1788876901.042292:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291136 00000100:00100000:1.0:1788876901.042295:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291136 00000100:00100000:1.0:1788876901.042332:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291264 00000100:00100000:1.0:1788876901.042335:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291264 00000100:00100000:1.0:1788876901.042533:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1401 00000100:00100000:1.0:1788876901.042541:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511291136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876901.042566:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511291136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876901.042573:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1401 00000100:00100000:1.0:1788876901.042584:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1402 00000100:00100000:1.0:1788876901.042590:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511291264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876901.042711:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511291264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 120us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876901.042718:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1402 00000100:00080000:1.0:1788876901.042734:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876901.042738:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876901.042741:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876901.042743:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876901.042805:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511290752 00000100:00100000:0.0:1788876901.042810:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511290752 00000100:00100000:0.0:1788876901.042847:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1788876901.042854:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511290752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876901.042889:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511290752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876901.042896:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1788876901.353421:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876901.353442:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532436096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876901.353507:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876901.353581:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436096 00000100:00100000:0.0:1788876901.353589:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436096 00000100:00100000:0.0:1788876901.353650:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1788876901.353658:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532436096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876901.353683:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876901.353853:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876901.353872:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532436224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876901.360116:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532436096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6448us (6598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876901.360130:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1788876901.363431:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876901.363662:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436224 00000100:00100000:0.0:1788876901.363671:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436224 00000100:00100000:0.0:1788876901.363716:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788876901.363725:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532436224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876901.363756:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876901.363809:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532436224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876901.363816:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1788876901.363918:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532436224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876901.365410:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532436096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788876901.545245:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876901.866087:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876901.868162:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532436352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876901.868233:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876901.868383:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436352 00000100:00100000:2.0:1788876901.868391:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436352 00000100:00100000:2.0:1788876901.868482:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1788876901.868492:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532436352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876901.868514:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876901.868568:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532436352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876901.868575:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1788876901.868645:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532436352:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788876902.575827:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788876902.890450:0:51094:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 85899345922 is committed 00010000:00010000:2.0:1788876902.890479:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890491:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890499:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890505:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8dc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876902.890510:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890518:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890535:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8f3e57e5 (ffff8a13c86a1400) 00010000:00010000:2.0:1788876902.890538:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876902.890543:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876902.890550:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313afe9a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8f3e57e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876902.891767:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876902.891787:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532436480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876902.891849:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876902.892336:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436480 00000100:00100000:1.0:1788876902.892344:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436480 00000100:00100000:1.0:1788876902.892446:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1788876902.892458:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532436480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876902.892484:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876902.892546:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532436480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876902.892553:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00080000:2.0:1788876902.892597:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876902.897238:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532436480:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876903.594670:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876904.619446:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876905.186043:0:51920:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 9: |X| create (same inum/gen) ====== 10:15:04 (1788876904) 00010000:00010000:3.0:1788876905.640865:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876905.960760:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532436608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876905.960830:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876905.960902:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436608 00000100:00100000:3.0:1788876905.960909:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436608 00000100:00100000:3.0:1788876905.960956:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788876905.960966:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532436608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876905.960997:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876905.961039:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532436608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876905.961046:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788876905.961088:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532436608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876905.961919:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532436736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876905.961967:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962015:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436736 00000100:00100000:1.0:1788876905.962020:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436736 00000100:00100000:1.0:1788876905.962055:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1788876905.962064:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532436736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876905.962091:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876905.962133:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532436736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.962139:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1788876905.962175:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532436736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876905.962494:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532436864:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962525:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962553:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962579:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962629:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532437888:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962653:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962672:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876905.962678:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532436992:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962698:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962716:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532437504:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962734:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962750:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532438016:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.962768:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.962796:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437376 00000100:00100000:1.0:1788876905.962800:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437376 00000100:00100000:1.0:1788876905.962835:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436992 00000100:00100000:1.0:1788876905.962838:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436992 00000100:00100000:1.0:1788876905.962858:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:1.0:1788876905.962864:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876905.963100:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532436864 00000100:00100000:3.0:1788876905.963105:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532436864 00000100:00100000:3.0:1788876905.963135:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788876905.963142:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532436864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876905.963181:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532436864:12345-0@lo:400:kworker.0 Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876905.963188:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788876905.963341:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532437376:12345-0@lo:400:kworker.0 Request processed in 476us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.963347:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:1.0:1788876905.963361:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1788876905.963367:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532436992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963394:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532436992:12345-0@lo:400:kworker.0 Request processed in 27us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.963399:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1788876905.963419:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437888 00000100:00100000:1.0:1788876905.963423:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437888 00000100:00100000:1.0:1788876905.963457:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437504 00000100:00100000:1.0:1788876905.963460:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437504 00000100:00100000:1.0:1788876905.963478:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438016 00000100:00100000:1.0:1788876905.963481:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438016 00000100:00100000:1.0:1788876905.963500:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1788876905.963507:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532437888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963539:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532437888:12345-0@lo:400:kworker.0 Request processed in 32us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.963544:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1788876905.963555:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1788876905.963561:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532437504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963584:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532437504:12345-0@lo:400:kworker.0 Request processed in 24us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.963589:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1788876905.963634:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1788876905.963640:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532438016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963668:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532438016:12345-0@lo:400:kworker.0 Request processed in 29us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.963673:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1788876905.963706:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963731:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.963753:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532437760:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963772:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.963790:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788876905.963796:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532437120:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963818:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.963836:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532437632:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963854:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.963868:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532438144:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.963888:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876905.963912:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437248 00000100:00100000:1.0:1788876905.963915:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437248 00000100:00100000:1.0:1788876905.963939:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437760 00000100:00100000:1.0:1788876905.963942:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437760 00000100:00100000:1.0:1788876905.963954:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437632 00000100:00100000:1.0:1788876905.963957:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437632 00000100:00100000:1.0:1788876905.963966:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438144 00000100:00100000:1.0:1788876905.963969:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438144 00000100:00100000:1.0:1788876905.963981:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1788876905.963987:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964021:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532437248:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.964026:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:1.0:1788876905.964038:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1788876905.964043:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532437760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964068:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532437760:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.964074:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:1.0:1788876905.964085:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:1.0:1788876905.964091:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532437632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964115:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532437632:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.964120:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:1.0:1788876905.964131:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1788876905.964136:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532438144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964160:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532438144:12345-0@lo:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.964165:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1788876905.964186:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532437120 00000100:00100000:1.0:1788876905.964190:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532437120 00000100:00100000:1.0:1788876905.964212:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1788876905.964217:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532437120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964243:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532437120:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876905.964249:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1788876905.964288:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532436992:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964312:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532437504:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964323:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532438016:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964331:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532436864:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964340:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964349:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532437888:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964382:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c1a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532437120:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964391:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532437632:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964399:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532438144:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964407:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788876905.964415:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532437760:0@lo:400:kworker.0 00000100:00080000:2.0:1788876905.968652:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876905.968663:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876905.968666:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876905.968669:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876906.164498:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.164538:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.164568:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.164593:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.164651:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.164680:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291520 00000100:00100000:0.0:1788876906.164689:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291520 00000100:00100000:0.0:1788876906.164745:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291648 00000100:00100000:0.0:1788876906.164749:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291648 00000100:00100000:0.0:1788876906.164771:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1852 00000100:00100000:0.0:1788876906.164782:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511291520:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876906.164863:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511291520:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.164871:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1852 00000100:00100000:0.0:1788876906.164888:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1853 00000100:00100000:0.0:1788876906.164894:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511291648:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876906.164919:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511291648:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.164925:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1853 00000100:00100000:0.0:1788876906.164944:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291776 00000100:00100000:0.0:1788876906.164948:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291776 00000100:00100000:0.0:1788876906.164974:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291904 00000100:00100000:0.0:1788876906.164976:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291904 00000100:00100000:0.0:1788876906.164994:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1407 00000100:00100000:0.0:1788876906.164999:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511291776:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876906.165023:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511291776:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.165029:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1407 00000100:00100000:0.0:1788876906.165039:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1408 00000100:00100000:0.0:1788876906.165045:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511291904:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876906.165065:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511291904:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.165071:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1408 00000100:00080000:0.0:1788876906.165088:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876906.165092:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876906.165094:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876906.165096:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876906.167324:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511291392 00000100:00100000:1.0:1788876906.167336:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511291392 00000100:00100000:1.0:1788876906.167386:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788876906.167395:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511291392:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876906.167456:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511291392:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876906.167464:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1788876906.333280:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876906.333375:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292032 00000100:00100000:1.0:1788876906.333388:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292032 00000100:00100000:1.0:1788876906.333448:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2641 00000100:00100000:1.0:1788876906.333460:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39898:x1875771511292032:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1788876906.333482:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876906.333512:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313afeaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489b3 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333584:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333643:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333660:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876906.333722:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876906.333726:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876906.333749:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333776:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313afeaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489b3 expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333797:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489b3 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876906.333806:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965000) 00010000:00010000:1.0:1788876906.333810:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876906.333814:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41600, rc 0) 00000100:00100000:1.0:1788876906.333874:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39898:x1875771511292032:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 415us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876906.333881:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2641 00000100:00100000:1.0:1788876906.356984:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876906.357108:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292160 00000100:00100000:3.0:1788876906.357117:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292160 00000100:00100000:3.0:1788876906.357189:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2642 00000100:00100000:3.0:1788876906.357200:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39898:x1875771511292160:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1788876906.357235:0:51736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876906.357312:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39898:x1875771511292160:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876906.357321:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2642 00000100:00100000:3.0:1788876906.359315:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876906.359383:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292288 00000100:00100000:1.0:1788876906.359391:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292288 00000100:00100000:1.0:1788876906.359441:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2643 00000100:00100000:1.0:1788876906.359451:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39898:x1875771511292288:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876906.359483:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876906.359538:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39898:x1875771511292288:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876906.359545:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2643 00000100:00100000:3.0:1788876906.361906:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876906.362116:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292416 00000100:00100000:1.0:1788876906.362125:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292416 00000100:00100000:1.0:1788876906.362185:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1112 00000100:00100000:1.0:1788876906.362196:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39898:x1875771511292416:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876906.362228:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876906.362285:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39898:x1875771511292416:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876906.362292:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1112 00000100:00100000:1.0:1788876906.364131:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876906.366695:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292544 00000100:00100000:3.0:1788876906.366707:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292544 00000100:00100000:1.0:1788876906.369644:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1113 00000100:00100000:1.0:1788876906.369659:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39898:x1875771511292544:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788876906.369696:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876906.369783:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39898:x1875771511292544:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 128us (5660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876906.369790:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1113 00000100:00100000:3.0:1788876906.427024:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.427146:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292800 00000100:00100000:0.0:1788876906.427156:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292800 00000100:00100000:0.0:1788876906.427215:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2644 00000100:00100000:0.0:1788876906.427226:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39905:x1875771511292800:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:0.0:1788876906.427287:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876906.427324:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313afeb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489b3 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427341:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965000) 00010000:00010000:0.0:1788876906.427353:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876906.427429:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427442:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427452:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427463:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427470:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427480:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427857:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427865:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427872:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427877:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876906.427882:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427889:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427899:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:0.0:1788876906.427902:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876906.427905:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427911:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afebd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876906.427924:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f76012e reply state 000000003af63275 transno 85899345923 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427934:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.427941:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae0b900) 00010000:00010000:0.0:1788876906.427943:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876906.427946:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876906.429130:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39905:x1875771511292800:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1898us (2118us total) trans 85899345923 rc 0/0 00000100:00100000:0.0:1788876906.429141:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2644 00000100:00100000:3.0:1788876906.454790:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.456236:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292928 00000100:00100000:0.0:1788876906.456247:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292928 00000100:00100000:0.0:1788876906.456308:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2645 00000100:00100000:0.0:1788876906.456318:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39908:x1875771511292928:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876906.456341:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876906.456363:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489ba expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456426:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456439:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456449:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876906.456486:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876906.456489:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876906.456507:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456528:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313afecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ba expref: 10 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456543:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ba expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.456551:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:0.0:1788876906.456553:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876906.456556:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221800, rc 0) 00000100:00100000:0.0:1788876906.456645:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39908:x1875771511292928:12345-192.168.203.11@tcp:101:rm.0 Request processed in 327us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.456654:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2645 00000100:00100000:0.0:1788876906.464074:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.464116:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293056 00000100:00100000:0.0:1788876906.464126:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293056 00000100:00100000:0.0:1788876906.464176:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2646 00000100:00100000:0.0:1788876906.464186:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39908:x1875771511293056:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:0.0:1788876906.464203:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876906.464223:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afed9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489c1 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464284:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464309:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464320:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464335:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464342:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464348:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464430:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464438:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464445:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876906.464484:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x111:0x0]: returning size 0 00000004:00200000:0.0:1788876906.464487:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876906.464504:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464514:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464521:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464527:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464536:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464542:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876906.464546:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464552:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464564:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:0.0:1788876906.464567:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876906.464571:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464578:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313afee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464588:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464594:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464620:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464625:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876906.464627:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464636:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464644:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae0b900) 00010000:00010000:0.0:1788876906.464645:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876906.464648:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464652:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afee7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464678:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c1 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464690:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c1 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.464697:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x111:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:0.0:1788876906.464699:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788876906.464701:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220600, rc 0) 00000100:00100000:0.0:1788876906.464753:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:39908:x1875771511293056:12345-192.168.203.11@tcp:101:rm.0 Request processed in 568us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.464760:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2646 00000100:00100000:0.0:1788876906.475430:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532438272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876906.475504:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876906.475559:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438272 00000100:00100000:0.0:1788876906.475567:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438272 00000100:00100000:0.0:1788876906.475640:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1788876906.475650:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532438272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876906.475674:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876906.475723:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532438272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.475730:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1788876906.475776:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532438272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876906.478287:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532438400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876906.478383:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876906.480207:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438400 00000100:00100000:2.0:1788876906.480223:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438400 00000100:00100000:2.0:1788876906.480283:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1788876906.480446:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532438400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876906.480476:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876906.480556:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532438400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876906.480563:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1788876906.480782:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532438400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876906.484734:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876906.485214:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293312 00000100:00100000:0.0:1788876906.485223:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293312 00000100:00100000:0.0:1788876906.485522:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2647 00000100:00100000:0.0:1788876906.485534:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:39908:x1875771511293312:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1788876906.485585:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788876906.485800:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220600/0xf5bf0f7e313afeee lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x111:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c1 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485818:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x111:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:0.0:1788876906.485834:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221800/0xf5bf0f7e313afed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489ba expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485842:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:0.0:1788876906.485848:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788876906.485870:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485883:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485892:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485903:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485910:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485917:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.485999:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486007:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486014:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486194:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486203:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486211:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486217:0:8722:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486224:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486231:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486281:0:8722:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876906.486307:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486313:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486327:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486332:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876906.486337:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486344:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486353:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x111:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:0.0:1788876906.486355:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788876906.486359:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486365:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221400/0xf5bf0f7e313aff03 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486378:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486388:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486394:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486399:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876906.486402:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486407:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486414:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0bb00) 00010000:00010000:0.0:1788876906.486416:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876906.486419:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486424:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220000/0xf5bf0f7e313afef5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788876906.486435:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a94c279 reply state 00000000ad75644f transno 85899345924 ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486445:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876906.486451:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae0b900) 00010000:00010000:0.0:1788876906.486454:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788876906.486456:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788876906.486528:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:39908:x1875771511293312:12345-192.168.203.11@tcp:36:rm.0 Request processed in 996us (1804us total) trans 85899345924 rc 0/0 00000100:00100000:0.0:1788876906.486535:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2647 00010000:00010000:2.0:1788876906.486827:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876906.486834:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876906.486840:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876906.486844:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876906.486850:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876906.486859:0:10419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x111:0x0].0x0 (ffff8a13fae0b300) 00010000:00010000:2.0:1788876906.486862:0:10419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788876906.486865:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876906.486871:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221600/0xf5bf0f7e313aff0a lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x111:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876906.486884:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876906.486885:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876906.486887:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876906.665439:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876906.993710:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532438528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876906.993790:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876906.997938:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438528 00000100:00100000:0.0:1788876906.997956:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438528 00000100:00100000:0.0:1788876906.998023:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1788876906.998035:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532438528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876906.998061:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876906.998140:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532438528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (4349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876906.998147:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1788876906.998197:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532438528:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876907.690116:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876908.008867:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532438656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876908.008940:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876908.009029:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438656 00000100:00100000:1.0:1788876908.009038:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438656 00000100:00100000:1.0:1788876908.009100:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1788876908.009110:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532438656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876908.009140:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876908.009185:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532438656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876908.009192:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:0.0:1788876908.009353:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876908.009388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532438656:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876908.715281:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876909.740889:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876910.760858:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876911.083853:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532438784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876911.083926:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.083975:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532438912:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084013:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.084047:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532439424:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084072:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.084088:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532439936:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084108:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.084124:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084148:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084165:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532439296:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084166:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788876911.084176:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532439040:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084209:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.084214:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084238:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532439808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084255:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532439552:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084265:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084302:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440320:0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084305:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876911.084337:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532440064:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084342:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084370:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788876911.084375:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084380:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532439168:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084410:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084431:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532439680:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084450:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084464:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440192:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084483:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.084517:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438784 00000100:00100000:3.0:1788876911.084525:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438784 00000100:00100000:3.0:1788876911.084565:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439040 00000100:00100000:3.0:1788876911.084568:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439040 00000100:00100000:3.0:1788876911.084577:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440064 00000100:00100000:3.0:1788876911.084579:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440064 00000100:00100000:3.0:1788876911.084592:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1788876911.084624:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532438784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876911.084657:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876911.084685:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439424 00000100:00100000:2.0:1788876911.084690:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439424 00000100:00100000:3.0:1788876911.084703:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532438784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.084711:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1788876911.084730:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439936 00000100:00100000:3.0:1788876911.084734:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1788876911.084735:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439936 00000100:00100000:3.0:1788876911.084744:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532439040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084756:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440448 00000100:00100000:2.0:1788876911.084760:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440448 00010000:00000080:3.0:1788876911.084762:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4676d80 x1875771532439040/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876911.084775:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439808 00000100:00100000:2.0:1788876911.084779:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439808 00000100:00100000:2.0:1788876911.084797:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439552 00000100:00100000:2.0:1788876911.084800:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439552 00000100:00100000:3.0:1788876911.084803:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532439040:12345-0@lo:400:kworker.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.084812:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1788876911.084816:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439168 00000100:00100000:2.0:1788876911.084820:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439168 00000100:00100000:3.0:1788876911.084829:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788876911.084840:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.084841:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:2.0:1788876911.084855:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532439424:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876911.084872:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4674700 x1875771532439424/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876911.084877:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532440064:12345-0@lo:400:kworker.0 Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.084891:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788876911.084912:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439296 00000100:00100000:3.0:1788876911.084916:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439296 00000100:00100000:2.0:1788876911.084923:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532439424:12345-0@lo:400:kworker.0 Request processed in 69us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.084931:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1788876911.084943:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440320 00000100:00100000:3.0:1788876911.084947:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440320 00000100:00100000:2.0:1788876911.084951:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1788876911.084960:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.084967:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532439680 00000100:00100000:3.0:1788876911.084971:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532439680 00000100:00100000:2.0:1788876911.084993:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532439936:12345-0@lo:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.085000:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1788876911.085014:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1788876911.085020:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532440448:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876911.085031:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4677b80 x1875771532440448/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876911.085057:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532440448:12345-0@lo:400:kworker.0 Request processed in 37us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.085062:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1788876911.085074:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788876911.085080:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532439808:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876911.085091:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13eb258700 x1875771532439808/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876911.085117:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532439808:12345-0@lo:400:kworker.0 Request processed in 38us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.085123:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788876911.085134:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1788876911.085140:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532439552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876911.085167:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532439552:12345-0@lo:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.085173:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1788876911.085185:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1788876911.085191:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532439168:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876911.085201:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac9ad80 x1875771532439168/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876911.085226:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532439168:12345-0@lo:400:kworker.0 Request processed in 36us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.085253:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440192 00000100:00100000:3.0:1788876911.085258:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440192 00000100:00100000:3.0:1788876911.085297:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788876911.085305:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532439296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085352:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532439296:12345-0@lo:400:kworker.0 Request processed in 48us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.085358:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788876911.085371:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1788876911.085378:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085404:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440320:12345-0@lo:400:kworker.0 Request processed in 28us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.085409:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1788876911.085420:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788876911.085426:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085456:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532439680:12345-0@lo:400:kworker.0 Request processed in 29us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876911.085464:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1788876911.085465:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788876911.085485:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1788876911.085491:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085518:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440192:12345-0@lo:400:kworker.0 Request processed in 27us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.085524:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1788876911.085581:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532439168:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085592:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532439680:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085620:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440192:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085632:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085641:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532439808:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085649:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440320:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085662:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532438784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876911.085704:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532439040:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085714:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532439552:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085722:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532440064:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085731:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085744:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532439936:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.085756:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532440448:0@lo:400:kworker.0 00000100:00080000:0.0:1788876911.085769:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876911.085775:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876911.085780:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876911.085782:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876911.086741:0:51101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532438912 00000100:00100000:0.0:1788876911.086748:0:51101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532438912 00000100:00100000:0.0:1788876911.086797:0:51101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788876911.086805:0:51101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532438912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876911.086859:0:51101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532438912:12345-0@lo:400:kworker.0 Request processed in 55us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.086866:0:51101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788876911.086957:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532438912:0@lo:400:kworker.0 00000100:00100000:3.0:1788876911.087680:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876911.087715:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876911.087749:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440576 00000100:00100000:3.0:1788876911.087753:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440576 00000100:00100000:3.0:1788876911.087781:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1788876911.087786:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532440576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876911.087816:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:3.0:1788876911.087830:0:6545:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac99f80 x1875771532440576/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:307/0 lens 224/368 e 0 to 0 dl 1788876922 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876911.087868:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532440576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876911.087874:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1788876911.087911:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876911.287040:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876911.287090:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876911.287123:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876911.287147:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876911.287169:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876911.287192:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293440 00000100:00100000:1.0:1788876911.287201:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293440 00000100:00100000:1.0:1788876911.287245:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1788876911.287255:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511293440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876911.287368:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293824 00000100:00100000:0.0:1788876911.287374:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293824 00000100:00100000:0.0:1788876911.287416:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293952 00000100:00100000:0.0:1788876911.287421:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293952 00000100:00100000:1.0:1788876911.287422:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511293440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 165us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.287448:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1413 00000100:00100000:0.0:1788876911.287456:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511293824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876911.287506:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511293824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.287513:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1413 00000100:00100000:0.0:1788876911.287528:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1414 00000100:00100000:0.0:1788876911.287534:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511293952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876911.287558:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511293952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.287564:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1414 00000100:00080000:0.0:1788876911.287584:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876911.287588:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876911.287637:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1788876911.287646:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293568 00000100:00100000:0.0:1788876911.287651:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293568 00000100:00080000:1.0:1788876911.287882:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876911.287932:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293696 00000100:00100000:1.0:1788876911.287947:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293696 00000100:00100000:1.0:1788876911.287978:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1860 00000100:00100000:1.0:1788876911.287984:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511293568:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:1.0:1788876911.288005:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7876300 x1875771511293568/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:307/0 lens 224/224 e 0 to 0 dl 1788876922 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876911.288043:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511293568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876911.288050:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1860 00000100:00100000:1.0:1788876911.288063:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1861 00000100:00100000:1.0:1788876911.288070:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511293696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876911.288094:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511293696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876911.288099:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1861 00000100:00080000:1.0:1788876911.288147:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876911.593039:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876911.593065:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876911.593170:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876911.593333:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440704 00000100:00100000:0.0:1788876911.593341:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440704 00000100:00100000:0.0:1788876911.593394:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1788876911.593404:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876911.593439:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876911.593490:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532440704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.593497:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1788876911.593540:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876911.595296:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876911.595316:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532440832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876911.595372:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876911.595415:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440832 00000100:00100000:0.0:1788876911.595421:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440832 00000100:00100000:0.0:1788876911.595469:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788876911.595478:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532440832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876911.595504:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876911.595544:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532440832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876911.595550:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788876911.595591:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532440832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788876911.788949:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876912.105435:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532440960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876912.105521:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876912.105582:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532440960 00000100:00100000:0.0:1788876912.105590:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532440960 00000100:00100000:0.0:1788876912.105661:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788876912.105672:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532440960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788876912.105694:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876912.105738:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532440960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876912.105748:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788876912.105794:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532440960:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876912.812066:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788876912.989160:0:51094:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 85899345924 is committed 00010000:00010000:2.0:1788876912.989238:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989252:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989260:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989276:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876912.989281:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989289:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989304:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae0b900) 00010000:00010000:2.0:1788876912.989307:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876912.989311:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989317:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221000/0xf5bf0f7e313afec4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989335:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989344:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989348:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989352:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876912.989355:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989360:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989365:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae0b900) 00010000:00010000:2.0:1788876912.989367:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876912.989369:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876912.989374:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3220a00/0xf5bf0f7e313afefc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876913.129805:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532441088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876913.129872:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876913.129969:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441088 00000100:00100000:1.0:1788876913.129984:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441088 00000100:00100000:1.0:1788876913.130041:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788876913.130050:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532441088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876913.130077:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876913.130119:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532441088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876913.130126:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1788876913.130361:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532441088:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788876913.130538:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876913.835770:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788876914.305430:0:52315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1788876914.420718:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876914.420754:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294080 00000100:00100000:1.0:1788876914.420763:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294080 00000100:00100000:1.0:1788876914.420822:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2648 00000100:00100000:1.0:1788876914.420832:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:39975:x1875771511294080:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:1.0:1788876914.420851:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876914.420874:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41800/0xf5bf0f7e313aff11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489c8 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.420932:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.420945:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.420958:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788876914.421823:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788876914.422424:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788876914.422430:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876914.422456:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.422486:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41800/0xf5bf0f7e313aff11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c8 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.422501:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c8 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.422509:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:1.0:1788876914.422512:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788876914.422516:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40000, rc 0) 00010000:00000080:1.0:1788876914.422524:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfd07b80 x1875771511294080/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:310/0 lens 576/688 e 0 to 0 dl 1788876925 ref 1 fl Interpret:/600/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788876914.422587:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39975:x1875771511294080:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 1756us (1877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876914.422595:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2648 00000100:00100000:1.0:1788876914.429034:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876914.429071:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294336 00000100:00100000:1.0:1788876914.429083:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294336 00000100:00100000:1.0:1788876914.429141:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2649 00000100:00100000:1.0:1788876914.429152:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:39975:x1875771511294336:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:1.0:1788876914.429212:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876914.429241:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313aff18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489c8 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429268:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965e00) 00010000:00010000:1.0:1788876914.429279:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876914.429371:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429384:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429394:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429404:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429410:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429416:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429856:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429865:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429871:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429876:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876914.429880:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429887:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429900:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965500) 00010000:00010000:1.0:1788876914.429903:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876914.429906:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429911:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313aff1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876914.429924:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd5f3a7b reply state 000000005e7e72d9 transno 85899345925 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429934:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876914.429941:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13e7965900) 00010000:00010000:1.0:1788876914.429943:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876914.429946:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1788876914.429973:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13cfd04000 x1875771511294336/t85899345925(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:310/0 lens 520/448 e 0 to 0 dl 1788876925 ref 1 fl Interpret:/200/0 rc 0/0 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876914.430050:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39975:x1875771511294336:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 899us (1025us total) trans 85899345925 rc 0/0 00000100:00100000:1.0:1788876914.430058:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2649 00000100:00100000:2.0:1788876914.461458:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876914.462869:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294464 00000100:00100000:0.0:1788876914.462884:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294464 00000100:00100000:0.0:1788876914.462967:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2650 00000100:00100000:0.0:1788876914.462979:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:39977:x1875771511294464:12345-192.168.203.11@tcp:101:ls.0 00010000:00010000:0.0:1788876914.463005:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876914.463029:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aff2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489cf expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463100:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463115:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463126:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788876914.463174:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788876914.463179:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788876914.463200:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463224:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221c00/0xf5bf0f7e313aff2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489cf expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463243:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489cf expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876914.463253:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d304b300) 00010000:00010000:0.0:1788876914.463267:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788876914.463271:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221e00, rc 0) 00010000:00000080:0.0:1788876914.463280:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa645880 x1875771511294464/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:310/0 lens 576/688 e 0 to 0 dl 1788876925 ref 1 fl Interpret:/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788876914.463352:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39977:x1875771511294464:12345-192.168.203.11@tcp:101:ls.0 Request processed in 375us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876914.463359:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2650 00000100:00100000:0.0:1788876914.467752:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876914.467814:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294592 00000100:00100000:2.0:1788876914.467824:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294592 00000100:00100000:2.0:1788876914.467884:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2651 00000100:00100000:2.0:1788876914.467893:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:39977:x1875771511294592:12345-192.168.203.11@tcp:101:ls.0 00010000:00010000:2.0:1788876914.467913:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876914.467934:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313aff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489d6 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468010:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468024:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468036:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468046:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468052:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468058:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468157:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468166:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468173:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876914.468213:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x112:0x0]: returning size 0 00000004:00200000:2.0:1788876914.468216:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876914.468237:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468252:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468270:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468277:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468283:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468289:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876914.468293:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468300:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468312:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d304b300) 00010000:00010000:2.0:1788876914.468324:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876914.468329:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468335:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8d000/0xf5bf0f7e313aff42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468345:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468352:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468358:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468363:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8dc00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876914.468366:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468372:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468378:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13e7965900) 00010000:00010000:2.0:1788876914.468380:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876914.468383:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468388:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468411:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8c200/0xf5bf0f7e313aff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489d6 expref: 11 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468424:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489d6 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876914.468431:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x112:0x0].0x0 (ffff8a13c86a1b00) 00010000:00010000:2.0:1788876914.468433:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788876914.468435:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8da00, rc 0) 00010000:00000080:2.0:1788876914.468441:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13ff5e4a80 x1875771511294592/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:310/0 lens 592/584 e 0 to 0 dl 1788876925 ref 1 fl Interpret:/600/0 rc 0/0 job:'ls.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876914.468507:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:39977:x1875771511294592:12345-192.168.203.11@tcp:101:ls.0 Request processed in 615us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876914.468513:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2651 00010000:00010000:2.0:1788876914.858451:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876915.880922:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876916.201741:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876916.201763:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532441216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876916.201864:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876916.202198:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441216 00000100:00100000:1.0:1788876916.202206:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441216 00000100:00100000:1.0:1788876916.202256:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1788876916.202265:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532441216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788876916.202295:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:1.0:1788876916.202309:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac98a80 x1875771532441216/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:312/0 lens 224/368 e 0 to 0 dl 1788876927 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876916.202345:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532441216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.202351:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1788876916.202412:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532441344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876916.202434:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.202474:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532441216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876916.202673:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441344 00000100:00100000:1.0:1788876916.202678:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441344 00000100:00100000:1.0:1788876916.202702:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1788876916.202708:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532441344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876916.202725:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876916.202760:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532441344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.202765:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1788876916.202794:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532441344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876916.204799:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532441600:0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.204912:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876916.204941:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f5219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532442112:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208217:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532441472:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208322:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208380:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532441984:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208410:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208441:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532442496:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208465:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208506:0:51099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441472 00000100:00100000:2.0:1788876916.208513:0:51099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441472 00000100:00100000:2.0:1788876916.208559:0:51099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876916.208567:0:51099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532441472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208639:0:51099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532441472:12345-0@lo:400:kworker.0 Request processed in 72us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.208646:0:51099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788876916.208677:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442496 00000100:00100000:2.0:1788876916.208680:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442496 00000100:00100000:2.0:1788876916.208714:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788876916.208721:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532442496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208751:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532442496:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.208757:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00080000:2.0:1788876916.208775:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876916.208789:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532441728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208812:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208829:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532442240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208847:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208862:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532442752:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208880:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208896:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788876916.208903:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532441856:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208920:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208934:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532442368:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.208964:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.208986:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441728 00000100:00100000:2.0:1788876916.208989:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441728 00000100:00100000:2.0:1788876916.209018:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788876916.209023:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532441728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209049:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532441728:12345-0@lo:400:kworker.0 Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209055:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788876916.209070:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441600 00000100:00100000:2.0:1788876916.209073:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441600 00000100:00100000:2.0:1788876916.209087:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441984 00000100:00100000:2.0:1788876916.209089:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441984 00000100:00100000:2.0:1788876916.209100:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1788876916.209105:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532441600:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876916.209117:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c606dc00 x1875771532441600/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.209149:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532441600:12345-0@lo:400:kworker.0 Request processed in 44us (4237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209156:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1788876916.209165:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442240 00000100:00100000:2.0:1788876916.209168:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442240 00000100:00100000:2.0:1788876916.209181:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442752 00000100:00100000:2.0:1788876916.209183:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442752 00000100:00100000:2.0:1788876916.209193:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532441856 00000100:00100000:2.0:1788876916.209195:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532441856 00000100:00100000:2.0:1788876916.209203:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442368 00000100:00100000:2.0:1788876916.209206:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442368 00000100:00100000:2.0:1788876916.209216:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788876916.209221:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532441984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209257:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532441984:12345-0@lo:400:kworker.0 Request processed in 27us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209263:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788876916.209273:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1788876916.209279:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532442240:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876916.209289:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa780a80 x1875771532442240/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.209310:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532442240:12345-0@lo:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209315:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1788876916.209325:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1788876916.209329:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532442752:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876916.209338:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa780e00 x1875771532442752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.209357:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532442752:12345-0@lo:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209362:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1788876916.209370:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1788876916.209375:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532441856:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876916.209384:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa783100 x1875771532441856/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.209406:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532441856:12345-0@lo:400:kworker.0 Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209411:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1788876916.209421:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1788876916.209426:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532442368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209449:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532442368:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.209455:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00080000:2.0:1788876916.209482:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876916.209485:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876916.209487:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876916.209513:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532441856:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209523:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532442368:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209531:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532441728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209539:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532442240:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209547:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532442752:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209582:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532441472:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209592:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532441984:0@lo:400:kworker.0 00000100:00100000:2.0:1788876916.209617:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532442496:0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210065:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876916.210092:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442112 00000100:00100000:1.0:1788876916.210096:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442112 00000100:00100000:1.0:1788876916.210125:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788876916.210132:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210161:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532442112:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.210167:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788876916.210195:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f5219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532442112:0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210204:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210226:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876916.210256:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442624 00000100:00100000:1.0:1788876916.210259:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442624 00000100:00100000:1.0:1788876916.210290:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788876916.210296:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532442624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210323:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532442624:12345-0@lo:400:kworker.0 Request processed in 27us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.210328:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788876916.210350:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532442624:0@lo:400:kworker.0 00000100:00100000:1.0:1788876916.210371:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532441600:0@lo:400:kworker.0 00000100:00080000:2.0:1788876916.210452:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876916.411180:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876916.411213:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876916.411237:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876916.411268:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876916.411289:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876916.411316:0:51100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294720 00000100:00100000:1.0:1788876916.411324:0:51100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294720 00000100:00100000:1.0:1788876916.411363:0:51100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1788876916.411371:0:51100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511294720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876916.411430:0:51100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511294720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.411437:0:51100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1788876916.411464:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295104 00000100:00100000:1.0:1788876916.411468:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295104 00000100:00100000:1.0:1788876916.411498:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295232 00000100:00100000:1.0:1788876916.411500:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295232 00000100:00100000:1.0:1788876916.411518:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1419 00000100:00100000:1.0:1788876916.411524:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511295104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876916.411548:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511295104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.411553:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1419 00000100:00100000:1.0:1788876916.411563:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1420 00000100:00100000:1.0:1788876916.411569:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511295232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876916.411587:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511295232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876916.411593:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1420 00000100:00100000:2.0:1788876916.416422:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294848 00000100:00100000:2.0:1788876916.416437:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294848 00000100:00100000:2.0:1788876916.416505:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294976 00000100:00100000:2.0:1788876916.416508:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294976 00000100:00100000:2.0:1788876916.416532:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1868 00000100:00100000:2.0:1788876916.416540:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2395:x1875771511294848:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:2.0:1788876916.416566:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c606ed80 x1875771511294848/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.416645:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2395:x1875771511294848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 105us (5474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.416652:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1868 00000100:00100000:2.0:1788876916.416682:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1869 00000100:00100000:2.0:1788876916.416690:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511294976:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876916.416715:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511294976:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (5446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.416721:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1869 00000100:00080000:2.0:1788876916.416748:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876916.416752:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876916.416754:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876916.416757:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:3.0:1788876916.602740:0:52413:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788876916.602788:0:52413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.602801:0:52413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.602807:0:52413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.602814:0:52413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.602836:0:52413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788876916.602842:0:52413:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788876916.602867:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876916.602871:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788876916.602877:0:52413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788876916.602899:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13f07af000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788876916.602977:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876916.602985:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.602992:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960400 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876916.602995:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.603005:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876916.603016:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876916.603022:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788876916.603024:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788876916.603026:0:6528:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788876916.603052:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.603058:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788876916.603259:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876916.603320:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.603378:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443008 00000100:00100000:2.0:1788876916.603384:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443008 00000100:00100000:2.0:1788876916.603426:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788876916.603433:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532443008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876916.603444:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876916.603458:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313afb4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb44 expref: 24 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.603470:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876916.603498:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3663:x1875771532443008:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.603505:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788876916.603538:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876916.603629:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.603637:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960400/0xf5bf0f7e313afb44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb4b expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.603647:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.603648:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.603650:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876916.604101:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532442880:0@lo:39:umount.0 00000100:00100000:1.0:1788876916.604141:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876916.604402:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532442880 00000100:00100000:2.0:1788876916.604408:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532442880 00000100:00100000:2.0:1788876916.604448:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1788876916.604456:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532442880:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788876916.604479:0:51736:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afc63 00000100:00080000:2.0:1788876916.604495:0:51736:0:(import.c:65:import_set_state_nolock()) ffff8a13c5ff9800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1788876916.604534:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c606c700 x1875771532442880/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:312/0 lens 224/224 e 0 to 0 dl 1788876927 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.604578:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532442880:12345-0@lo:39:umount.0 Request processed in 124us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.604583:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000020:00000080:2.0:1788876916.604591:0:51736:0:(genops.c:885:class_export_put()) final put ffff8a13c5ffc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788876916.604658:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5ffc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876916.604697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5ff9800 for lustre-MDT0000 00000100:00080000:3.0:1788876916.605729:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f07af000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788876916.605754:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532442880:0@lo:39:umount.0 00000100:00080000:2.0:1788876916.605810:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876916.605814:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788876916.605819:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788876916.606736:0:52413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606751:0:52413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606758:0:52413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606764:0:52413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606787:0:52413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876916.606792:0:52413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606798:0:52413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606804:0:52413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606810:0:52413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606825:0:52413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788876916.606831:0:52413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606837:0:52413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606844:0:52413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606850:0:52413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606858:0:52413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788876916.606862:0:52413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606868:0:52413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606873:0:52413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606879:0:52413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876916.606885:0:52413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788876916.606888:0:52413:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788876916.606925:0:52413:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788876916.606929:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1788876916.606935:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1788876916.606940:0:52413:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1788876916.608736:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788876916.608748:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608759:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:3.0:1788876916.608763:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608773:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876916.608780:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876916.608786:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788876916.608788:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788876916.608791:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788876916.608836:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608843:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788876916.608873:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608885:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961600/0xf5bf0f7e313afa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa72 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608901:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788876916.608905:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608911:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73c00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:3.0:1788876916.608914:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608921:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876916.608926:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876916.608931:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788876916.608933:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788876916.608934:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788876916.608947:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608962:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788876916.608969:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608975:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313afb6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb75 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608988:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788876916.608991:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.608997:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961200 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:3.0:1788876916.609000:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609005:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876916.609011:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876916.609017:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788876916.609019:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788876916.609021:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788876916.609033:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609038:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788876916.609053:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609060:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961200/0xf5bf0f7e313afb36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afb3d expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609069:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788876916.609072:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609079:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960200 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:3.0:1788876916.609081:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609098:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876916.609105:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876916.609110:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788876916.609112:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788876916.609113:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788876916.609126:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609132:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788876916.609137:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609143:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960200/0xf5bf0f7e313afa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313afa64 expref: -99 pid: 51093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609151:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876916.609153:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876916.609154:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876916.609175:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532443136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609239:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.609296:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876916.609303:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532443264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609321:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.609342:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609358:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.609372:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876916.609376:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609393:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.609416:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443136 00000100:00100000:3.0:1788876916.609422:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443136 00000100:00100000:3.0:1788876916.609461:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443264 00000100:00100000:3.0:1788876916.609464:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443264 00000100:00100000:3.0:1788876916.609473:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443520 00000100:00100000:3.0:1788876916.609475:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443520 00000100:00100000:3.0:1788876916.609484:0:43957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443392 00000100:00100000:3.0:1788876916.609486:0:43957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443392 00000100:00100000:3.0:1788876916.609500:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788876916.609507:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+26:3664:x1875771532443136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876916.609518:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876916.609532:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313afa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afa6b expref: 26 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609543:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876916.609576:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+25:3664:x1875771532443136:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876916.609583:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788876916.609598:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788876916.609627:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532443264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876916.609635:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876916.609644:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7960e00/0xf5bf0f7e313afb75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb6e expref: 24 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609652:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876916.609673:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3664:x1875771532443264:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876916.609678:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788876916.609692:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788876916.609698:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3663:x1875771532443520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876916.609705:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876916.609712:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7961a00/0xf5bf0f7e313afa64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afa5d expref: 22 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609720:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876916.609743:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3663:x1875771532443520:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876916.609749:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788876916.609760:0:43957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788876916.609766:0:43957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3663:x1875771532443392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876916.609773:0:43957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876916.609781:0:43957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313afb3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb36 expref: 20 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876916.609788:0:43957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876916.609807:0:43957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3663:x1875771532443392:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876916.609811:0:43957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788876916.609874:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609882:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532443520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609906:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532443264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876916.609913:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532443136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876916.611232:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.611244:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1788876916.612027:0:52413:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788876916.616173:0:51094:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 85899345925 is committed 00010000:00010000:0.0:1788876916.616238:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616258:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616265:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616270:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876916.616275:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616283:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616301:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13e7965900) 00010000:00010000:0.0:1788876916.616305:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876916.616309:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.616316:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313aff26 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788876916.616424:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1788876916.616432:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c720b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788876916.616437:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13f4441000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788876916.616441:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c5f9b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788876916.616447:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13ff33b000 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 7 (0 0 2) 0 0 0 0: 0000000000000000 85899345925 stale:0 00000020:00080000:3.0:1788876916.616451:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c3006800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788876916.616455:0:52413:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c3f63380) has exports, disconnecting them 00000020:00080000:3.0:1788876916.616459:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13c720b800), last request at 1788876916 00000020:00000080:3.0:1788876916.616465:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afc5c 00000100:00080000:3.0:1788876916.616473:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13c5fff000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788876916.616497:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c720b800): rc 0 00000020:00000080:3.0:1788876916.616499:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c720b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788876916.616509:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13f4441000), last request at 1788876916 00000020:00000080:3.0:1788876916.616512:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afc55 00000100:00080000:3.0:1788876916.616515:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13c720d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788876916.616527:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f4441000): rc 0 00000020:00000080:3.0:1788876916.616529:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13f4441000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788876916.616532:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13c5f9b800), last request at 1788876880 00000020:00000080:3.0:1788876916.616534:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afc4e 00000100:00080000:3.0:1788876916.616537:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13f4440800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788876916.616544:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c5f9b800): rc 0 00000020:00000080:3.0:1788876916.616546:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c5f9b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788876916.616549:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13ff33b000), last request at 1788876916 00000020:00000080:3.0:1788876916.616557:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afab8 00000020:00010000:3.0:1788876916.616566:0:52413:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13ff33b000: total 3 00000100:00080000:3.0:1788876916.616569:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7b8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788876916.616641:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13ff33b000): rc 0 00000020:00080000:3.0:1788876916.616644:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13c3006800), last request at 1788876875 00000020:00000080:3.0:1788876916.616648:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afab1 00000100:00080000:3.0:1788876916.616652:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13c3005800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788876916.616656:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c3006800): rc 0 00000020:00000080:3.0:1788876916.616657:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c3006800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:3.0:1788876916.616664:0:52413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa6208204bae0 00000100:00080000:3.0:1788876916.616681:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788876916.616685:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:1.0:1788876916.617051:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13ff33b000: total 4 00010000:00010000:1.0:1788876916.617104:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13ff33b000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788876916.617133:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7b8da00/0xf5bf0f7e313aff50 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489d6 expref: 3 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876916.617154:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a12c3221e00/0xf5bf0f7e313aff34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489cf expref: 2 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876916.617168:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13ff33b000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788876916.619072:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.619099:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876916.621340:0:52413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788876916.621374:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a12c2593800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788876916.621416:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443648:0@lo:39:umount.0 00000100:00100000:3.0:1788876916.621482:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788876916.623108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c720b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876916.623190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4441000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876916.623210:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f9b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876916.623228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3006800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788876916.623260:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5fff000 for lustre-MDT0000 00000020:00000080:2.0:1788876916.623265:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c720d800 for lustre-MDT0000 00000020:00000080:2.0:1788876916.623268:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f4440800 for lustre-MDT0000 00000020:00000080:2.0:1788876916.623270:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c3005800 for lustre-MDT0000 00000100:00080000:3.0:1788876916.625681:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788876916.625689:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934860 gen 3 00000004:00080000:3.0:1788876916.625702:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788876916.625760:0:52413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788876916.625785:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f98000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788876916.625803:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788876916.625805:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967568 gen 3 00000004:00080000:3.0:1788876916.625813:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876916.625887:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443776:0@lo:9:umount.0 00000100:00100000:3.0:1788876916.625952:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876916.626200:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443776 00000100:00100000:3.0:1788876916.626207:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443776 00000100:00100000:3.0:1788876916.626261:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788876916.626271:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532443776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788876916.626295:0:43955:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb13 00000100:00080000:3.0:1788876916.626303:0:43955:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f9f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788876916.626344:0:43955:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934860 00000100:00100000:3.0:1788876916.626480:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532443776:12345-0@lo:9:umount.0 Request processed in 210us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876916.626488:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00080000:3.0:1788876916.626530:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f98000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788876916.626535:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788876916.626537:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876916.626540:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443776:0@lo:9:umount.0 00010000:00010000:3.0:1788876916.626560:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876916.626567:0:52413:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788876916.626577:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13f4438000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788876916.626595:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443904:0@lo:9:umount.0 00000100:00100000:3.0:1788876916.627230:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788876916.627326:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c3f63380) has no exports 00000100:00100000:2.0:1788876916.630107:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443904 00000100:00100000:2.0:1788876916.630123:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443904 00000100:00100000:2.0:1788876916.630178:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1788876916.630188:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532443904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788876916.630213:0:8456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb21 00000100:00080000:2.0:1788876916.630220:0:8456:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788876916.630275:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967568 00000100:00100000:2.0:1788876916.630438:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532443904:12345-0@lo:9:umount.0 Request processed in 251us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876916.630444:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:2.0:1788876916.630484:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f4438000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788876916.630489:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788876916.630491:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876916.630495:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443904:0@lo:9:umount.0 00010000:00010000:2.0:1788876916.630517:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876916.631669:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532443648 00000100:00100000:0.0:1788876916.631678:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532443648 00000100:00100000:0.0:1788876916.631726:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788876916.631734:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532443648:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788876916.631755:0:6545:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afaf7 00000100:00080000:0.0:1788876916.631762:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a13d1516000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788876916.631779:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1788876916.631911:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532443648:12345-0@lo:39:umount.0 Request processed in 177us (10428us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788876916.631918:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00010000:00010000:0.0:1788876916.631936:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876916.633292:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c2593800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788876916.633303:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532443648:0@lo:39:umount.0 00000020:00080000:3.0:1788876916.633428:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c3f63380) has no exports 00000020:00000080:1.0:1788876916.672794:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a13ff33b000/f0204769-56bd-4f5c-ab97-74c450c9e072 00000020:00000080:2.0:1788876916.678709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff33b000/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:2.0:1788876916.688689:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fa7b8000 for lustre-MDT0000 00010000:00010000:2.0:1788876916.688715:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876916.688718:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876916.688720:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788876916.714874:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afacd 00000020:00000080:3.0:1788876916.714890:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c5f30800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788876916.714906:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788876916.715203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f30800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788876916.715230:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876916.715239:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788876916.715254:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a12c4e34d40) has no exports 00000020:00000080:2.0:1788876916.718067:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afac6 00000020:00000080:2.0:1788876916.718082:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c5f9d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788876916.721142:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f9d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876916.721371:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876916.721386:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788876916.721393:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c5f99800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788876916.721396:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f99800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788876916.721403:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788876916.721577:0:52413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c4c92900 - data ffff8a13ee841798/ffff8a12c5b93000 00000020:01000000:2.0:1788876916.721757:0:52413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13e7b12420 - data ffff8a13f00c26c0/ffff8a12c3da8c00 00000100:00080000:2.0:1788876916.790736:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876916.790745:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788876916.790759:0:52413:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13eb149880 x1875771532443648/t4294967327(4294967327) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876926 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876916.790785:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788876916.794339:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788876916.794346:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934860 gen 4 00000004:00080000:2.0:1788876916.794399:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876916.794402:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788876916.795174:0:51111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788876916.795180:0:51111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x50:0x0] index 1 count 1 00000040:00080000:1.0:1788876916.795191:0:51111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 20 count 2 00000100:00080000:2.0:1788876916.795846:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788876916.795851:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967568 gen 4 00000004:00080000:2.0:1788876916.795864:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788876916.795865:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788876916.796177:0:51113:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788876916.796180:0:51113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x52:0x0] index 1 count 1 00000040:00080000:1.0:1788876916.796188:0:51113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 20 count 2 00000020:00000080:2.0:1788876916.796908:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afa87 00000020:00000080:2.0:1788876916.796916:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c2591000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876916.797639:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afa9c 00000020:00000080:2.0:1788876916.797646:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c49fc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788876916.797652:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788876916.797657:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876916.797665:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876916.797669:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c3f60000) has no exports 00000004:01000000:2.0:1788876916.797853:0:52413:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788876916.797860:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb1a 00000020:00000080:2.0:1788876916.797863:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13d0e63000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788876916.797867:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788876916.797870:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876916.797878:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788876916.797880:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c5e3b380) has no exports 00000020:00000080:2.0:1788876916.797886:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb0c 00000020:00000080:2.0:1788876916.797889:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13f4439000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876916.798231:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2591000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788876916.798255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788876916.798260:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e63000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788876916.798265:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4439000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788876916.801595:0:52413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788876916.801753:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788876916.801758:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967568 gen 5 00000004:00080000:1.0:1788876916.801767:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876916.801770:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788876916.801826:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.801912:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f4438000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788876916.801943:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876916.801949:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13d0e62000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876916.801953:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e62000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788876916.801967:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876916.802056:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afafe 00000020:00000080:1.0:1788876916.802063:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13d0e62800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876916.802166:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788876916.802171:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876916.802177:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788876916.802181:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c4e30000) has no exports 00000020:00000080:1.0:1788876916.802189:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afaf0 00000020:00000080:1.0:1788876916.802193:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13eefda800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876916.803878:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e62800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788876916.805787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eefda800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788876916.805858:0:52413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788876916.805863:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788876916.805867:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934860 gen 5 00000004:00080000:1.0:1788876916.805874:0:52413:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788876916.805876:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788876916.805918:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788876916.805929:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788876916.805944:0:52413:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788876916.805951:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afae2 00000020:00000080:0.0:1788876916.806070:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5f98000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788876916.806079:0:8:0:(genops.c:885:class_export_put()) final put ffff8a13f4441800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876916.806082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4441800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788876916.806095:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876916.806260:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13f4447000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788876916.806275:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788876916.806280:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788876916.806286:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788876916.806289:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a12c5e3cd40) has no exports 00000020:00000080:1.0:1788876916.806295:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afadb 00000020:00000080:1.0:1788876916.806299:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c2594800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876916.806540:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4447000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788876916.806546:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2594800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788876916.807650:0:52413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788876916.807655:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788876916.807658:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788876916.807663:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876916.807714:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.807721:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876916.807744:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.807747:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876916.807751:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13eefd8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876916.807754:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eefd8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788876916.807760:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876916.807848:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afaa3 00000020:00000080:0.0:1788876916.807854:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c49fd800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788876916.807858:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788876916.807861:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876916.807865:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788876916.807867:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c3f619c0) has no exports 00000020:00000080:0.0:1788876916.807883:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.807886:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788876916.807890:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afaaa 00000020:00000080:0.0:1788876916.807892:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c49fb800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788876916.807898:0:52413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13c4ebc800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788876916.807902:0:52413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13c4ebc800 3 00000020:01000004:0.0:1788876916.807905:0:52413:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13c4ebc800 from lustre-MDT0000 00000020:00000080:0.0:1788876916.807921:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.807924:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788876916.807927:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c2595800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788876916.807929:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c2595800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788876916.807935:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788876916.807972:0:52413:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788876916.807976:0:52413:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788876916.807979:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788876916.807981:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876916.807984:0:52413:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788876916.807992:0:52413:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13ff363800 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876916.807998:0:52413:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13ff37f800 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876916.808002:0:52413:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c5e38000) has exports, disconnecting them 00000020:00080000:0.0:1788876916.808006:0:52413:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13ff363800), last request at 1788876875 00000020:00000080:0.0:1788876916.808027:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb67 00000020:00010000:0.0:1788876916.808032:0:52413:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13ff363800: total 2 00000100:00080000:0.0:1788876916.808035:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13ff364800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876916.808045:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13ff363800): rc 0 00000020:00080000:0.0:1788876916.808049:0:52413:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13ff37f800), last request at 1788876874 00000020:00000080:0.0:1788876916.808098:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afa4f 00000020:00010000:0.0:1788876916.808102:0:52413:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13ff37f800: total 2 00000100:00080000:0.0:1788876916.808104:0:52413:0:(import.c:65:import_set_state_nolock()) ffff8a13ff37e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788876916.808113:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13ff37f800): rc 0 00000020:00080000:0.0:1788876916.808117:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c5e38000) has no exports 00000020:00010000:0.0:1788876916.808125:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13ff363800: total 2 00010000:00010000:0.0:1788876916.808128:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.808150:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13ff363800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1788876916.808176:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7961c00/0xf5bf0f7e313afc32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048989 expref: 5 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808190:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313afc40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048997 expref: 4 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808201:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313afc39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048990 expref: 3 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808210:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313afc47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc3704899e expref: 2 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808218:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13ff363800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1788876916.808234:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13ff363800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:0.0:1788876916.808239:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13ff37f800: total 3 00010000:00010000:0.0:1788876916.808262:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13ff37f800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788876916.808276:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7960600/0xf5bf0f7e313afbd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbd0 expref: 14 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808287:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72400/0xf5bf0f7e313afbe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbde expref: 13 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808299:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221a00/0xf5bf0f7e313afb83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb7c expref: 12 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808307:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8ca00/0xf5bf0f7e313afc01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbfa expref: 11 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808321:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220c00/0xf5bf0f7e313afb91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb8a expref: 10 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808331:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73200/0xf5bf0f7e313afbf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbec expref: 9 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808341:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313afc1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afc16 expref: 8 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808350:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73600/0xf5bf0f7e313afbad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afba6 expref: 7 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808359:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c400/0xf5bf0f7e313afc0f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afc08 expref: 6 pid: 51101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808368:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72a00/0xf5bf0f7e313afb9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afb98 expref: 5 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808377:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7960a00/0xf5bf0f7e313afc2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afc24 expref: 4 pid: 51099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808386:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313afbbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbb4 expref: 3 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808397:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73800/0xf5bf0f7e313afbc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313afbc2 expref: 2 pid: 51100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876916.808406:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13ff37f800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788876916.808416:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13ff37f800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00010000:00010000:0.0:1788876916.808420:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.808422:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876916.808424:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876916.809047:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876916.809094:0:51101:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13d36a8400:51101] 2 exiting: rc = 0 00000100:00100000:2.0:1788876916.809194:0:51099:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13e7b22c00:51099] 0 exiting: rc = 1 00000020:00000080:2.0:1788876916.809234:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c2593800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788876916.809240:0:8:0:(genops.c:885:class_export_put()) final put ffff8a13c3003000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876916.809242:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3003000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788876916.809257:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876916.809311:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788876916.809315:0:8:0:(genops.c:885:class_export_put()) final put ffff8a13eefdc800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788876916.809317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eefdc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788876916.809320:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788876916.809344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876916.809348:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff363800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:2.0:1788876916.809376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37f800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:2.0:1788876916.809388:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff364800 for MGS 00000020:00000080:2.0:1788876916.809392:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff37e000 for MGS 00000100:00100000:2.0:1788876916.809689:0:51100:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13d36a8200:51100] 1 exiting: rc = 0 00000100:00100000:0.0:1788876916.809776:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809783:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809788:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809794:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809799:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809805:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809811:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809816:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809821:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809828:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809842:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809847:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809853:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809858:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809863:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809868:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809873:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809878:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809883:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809889:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809895:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809901:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809907:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809914:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809919:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809939:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809946:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809952:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809966:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809972:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809978:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809985:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809990:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.809996:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810001:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810007:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810012:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810017:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810023:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810028:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810033:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810038:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810043:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810047:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810052:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810057:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810062:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810067:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810072:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810077:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810091:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810097:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810102:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810108:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810114:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810120:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810125:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810130:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810135:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810140:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810146:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810151:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810157:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788876916.810163:0:52413:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788876916.811196:0:52413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13c86a4180 - data ffff8a13f01ea948/ffff8a12c2430000 00000020:01000000:0.0:1788876916.811327:0:52413:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c2218240 - data ffff8a13f03b6ca8/ffff8a13f5554400 00000020:00000080:0.0:1788876916.811777:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afa48 00000020:00000080:0.0:1788876916.811785:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c486d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788876916.811798:0:52413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13c4ebc800 from MGS, refs=2 00000020:01000004:0.0:1788876916.811801:0:52413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13c4ebc800 2 00000020:01000004:0.0:1788876916.811805:0:52413:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13c4ebc800 from MGS 00000020:00000080:0.0:1788876916.811822:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876916.811827:0:52413:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788876916.811829:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c8696800/MGS 00000020:00000080:0.0:1788876916.811832:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c8696800/MGS for MGS 00000020:00000080:2.0:1788876916.811935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c486d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788876916.812036:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788876916.812173:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788876916.812177:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876916.812188:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788876916.812194:0:52413:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a12c340a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788876916.812199:0:52413:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c25e8000) has exports, disconnecting them 00000020:00080000:0.0:1788876916.812204:0:52413:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a12c340a800), last request at 1788876875 00000020:00000080:0.0:1788876916.812207:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afb59 00000020:00080000:0.0:1788876916.812218:0:52413:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c340a800): rc 0 00000020:00000080:0.0:1788876916.812222:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a12c340a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876916.813833:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788876916.815299:0:52413:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788876916.815307:0:52413:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788876916.815311:0:52413:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876916.815318:0:52413:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876916.815346:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f07af000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788876916.815518:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876916.815533:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788876916.815540:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13ff3df000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788876916.815544:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3df000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788876916.815559:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788876916.815666:0:52413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13c4ebc800 1 00000020:00000080:2.0:1788876916.815673:0:52413:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afa3a 00000020:00000080:2.0:1788876916.815680:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c8697000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788876916.815688:0:52413:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788876916.815695:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c8697000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788876916.815704:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876916.815708:0:52413:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788876916.815712:0:52413:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c25eb380) has no exports 00010000:00010000:0.0:1788876917.037891:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788876917.043020:0:52413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876917.043034:0:52413:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788876917.043041:0:52413:0:(genops.c:885:class_export_put()) final put ffff8a13c486a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788876917.043046:0:52413:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c486a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788876917.043059:0:52413:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788876917.043190:0:52413:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13c4ebd800 00000020:02000400:2.0:1788876917.043280:0:52413:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788876917.227750:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532444032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876917.227831:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876917.227887:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444032 00000100:00100000:3.0:1788876917.227894:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444032 00000100:00100000:3.0:1788876917.227936:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1788876917.227944:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532444032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876917.227980:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876917.228023:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532444032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876917.228030:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1788876917.228076:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532444032:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876918.063094:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876918.255573:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532444160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876918.255715:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876918.255822:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444160 00000100:00100000:0.0:1788876918.255830:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444160 00000100:00100000:0.0:1788876918.255900:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1788876918.255909:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532444160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876918.255936:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876918.265812:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532444160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9895us (10087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876918.265826:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00080000:0.0:1788876918.265866:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876918.271410:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532444160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876919.084420:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876920.105490:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876921.129129:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876921.320873:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532444288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876921.320951:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876921.321256:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444288 00000100:00100000:2.0:1788876921.321264:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444288 00000100:00100000:2.0:1788876921.321309:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1788876921.321316:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1875771532444288:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788876921.321325:0:6544:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788876921.321373:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1875771532444288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (429us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788876921.321380:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:02020000:3.0:1788876921.321498:0:3662:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788876921.321504:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876921.321509:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876921.321513:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876921.321518:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876921.321522:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1868 00000100:00080000:3.0:1788876921.321529:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876921.321549:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25aa00 x1875771532444416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876921.321663:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532444416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788876921.321693:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876921.321763:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444416 00000100:00100000:3.0:1788876921.321768:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444416 00000100:00100000:3.0:1788876921.321795:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788876921.321799:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532444416:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788876921.321817:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876921.321863:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532444416:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876921.321870:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00080000:0.0:1788876921.321934:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876921.321939:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876921.321951:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532444416:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788876921.322269:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532444800:0@lo:400:kworker.0 00000100:00100000:3.0:1788876921.322299:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876921.322316:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532445312:0@lo:400:kworker.0 00000100:00100000:3.0:1788876921.322337:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876921.322356:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788876921.322361:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532444672:0@lo:400:kworker.0 00000100:00100000:3.0:1788876921.322379:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876921.322395:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532445184:0@lo:400:kworker.0 00000100:00100000:3.0:1788876921.322416:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876921.322437:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445312 00000100:00100000:3.0:1788876921.322441:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445312 00000100:00100000:3.0:1788876921.322463:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444672 00000100:00100000:3.0:1788876921.322465:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444672 00000100:00100000:3.0:1788876921.322491:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1788876921.322496:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532445312:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788876921.322501:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788876921.322530:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3665:x1875771532445312:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876921.322720:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444800 00000100:00100000:0.0:1788876921.322725:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444800 00000100:00100000:0.0:1788876921.322762:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445184 00000100:00100000:0.0:1788876921.322765:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445184 00000100:00100000:0.0:1788876921.322784:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1788876921.322791:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532444800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.322826:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532444800:12345-0@lo:400:kworker.0 Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876921.322832:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1788876921.322846:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1788876921.322852:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.322875:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532445184:12345-0@lo:400:kworker.0 Request processed in 23us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876921.322881:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:0.0:1788876921.322900:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876921.322904:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876921.322917:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.322954:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876921.322973:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532445440:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.322992:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876921.323009:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788876921.323015:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532444544:0@lo:400:kworker.0 00000400:00000100:0.0:1788876921.323033:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532444544 offset 0 length 224: 4 00000100:00100000:0.0:1788876921.323052:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.323071:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876921.323090:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444928 00000100:00100000:0.0:1788876921.323093:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444928 00000100:00100000:0.0:1788876921.323106:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445440 00000100:00100000:0.0:1788876921.323108:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445440 00000100:00100000:0.0:1788876921.323124:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445056 00000100:00100000:0.0:1788876921.323127:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445056 00000100:00100000:0.0:1788876921.323141:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1788876921.323147:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.323180:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532445440:12345-0@lo:400:kworker.0 Request processed in 33us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876921.323196:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1788876921.323207:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1788876921.323213:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532445056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.323252:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532445056:12345-0@lo:400:kworker.0 Request processed in 40us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876921.323258:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1788876921.323269:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788876921.323273:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3665:x1875771532444672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876921.323277:0:51736:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876921.323300:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3665:x1875771532444672:12345-0@lo:400:kworker.0 Request processed in 25us (918us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876921.323305:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1788876921.323317:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1788876921.323321:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3662:x1875771532444928:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788876921.323325:0:51736:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788876921.323344:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3662:x1875771532444928:12345-0@lo:400:kworker.0 Request processed in 22us (390us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788876921.323350:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00080000:0.0:1788876921.323363:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876921.323383:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532445056:0@lo:400:kworker.0 00000100:00080000:0.0:1788876921.323392:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876921.323396:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876921.323399:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876921.323404:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876921.323407:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1868 00000100:00080000:0.0:1788876921.323412:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876921.323428:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e7480 x1875771532445568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876921.323444:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.323457:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532445440:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.323482:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532445568:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788876921.323504:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876921.323526:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445568 00000100:00100000:0.0:1788876921.323530:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445568 00000100:00100000:0.0:1788876921.323560:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:0.0:1788876921.323564:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532445568:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788876921.323581:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876921.323841:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532445568:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 274us (336us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876921.323848:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00080000:0.0:1788876921.323873:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876921.323877:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876921.323880:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532445568:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788876921.323929:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876921.324051:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876921.324055:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876921.324058:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876921.324061:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1868 00000100:00080000:0.0:1788876921.324066:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876921.324081:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13ff5e7480 x1875771532445696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876921.324097:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532444672:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.324112:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788876921.324122:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532444800:0@lo:400:kworker.0 00000100:00080000:0.0:1788876921.324131:0:3665:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788876921.324135:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788876921.324137:0:3665:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788876921.324140:0:3665:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876921.324144:0:3665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1868 00000100:00080000:0.0:1788876921.324148:0:3665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876921.324161:0:3665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3658000 x1875771532445824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876921.324170:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532445312:0@lo:400:kworker.0 00000100:00100000:1.0:1788876921.324299:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532445696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788876921.324331:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876921.324351:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532445824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788876921.324370:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876921.324407:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445696 00000100:00100000:1.0:1788876921.324411:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445696 00000100:00100000:1.0:1788876921.324430:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445824 00000100:00100000:1.0:1788876921.324433:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445824 00000100:00100000:1.0:1788876921.324446:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1788876921.324451:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532445696:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788876921.324463:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876921.324494:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532445696:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (162us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876921.324500:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1788876921.324513:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1788876921.324517:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532445824:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788876921.324526:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876921.324561:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532445824:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (190us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876921.324567:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00080000:1.0:1788876921.324593:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876921.324597:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876921.324630:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532445696:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788876921.324640:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876921.324643:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876921.324646:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532445824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788876921.325248:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:1.0:1788876921.518009:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876921.518056:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:1.0:1788876921.518084:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511295360 offset 0 length 224: 4 00000100:00100000:1.0:1788876921.518101:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876921.518136:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876921.518336:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295744 00000100:00100000:2.0:1788876921.518347:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295744 00000100:00100000:2.0:1788876921.518420:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295872 00000100:00100000:2.0:1788876921.518423:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295872 00000100:00100000:2.0:1788876921.518451:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1423 00000100:00100000:2.0:1788876921.518462:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511295744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876921.518553:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511295744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876921.518563:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1423 00000100:00100000:2.0:1788876921.518579:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1424 00000100:00100000:2.0:1788876921.518586:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511295872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876921.518834:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511295872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 246us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876921.518841:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1424 00000100:00100000:2.0:1788876921.518869:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295488 00000100:00100000:2.0:1788876921.518873:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295488 00000100:00100000:2.0:1788876921.518894:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511295616 00000100:00100000:2.0:1788876921.518897:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511295616 00000100:00100000:2.0:1788876921.518918:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1872 00000100:00100000:2.0:1788876921.518928:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511295616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876921.518972:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511295616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876921.518980:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1872 00000100:00100000:2.0:1788876921.518993:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2659 00000100:00100000:2.0:1788876921.518997:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875771511295488:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:2.0:1788876921.519003:0:6541:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:2.0:1788876921.519026:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1875771511295488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (1030us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788876921.519032:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2659 00000100:00080000:1.0:1788876921.519345:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876921.519350:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876921.519353:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876921.524447:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876921.524753:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296000 00000100:00100000:1.0:1788876921.524763:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296000 00000100:00100000:1.0:1788876921.524813:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2660 00000100:00100000:1.0:1788876921.524821:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511296000:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788876921.524847:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876921.524919:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511296000:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 Request processed in 98us (486us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876921.524927:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2660 00000001:00100000:0.0:1788876921.836923:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876921.836941:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13c5f99000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876921.836966:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5f99000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788876921.837004:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c5f9f000 for lustre-OST0000 00000001:00100000:2.0:1788876921.837892:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788876921.837902:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967327 is committed 00000020:00000080:2.0:1788876921.837906:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a13d1515000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876921.837997:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d1515000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:1.0:1788876921.838311:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876921.838316:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876921.838412:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d1516000 for lustre-MDT0001 00000020:00000080:0.0:1788876921.838504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788876921.838626:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c49fc800 for lustre-OST0001 00010000:00010000:2.0:1788876922.153111:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876922.344975:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532445952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876922.345045:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876922.345140:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532445952 00000100:00100000:3.0:1788876922.345148:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532445952 00000100:00100000:3.0:1788876922.345248:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1788876922.345259:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532445952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876922.345288:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876922.345340:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532445952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876922.345348:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1788876922.345428:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532445952:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788876923.180495:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876923.369468:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532446080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876923.369571:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876923.369723:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446080 00000100:00100000:1.0:1788876923.369734:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446080 00000100:00100000:1.0:1788876923.369821:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788876923.369833:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532446080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876923.369872:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00080000:2.0:1788876923.370103:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876923.370227:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532446080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 383us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876923.370235:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1788876923.384417:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532446080:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876924.200934:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876925.225143:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876926.249635:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876926.441806:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532446208:0@lo:400:kworker.0 00000400:00000100:0.0:1788876926.441866:0:3665:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532446208 offset 0 length 224: 4 00000100:00080000:3.0:1788876926.441960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876926.441967:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876926.441971:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876926.445151:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1909 00000100:00080000:3.0:1788876926.445167:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788876926.445176:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876926.445226:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fae32680 x1875771532446336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876926.445376:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532446336:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.445448:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876926.445518:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446336 00000100:00100000:0.0:1788876926.445534:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446336 00000100:00080000:3.0:1788876926.445575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876926.445580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876926.445583:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876926.445588:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1909 00000100:00080000:3.0:1788876926.445591:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788876926.445596:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876926.445639:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fae33480 x1875771532446464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788876926.445653:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1788876926.445729:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532446336:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876926.445758:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876926.445906:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532446464:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.445944:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788876926.446013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876926.446016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876926.446018:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876926.446021:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1909 00000100:00080000:3.0:1788876926.446024:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788876926.446028:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876926.446040:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3aa00 x1875771532446720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876926.446068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876926.446071:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876926.446073:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876926.446076:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1909 00000100:00080000:3.0:1788876926.446079:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788876926.446082:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876926.446092:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39880 x1875771532447104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876926.446147:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446464 00000100:00100000:3.0:1788876926.446154:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446464 00000100:00100000:3.0:1788876926.446210:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1788876926.446217:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532446464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876926.446236:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876926.446286:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532446464:12345-0@lo:38:kworker.0 Request processed in 67us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876926.446292:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1788876926.446327:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532446592:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.446373:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876926.446398:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876926.446404:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532446848:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.446939:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876926.446984:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446848 00000100:00100000:3.0:1788876926.446989:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446848 00000100:00100000:3.0:1788876926.447034:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1788876926.447043:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532446848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447088:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532446848:12345-0@lo:400:kworker.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876926.447094:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1788876926.447132:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532446848:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447153:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532446976:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447192:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876926.447225:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788876926.447231:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532447232:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447315:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876926.447342:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447232 00000100:00100000:3.0:1788876926.447346:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447232 00000100:00100000:3.0:1788876926.447589:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:3.0:1788876926.447598:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532447232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447657:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532447232:12345-0@lo:400:kworker.0 Request processed in 61us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876926.447663:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:3.0:1788876926.447686:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532447232:0@lo:400:kworker.0 00000100:00080000:3.0:1788876926.447708:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876926.447731:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446592 00000100:00100000:3.0:1788876926.447734:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446592 00000100:00100000:3.0:1788876926.447763:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446976 00000100:00100000:3.0:1788876926.447766:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446976 00000100:00100000:3.0:1788876926.447783:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1788876926.447790:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532446592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447825:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532446592:12345-0@lo:400:kworker.0 Request processed in 36us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876926.447831:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1788876926.447843:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1788876926.447849:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532446976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447881:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532446976:12345-0@lo:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876926.447886:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00080000:3.0:1788876926.447906:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876926.447909:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876926.447926:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532446592:0@lo:400:kworker.0 00000100:00100000:3.0:1788876926.447946:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532446976:0@lo:400:kworker.0 00000100:00080000:1.0:1788876926.462980:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876926.463000:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876926.463007:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532446336:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.463165:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532446720:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.464272:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876926.464432:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532447104:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.464469:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876926.464682:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532446336:12345-0@lo:38:kworker.0 Request processed in 18960us (19230us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876926.464694:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00080000:1.0:1788876926.473883:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876926.473900:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876926.473907:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532446464:0@lo:38:kworker.0 00000100:00100000:3.0:1788876926.474580:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532446720 00000100:00100000:3.0:1788876926.474616:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532446720 00000100:00100000:3.0:1788876926.474726:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447104 00000100:00100000:3.0:1788876926.474730:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447104 00000100:00100000:0.0:1788876926.475107:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1788876926.475119:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532446720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876926.475149:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876926.475273:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532446720:12345-0@lo:38:kworker.0 Request processed in 154us (11017us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876926.475281:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:0.0:1788876926.475303:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:0.0:1788876926.475307:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532447104:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876926.475326:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876926.475359:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532447104:12345-0@lo:38:kworker.0 Request processed in 50us (10889us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876926.475365:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00080000:1.0:1788876926.475504:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876926.475510:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876926.475515:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532446720:0@lo:38:kworker.0 00000100:00080000:1.0:1788876926.475526:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876926.475529:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876926.475532:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532447104:0@lo:38:kworker.0 00000100:00100000:1.0:1788876926.650074:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876926.650181:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:1.0:1788876926.650221:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511296128 offset 0 length 224: 4 00000100:00100000:1.0:1788876926.650241:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876926.650407:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296384 00000100:00100000:3.0:1788876926.650420:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296384 00000100:00100000:3.0:1788876926.650506:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1875 00000100:00100000:3.0:1788876926.650518:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511296384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876926.650657:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511296384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 140us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876926.650664:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1875 00000100:00080000:3.0:1788876926.650696:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876926.651354:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876926.651391:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296256 00000100:00100000:1.0:1788876926.651397:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296256 00000100:00100000:1.0:1788876926.651440:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2664 00000100:00100000:1.0:1788876926.651447:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511296256:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876926.651473:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876926.651530:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511296256:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 73us (169us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876926.651538:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2664 00000100:00100000:0.0:1788876926.659722:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296640 00000100:00100000:0.0:1788876926.659755:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296640 00000100:00100000:0.0:1788876926.659921:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296512 00000100:00100000:0.0:1788876926.659925:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296512 00000100:00100000:1.0:1788876926.659977:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1427 00000100:00100000:1.0:1788876926.659991:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511296640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876926.660112:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511296640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 124us (9930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876926.660120:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1427 00000100:00080000:3.0:1788876926.667427:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876926.667447:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876926.668622:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1428 00000100:00100000:0.0:1788876926.668645:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511296512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876926.668791:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511296512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 152us (18543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876926.668799:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1428 00010000:00010000:0.0:1788876927.273276:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876927.465307:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532447360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876927.465423:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876927.465641:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447360 00000100:00100000:1.0:1788876927.465653:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447360 00000100:00100000:1.0:1788876927.465730:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788876927.465744:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532447360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876927.465793:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876927.470540:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532447360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4784us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876927.470559:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1788876927.470742:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532447360:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788876928.298219:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876928.489587:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532447488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876928.489741:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876928.489900:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447488 00000100:00100000:0.0:1788876928.489911:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447488 00000100:00100000:0.0:1788876928.489983:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788876928.489994:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532447488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876928.490045:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876928.490105:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532447488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876928.490113:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00080000:3.0:1788876928.490392:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876928.490516:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532447488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876929.321092:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876930.347761:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876931.371314:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788876931.561716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876931.561722:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876931.561726:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876931.561733:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1914 00000100:00080000:3.0:1788876931.561738:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876931.561744:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876931.561764:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39180 x1875771532447744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876931.561779:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876931.561783:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876931.561784:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876931.561786:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1914 00000100:00080000:3.0:1788876931.561789:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876931.561791:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876931.561812:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3bb80 x1875771532447872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876931.561827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876931.561830:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876931.561831:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876931.561835:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1914 00000100:00080000:3.0:1788876931.561837:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876931.561840:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876931.561848:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39f80 x1875771532448128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788876931.561874:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788876931.561877:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788876931.561878:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876931.561881:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1914 00000100:00080000:3.0:1788876931.561883:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788876931.561886:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876931.561896:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4037800 x1875771532448512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876931.561925:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532448000:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.561982:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562031:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788876931.562038:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532447616:0@lo:400:kworker.0 00000400:00000100:3.0:1788876931.562055:0:3665:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532447616 offset 0 length 224: 4 00000100:00100000:3.0:1788876931.562070:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562090:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562113:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532447744:0@lo:38:kworker.0 00000100:00100000:3.0:1788876931.562134:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562148:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532447872:0@lo:38:kworker.0 00000100:00100000:3.0:1788876931.562165:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562192:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532448128:0@lo:38:kworker.0 00000100:00100000:3.0:1788876931.562211:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562224:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532448512:0@lo:38:kworker.0 00000100:00100000:3.0:1788876931.562241:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562264:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532448384:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562285:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562302:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876931.562306:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532448256:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562324:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876931.562351:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448000 00000100:00100000:3.0:1788876931.562357:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448000 00000100:00100000:3.0:1788876931.562403:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448384 00000100:00100000:3.0:1788876931.562406:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448384 00000100:00100000:3.0:1788876931.562428:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788876931.562437:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532448000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562483:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532448000:12345-0@lo:400:kworker.0 Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876931.562490:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788876931.562505:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788876931.562511:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532448384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562539:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532448384:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876931.562545:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788876931.562561:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448640 00000100:00100000:3.0:1788876931.562564:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448640 00000100:00100000:3.0:1788876931.562588:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447872 00000100:00100000:3.0:1788876931.562591:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447872 00000100:00100000:3.0:1788876931.562618:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448128 00000100:00100000:3.0:1788876931.562622:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448128 00000100:00100000:3.0:1788876931.562631:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448512 00000100:00100000:3.0:1788876931.562633:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448512 00000100:00100000:3.0:1788876931.562639:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448256 00000100:00100000:3.0:1788876931.562641:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448256 00000100:00100000:3.0:1788876931.562652:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:3.0:1788876931.562657:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532448640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562686:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532448640:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876931.562692:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:3.0:1788876931.562704:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:3.0:1788876931.562710:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532448256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.562736:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532448256:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876931.562742:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:3.0:1788876931.562753:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:3.0:1788876931.562756:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532447872:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876931.562771:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876931.562802:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532447872:12345-0@lo:38:kworker.0 Request processed in 44us (636us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876931.562808:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:3.0:1788876931.562819:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1788876931.562823:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532448128:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876931.562831:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876931.562853:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532448128:12345-0@lo:38:kworker.0 Request processed in 28us (641us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876931.562861:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1788876931.562871:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1788876931.562876:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532448512:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876931.562884:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876931.562905:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532448512:12345-0@lo:38:kworker.0 Request processed in 28us (663us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876931.562911:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:3.0:1788876931.562929:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532447744 00000100:00100000:3.0:1788876931.562933:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532447744 00000100:00100000:3.0:1788876931.562951:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788876931.562955:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532447744:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876931.562963:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876931.562985:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532447744:12345-0@lo:38:kworker.0 Request processed in 29us (850us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876931.562990:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00080000:3.0:1788876931.563022:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876931.563026:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876931.563028:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876931.563066:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532448256:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.563077:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532448384:0@lo:400:kworker.0 00000100:00080000:3.0:1788876931.563104:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876931.563108:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876931.563111:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532447744:0@lo:38:kworker.0 00000100:00080000:3.0:1788876931.563117:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876931.563120:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876931.563123:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532447872:0@lo:38:kworker.0 00000100:00080000:3.0:1788876931.563130:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876931.563132:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876931.563136:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532448128:0@lo:38:kworker.0 00000100:00080000:3.0:1788876931.563142:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876931.563145:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876931.563147:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532448512:0@lo:38:kworker.0 00000100:00100000:3.0:1788876931.563172:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788876931.563196:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532448000:0@lo:400:kworker.0 00000100:00100000:1.0:1788876931.764218:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876931.764258:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:1.0:1788876931.764281:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511296768 offset 0 length 224: 4 00000100:00100000:1.0:1788876931.764297:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876931.764325:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876931.764355:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297024 00000100:00100000:1.0:1788876931.764364:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297024 00000100:00100000:1.0:1788876931.764415:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511296896 00000100:00100000:1.0:1788876931.764418:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511296896 00000100:00100000:1.0:1788876931.764436:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1878 00000100:00100000:1.0:1788876931.764445:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511297024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876931.764507:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511297024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876931.764514:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1878 00000100:00100000:1.0:1788876931.764531:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2668 00000100:00100000:1.0:1788876931.764536:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511296896:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876931.764554:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876931.764579:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511296896:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 41us (253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876931.764585:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2668 00000100:00100000:1.0:1788876931.764619:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297280 00000100:00100000:1.0:1788876931.764623:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297280 00000100:00100000:1.0:1788876931.764647:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297152 00000100:00100000:1.0:1788876931.764650:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297152 00000100:00100000:1.0:1788876931.764668:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1431 00000100:00100000:1.0:1788876931.764674:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511297280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876931.764697:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511297280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876931.764704:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1431 00000100:00100000:1.0:1788876931.764715:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1432 00000100:00100000:1.0:1788876931.764721:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511297152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876931.764747:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511297152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876931.764753:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1432 00000100:00080000:1.0:1788876931.764770:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876931.764774:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876931.764776:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788876932.395119:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876932.586770:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532448768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876932.586899:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876932.587096:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448768 00000100:00100000:3.0:1788876932.587109:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448768 00000100:00100000:3.0:1788876932.587192:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1788876932.587207:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532448768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876932.587247:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876932.587320:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532448768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876932.587332:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788876932.587445:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532448768:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788876933.420810:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876933.619859:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876933.619882:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532448896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876933.619952:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876933.620750:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532448896 00000100:00100000:1.0:1788876933.620760:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532448896 00000100:00100000:1.0:1788876933.620942:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1788876933.620953:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532448896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876933.620981:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876933.621034:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532448896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876933.621042:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00080000:3.0:1788876933.621119:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876933.623780:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532448896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788876934.443745:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876935.464835:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876936.490258:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876936.685679:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532449024:0@lo:400:kworker.0 00000400:00000100:3.0:1788876936.685731:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532449024 offset 0 length 224: 4 00000100:00080000:2.0:1788876936.686697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876936.686703:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876936.686706:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876936.686712:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1919 00000100:00080000:2.0:1788876936.686717:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788876936.686724:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876936.686752:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd05180 x1875771532449152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876936.686768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876936.686771:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876936.686773:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876936.686776:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1919 00000100:00080000:2.0:1788876936.686779:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788876936.686783:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876936.686794:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa714380 x1875771532449280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876936.686820:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876936.686823:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876936.686825:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876936.686828:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1919 00000100:00080000:2.0:1788876936.686831:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788876936.686834:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876936.686847:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad74380 x1875771532449536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876936.686924:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532449152:0@lo:38:kworker.0 00000100:00100000:3.0:1788876936.686970:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.687006:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532449280:0@lo:38:kworker.0 00000100:00100000:3.0:1788876936.687512:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.687537:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532449536:0@lo:38:kworker.0 00000100:00100000:3.0:1788876936.687562:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.687597:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449280 00000100:00100000:3.0:1788876936.687621:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449280 00000100:00100000:3.0:1788876936.687650:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449536 00000100:00100000:3.0:1788876936.687652:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449536 00000100:00100000:3.0:1788876936.687667:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:3.0:1788876936.687674:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449280:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876936.687692:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876936.687728:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449280:12345-0@lo:38:kworker.0 Request processed in 54us (695us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876936.687735:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:3.0:1788876936.687750:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1788876936.687755:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876936.687764:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876936.687786:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449536:12345-0@lo:38:kworker.0 Request processed in 30us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876936.687792:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00080000:3.0:1788876936.687830:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876936.687834:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876936.687837:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532449280:0@lo:38:kworker.0 00000100:00080000:3.0:1788876936.687849:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876936.687851:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876936.687854:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532449536:0@lo:38:kworker.0 00000100:00100000:1.0:1788876936.692805:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532449792:0@lo:400:kworker.0 00000100:00100000:1.0:1788876936.692885:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.694573:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449792 00000100:00100000:3.0:1788876936.694586:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449792 00000100:00100000:3.0:1788876936.694674:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788876936.694685:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532449792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876936.694763:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532449792:12345-0@lo:400:kworker.0 Request processed in 80us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876936.694770:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00080000:1.0:1788876936.696585:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876936.696658:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532449792:0@lo:400:kworker.0 00000100:00100000:3.0:1788876936.696846:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532449664:0@lo:400:kworker.0 00000100:00100000:3.0:1788876936.696917:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.696960:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876936.696968:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532449408:0@lo:400:kworker.0 00000100:00100000:3.0:1788876936.697004:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876936.697048:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449408 00000100:00100000:3.0:1788876936.697054:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449408 00000100:00100000:3.0:1788876936.697104:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1788876936.697113:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532449408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876936.697173:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532449408:12345-0@lo:400:kworker.0 Request processed in 61us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876936.697180:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1788876936.697217:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532449408:0@lo:400:kworker.0 00000100:00100000:1.0:1788876936.697499:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449664 00000100:00100000:1.0:1788876936.697504:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449664 00000100:00100000:1.0:1788876936.697544:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:1.0:1788876936.697552:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532449664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876936.697593:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532449664:12345-0@lo:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876936.697598:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00080000:1.0:1788876936.697640:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876936.697644:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876936.697660:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532449664:0@lo:400:kworker.0 00000100:00080000:2.0:1788876936.698215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876936.698221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876936.698224:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876936.698229:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1919 00000100:00080000:2.0:1788876936.698234:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788876936.698238:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876936.698275:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449152 00000100:00100000:2.0:1788876936.698279:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449152 00000100:00100000:2.0:1788876936.698307:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1788876936.698324:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532449152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876936.698343:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876936.698394:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532449152:12345-0@lo:38:kworker.0 Request processed in 80us (11423us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876936.698404:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00080000:2.0:1788876936.698438:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876936.698443:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876936.698446:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532449152:0@lo:38:kworker.0 00000100:00100000:2.0:1788876936.698487:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13d12f2d80 x1875771532449920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876936.698513:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532449920:0@lo:38:kworker.0 00000100:00100000:2.0:1788876936.698545:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876936.698574:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532449920 00000100:00100000:2.0:1788876936.698578:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532449920 00000100:00100000:2.0:1788876936.698598:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:2.0:1788876936.698636:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449920:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788876936.698647:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876936.698678:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532449920:12345-0@lo:38:kworker.0 Request processed in 41us (132us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788876936.698684:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00080000:2.0:1788876936.698709:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876936.698712:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876936.698715:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532449920:0@lo:38:kworker.0 00000100:00100000:2.0:1788876936.698748:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532450048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876936.698772:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876936.698799:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450048 00000100:00100000:2.0:1788876936.698803:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450048 00000100:00100000:2.0:1788876936.698835:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1788876936.698841:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532450048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876936.698893:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532450048:12345-0@lo:400:kworker.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876936.698900:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1788876936.698929:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d12f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532450048:0@lo:400:kworker.0 00000100:00080000:1.0:1788876936.699332:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1788876936.880322:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511297408 offset 0 length 520: 4 00000100:00100000:2.0:1788876936.880364:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876936.880411:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876936.881056:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297536 00000100:00100000:0.0:1788876936.881067:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297536 00000100:00100000:0.0:1788876936.881107:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297664 00000100:00100000:0.0:1788876936.881110:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297664 00000100:00100000:0.0:1788876936.881168:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1881 00000100:00100000:0.0:1788876936.881178:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511297664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876936.881256:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511297664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876936.881263:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1881 00000100:00100000:0.0:1788876936.881281:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2672 00000100:00100000:0.0:1788876936.881286:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511297536:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788876936.881305:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876936.881336:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511297536:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 49us (972us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876936.881342:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2672 00000100:00080000:1.0:1788876936.881495:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876936.884256:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876936.884298:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876936.884383:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297792 00000100:00100000:0.0:1788876936.884392:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297792 00000100:00100000:0.0:1788876936.884454:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511297920 00000100:00100000:0.0:1788876936.884457:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511297920 00000100:00100000:0.0:1788876936.884478:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1435 00000100:00100000:0.0:1788876936.884487:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511297792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876936.884547:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511297792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876936.884554:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1435 00000100:00100000:0.0:1788876936.884567:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1436 00000100:00100000:0.0:1788876936.884574:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511297920:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876936.884594:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511297920:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876936.884628:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1436 00000100:00080000:2.0:1788876936.884768:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876936.884773:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788876937.520561:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788876937.705063:0:3662:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876921/real 1788876921] req@ffff8a13eb25aa00 x1875771532444544/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876937 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876937.705110:0:3662:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13eb25aa00 x1875771532444544/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788876937.705121:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788876937.705124:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788876937.705129:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788876937.705132:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788876937.705136:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13eb25aa00 x1875771532444544/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788876937 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876937.705157:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fae32d80 x1875771532446208/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876942 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876937.705167:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fad39500 x1875771532447616/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876947 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876937.705177:0:3662:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13cfd7fb80 x1875771532449024/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788876952 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788876937.705197:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788876937.705201:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788876937.705203:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788876937.705206:0:3662:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1788876937.705242:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532444544:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.705298:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532449024:0@lo:400:kworker.0 00000100:00080000:1.0:1788876937.705344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876937.705350:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788876937.705353:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876937.705358:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1862 00000100:00080000:1.0:1788876937.705369:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876937.705409:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd7fb80 x1875771532450176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876937.705434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876937.705438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876937.705439:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876937.705444:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1924 00000100:00080000:1.0:1788876937.705447:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876937.705451:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876937.705469:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb25aa00 x1875771532450304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876937.705479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876937.705482:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876937.705484:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876937.705487:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1924 00000100:00080000:1.0:1788876937.705490:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876937.705493:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876937.705505:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978a80 x1875771532450432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876937.705533:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876937.705537:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876937.705538:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876937.705542:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1924 00000100:00080000:1.0:1788876937.705544:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876937.705548:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876937.705558:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978000 x1875771532450688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876937.705584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876937.705587:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876937.705589:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876937.705593:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1924 00000100:00080000:1.0:1788876937.705595:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876937.705622:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876937.705634:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979c00 x1875771532451072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876937.705672:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532450176:0@lo:250:kworker.0 00000400:00000100:1.0:1788876937.706105:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532450176 offset 0 length 520: 4 00000100:00100000:1.0:1788876937.706161:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532450304:0@lo:38:kworker.0 00000100:00100000:1.0:1788876937.706201:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706230:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532450432:0@lo:38:kworker.0 00000100:00100000:1.0:1788876937.706258:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706277:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532450688:0@lo:38:kworker.0 00000100:00100000:1.0:1788876937.706299:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706316:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532451072:0@lo:38:kworker.0 00000100:00100000:1.0:1788876937.706340:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706379:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532450560:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.706408:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706428:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876937.706433:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532450816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.706456:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.706491:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450304 00000100:00100000:1.0:1788876937.706500:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450304 00000100:00100000:1.0:1788876937.706547:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1788876937.706556:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532450304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876937.706581:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876937.706656:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532450304:12345-0@lo:38:kworker.0 Request processed in 99us (454us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876937.706664:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1788876937.706832:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532447616:0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.706844:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532446208:0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.706894:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450560 00000100:00100000:2.0:1788876937.706899:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450560 00000100:00100000:2.0:1788876937.706939:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1788876937.706946:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.707010:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532450560:12345-0@lo:400:kworker.0 Request processed in 64us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876937.707017:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1788876937.707075:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876937.707081:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532451328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876937.707112:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876937.707155:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451328 00000100:00100000:2.0:1788876937.707160:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451328 00000100:00100000:2.0:1788876937.707192:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1788876937.707199:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532451328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876937.707224:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876937.707263:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532451328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876937.707269:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1788876937.707309:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532450560:0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.707342:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532451328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876937.709191:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450432 00000100:00100000:1.0:1788876937.709206:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450432 00000100:00100000:1.0:1788876937.709241:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450688 00000100:00100000:1.0:1788876937.709244:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450688 00000100:00100000:1.0:1788876937.709266:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451072 00000100:00100000:1.0:1788876937.709270:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451072 00000100:00100000:1.0:1788876937.709278:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450816 00000100:00100000:1.0:1788876937.709280:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450816 00000100:00100000:1.0:1788876937.709308:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1788876937.709318:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532450816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.709410:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532450816:12345-0@lo:400:kworker.0 Request processed in 94us (2952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876937.709418:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1788876937.709436:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:1.0:1788876937.709441:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532450432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876937.709460:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876937.709492:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532450432:12345-0@lo:38:kworker.0 Request processed in 50us (3233us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876937.709499:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:1.0:1788876937.709510:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1788876937.709513:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532450688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876937.709522:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876937.709548:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532450688:12345-0@lo:38:kworker.0 Request processed in 33us (3248us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876937.709553:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:1.0:1788876937.709562:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1788876937.709566:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532451072:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876937.709574:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876937.709593:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb29ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532451072:12345-0@lo:38:kworker.0 Request processed in 26us (3253us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876937.709598:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:1.0:1788876937.709659:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.712016:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532450816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.712289:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.712344:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876937.712356:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532450944:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.712390:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876937.712431:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532450944 00000100:00100000:1.0:1788876937.712439:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532450944 00000100:00100000:2.0:1788876937.713834:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451200 00000100:00100000:2.0:1788876937.713851:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451200 00000100:00100000:2.0:1788876937.713937:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1788876937.713948:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532451200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876937.714188:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532451200:12345-0@lo:400:kworker.0 Request processed in 241us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876937.714197:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1788876937.714266:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532451200:0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.714472:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1788876937.714484:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532450944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876937.714531:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532450944:12345-0@lo:400:kworker.0 Request processed in 51us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876937.714538:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:1.0:1788876937.714591:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876937.714597:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876937.714620:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532450304:0@lo:38:kworker.0 00000100:00080000:1.0:1788876937.714634:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876937.714638:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876937.714641:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532450432:0@lo:38:kworker.0 00000100:00080000:1.0:1788876937.714654:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876937.714657:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876937.714660:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532450688:0@lo:38:kworker.0 00000100:00100000:2.0:1788876937.715973:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532450944:0@lo:400:kworker.0 00000100:00080000:1.0:1788876937.716293:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876937.716302:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876937.716306:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532451072:0@lo:38:kworker.0 00010000:00010000:0.0:1788876938.536829:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876938.734425:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876938.734451:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532451456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876938.734527:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876938.734658:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451456 00000100:00100000:3.0:1788876938.734672:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451456 00000100:00100000:3.0:1788876938.735069:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1788876938.735092:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532451456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876938.735156:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876938.735394:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532451456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 310us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876938.735408:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1788876938.736154:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532451456:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788876938.741402:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788876939.563301:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876940.588785:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876941.608895:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876941.998534:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876941.998573:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876941.998644:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876941.998673:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298304 00000100:00100000:1.0:1788876941.998682:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298304 00000100:00100000:1.0:1788876941.998736:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298432 00000100:00100000:1.0:1788876941.998739:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298432 00000100:00100000:3.0:1788876941.998750:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1439 00000100:00100000:3.0:1788876941.998761:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511298304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876941.998795:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298176 00000100:00100000:2.0:1788876941.998800:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298176 00000100:00100000:3.0:1788876941.998828:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511298304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876941.998829:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1884 00000100:00100000:2.0:1788876941.998836:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511298176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876941.998869:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511298176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876941.998876:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1884 00000100:00080000:2.0:1788876942.000828:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876942.000837:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876942.000840:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876942.004790:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1440 00000100:00100000:1.0:1788876942.004808:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511298432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876942.004890:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511298432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 89us (6245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876942.004899:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1440 00000020:01000004:0.0:1788876942.009533:0:53032:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788876942.009538:0:53032:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788876942.009540:0:53032:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788876942.015179:0:53032:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a13f43d5000 00000020:01000004:2.0:1788876942.015214:0:53032:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788876942.015230:0:53032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788876942.015249:0:53032:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c5e3cd40) 00000020:00000080:2.0:1788876942.015266:0:53032:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1788876942.015492:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1439 00000100:00100000:3.0:1788876942.015597:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876942.016557:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298048 00000100:00100000:3.0:1788876942.016567:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298048 00000100:00100000:3.0:1788876942.016617:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2676 00000100:00100000:3.0:1788876942.016625:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511298048:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788876942.016645:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876942.016704:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511298048:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 78us (1106us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876942.016711:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2676 00100000:10000000:2.0:1788876942.151996:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788876942.161968:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788876942.167226:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788876942.167910:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788876942.168326:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788876942.168631:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788876942.169014:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.169288:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.170055:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788876942.170410:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.170711:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788876942.171061:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.171356:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.171591:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.173091:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788876942.173719:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.173974:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.174232:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.174529:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.174754:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.174969:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.175168:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.175427:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.175673:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.176304:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.176564:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.176864:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.178219:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.178485:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.178706:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.179372:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.179874:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.180135:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.180756:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.181021:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.181321:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.181759:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788876942.182308:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.182831:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.183288:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788876942.183492:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788876942.188997:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788876942.189477:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788876942.189774:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788876942.190285:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788876942.190765:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788876942.191057:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788876942.197157:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876942.200813:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788876942.201514:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788876942.204338:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788876942.205322:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788876942.205753:0:53032:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788876942.208490:0:53032:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788876942.208760:0:53032:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788876942.208769:0:53032:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788876942.208780:0:53032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aff5e 00000020:01000004:3.0:1788876942.208788:0:53032:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788876942.208799:0:53032:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788876942.208804:0:53032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13f43d5000 from MGS 00000020:01000004:3.0:1788876942.208808:0:53032:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788876942.208818:0:53032:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c3f619c0) 00000020:00000080:3.0:1788876942.208828:0:53032:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788876942.208904:0:53032:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13f43d5000 from MGS, refs=2 00080000:01000000:3.0:1788876942.208910:0:53032:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788876942.208915:0:53032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313aff6c 00010000:00010000:3.0:1788876942.209039:0:53032:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1788876942.220823:0:53032:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788876942.223383:0:53036:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788876942.223437:0:53032:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788876942.223489:0:53032:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788876942.224254:0:53032:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788876942.224496:0:53032:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788876942.225066:0:53032:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788876942.225073:0:53032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788876942.227204:0:53032:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788876942.227216:0:53032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788876942.235239:0:53032:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788876942.235254:0:53032:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788876942.235765:0:53032:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788876942.235787:0:53032:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1788876942.235789:0:53032:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1788876942.235792:0:53032:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1788876942.235798:0:53032:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 45, was 0): CONNECTING 00000100:00100000:1.0:1788876942.235803:0:53032:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:1.0:1788876942.632995:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788876942.824885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876942.824892:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788876942.824895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1788876942.824896:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532451584:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876942.824898:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876942.824902:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876942.824908:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1925 00000100:00080000:2.0:1788876942.824912:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876942.824917:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876942.824939:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979c00 x1875771532451712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876942.824950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876942.824953:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876942.824955:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876942.824958:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1925 00000100:00080000:2.0:1788876942.824960:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876942.824963:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876942.824973:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978000 x1875771532451840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876942.824989:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876942.824992:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876942.824993:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876942.824997:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1925 00000100:00080000:2.0:1788876942.824999:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876942.825002:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876942.825012:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978e00 x1875771532452096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876942.825035:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876942.825040:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876942.825043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876942.825045:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876942.825048:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1925 00000100:00080000:2.0:1788876942.825050:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788876942.825053:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876942.825062:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979180 x1875771532452480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876942.825092:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532452224:0@lo:400:kworker.0 00000100:00100000:1.0:1788876942.825093:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532452608:0@lo:400:kworker.0 00000100:00100000:1.0:1788876942.825119:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876942.825138:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788876942.825161:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876942.825191:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876942.825197:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788876942.825204:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451584 00000100:00100000:2.0:1788876942.825211:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451584 00000100:00100000:1.0:1788876942.825219:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876942.825246:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452352 00000100:00100000:1.0:1788876942.825250:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452352 00000100:00100000:1.0:1788876942.825271:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451968 00000100:00100000:1.0:1788876942.825273:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451968 00000100:00100000:2.0:1788876942.825275:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1788876942.825284:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532451584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876942.825290:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788876942.825296:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532452352:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788876942.825314:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876942.825335:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532452352:12345-0@lo:400:kworker.0 Request processed in 39us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876942.825342:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1788876942.825344:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532451584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876942.825349:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788876942.825355:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788876942.825361:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532451968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876942.825368:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452608 00000100:00100000:2.0:1788876942.825371:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452608 00000100:00100000:1.0:1788876942.825387:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532451968:12345-0@lo:400:kworker.0 Request processed in 27us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876942.825393:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:2.0:1788876942.825396:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:2.0:1788876942.825402:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876942.825431:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532452608:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876942.825435:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788876942.825437:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:1.0:1788876942.825445:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eef62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532452608:0@lo:400:kworker.0 00000100:00080000:2.0:1788876942.825453:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876942.825457:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788876942.825459:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532451584:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876942.825459:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876942.825473:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876942.825492:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452224 00000100:00100000:1.0:1788876942.825496:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452224 00000100:00100000:2.0:1788876942.825505:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532452352:0@lo:400:kworker.0 00000100:00100000:1.0:1788876942.825523:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00080000:2.0:1788876942.825523:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876942.825530:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532452224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876942.825663:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532451712:0@lo:38:kworker.0 00000100:00100000:0.0:1788876942.825703:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876942.825731:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532451840:0@lo:38:kworker.0 00000100:00100000:0.0:1788876942.825751:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876942.825766:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532452096:0@lo:38:kworker.0 00000100:00100000:0.0:1788876942.825788:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876942.825802:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532452480:0@lo:38:kworker.0 00000100:00100000:0.0:1788876942.825823:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876942.825856:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451712 00000100:00100000:0.0:1788876942.825860:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451712 00000100:00100000:0.0:1788876942.825882:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1788876942.825887:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532451712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788876942.825902:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876942.825934:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532451712:12345-0@lo:38:kworker.0 Request processed in 46us (230us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876942.825940:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788876942.826100:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532452224:12345-0@lo:400:kworker.0 Request processed in 570us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876942.826107:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1788876942.836846:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532452224:0@lo:400:kworker.0 00000100:00100000:3.0:1788876942.838432:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532451840 00000100:00100000:3.0:1788876942.838460:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532451840 00000100:00100000:3.0:1788876942.838522:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452096 00000100:00100000:3.0:1788876942.838525:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452096 00000100:00100000:3.0:1788876942.838542:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452480 00000100:00100000:3.0:1788876942.838545:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452480 00000100:00100000:3.0:1788876942.838559:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788876942.838566:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532451840:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876942.838590:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876942.838681:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532451840:12345-0@lo:38:kworker.0 Request processed in 114us (12927us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876942.838689:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00100000:3.0:1788876942.838706:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1788876942.838710:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532452096:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876942.838720:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876942.838745:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532452096:12345-0@lo:38:kworker.0 Request processed in 33us (12960us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876942.838751:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1788876942.838762:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1788876942.838766:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532452480:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876942.838774:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876942.838795:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532452480:12345-0@lo:38:kworker.0 Request processed in 28us (12971us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876942.838800:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00080000:3.0:1788876942.839131:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876942.839137:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876942.839141:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532451712:0@lo:38:kworker.0 00000100:00080000:3.0:1788876942.839157:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876942.839160:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876942.839163:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532451840:0@lo:38:kworker.0 00000100:00080000:3.0:1788876942.839173:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876942.839176:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876942.839179:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532452096:0@lo:38:kworker.0 00000100:00080000:3.0:1788876942.839186:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876942.839190:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876942.839193:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532452480:0@lo:38:kworker.0 00010000:00010000:3.0:1788876943.656729:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876943.849224:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876943.849247:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532452736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876943.849353:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876943.849526:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452736 00000100:00100000:3.0:1788876943.849536:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452736 00000100:00100000:3.0:1788876943.849625:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1788876943.849636:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532452736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876943.849676:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876943.849743:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532452736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876943.849751:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788876943.850112:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532452736:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788876944.680820:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876945.712204:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876946.107305:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876946.107498:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298560 00000100:00100000:3.0:1788876946.107512:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298560 00000100:00100000:3.0:1788876946.107666:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2680 00000100:00100000:3.0:1788876946.107679:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511298560:12345-192.168.203.11@tcp:17:kworker.0 00000100:00080000:2.0:1788876946.107695:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876946.107813:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511298560:12345-192.168.203.11@tcp:17:kworker.0 Request processed in 136us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876946.107834:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2680 00010000:00010000:3.0:1788876946.729877:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876947.120078:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876947.120136:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876947.120175:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876947.120219:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876947.120253:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298944 00000100:00100000:3.0:1788876947.120263:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298944 00000100:00080000:2.0:1788876947.120292:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876947.120307:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298688 00000100:00100000:3.0:1788876947.120314:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299072 00000100:00100000:2.0:1788876947.120316:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298688 00000100:00100000:3.0:1788876947.120316:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299072 00000100:00100000:2.0:1788876947.120337:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511298816 00000100:00100000:2.0:1788876947.120339:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511298816 00000100:00100000:3.0:1788876947.120339:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1443 00000100:00100000:3.0:1788876947.120348:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511298944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876947.120361:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1887 00000100:00100000:2.0:1788876947.120368:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511298816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876947.120414:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511298944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876947.120421:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1443 00000100:00100000:3.0:1788876947.120438:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1444 00000100:00100000:3.0:1788876947.120445:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511299072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876947.120515:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2681 00000100:00100000:1.0:1788876947.120521:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511298688:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788876947.120542:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788876947.124028:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511298816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3645us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.124044:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1887 00000100:00080000:2.0:1788876947.124094:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876947.130164:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511299072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 9708us (9932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876947.130179:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1444 00000100:00100000:2.0:1788876947.132373:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876947.134786:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299200 00000100:00100000:3.0:1788876947.134802:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299200 00000100:00100000:3.0:1788876947.134864:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1788876947.134873:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1875771511299200:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:3.0:1788876947.134902:0:53037:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 1935 last 0 00000020:00000080:3.0:1788876947.134933:0:53037:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313aff73 00000100:00100000:1.0:1788876947.135070:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511298688:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 14547us (14933us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788876947.135077:0:53037:0:(import.c:65:import_set_state_nolock()) ffff8a13c3003000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876947.135081:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2681 00000100:00100000:3.0:1788876947.135125:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511299200:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 253us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876947.135133:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00010000:00010000:2.0:1788876947.752841:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788876947.944813:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.944824:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788876947.944827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.944832:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876947.944836:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876947.944844:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1930 00000100:00080000:0.0:1788876947.944849:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876947.944858:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876947.944901:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c365b100 x1875771532452864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876947.944918:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.944922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876947.944924:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876947.944927:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1930 00000100:00080000:0.0:1788876947.944929:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876947.944932:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876947.944943:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3658000 x1875771532452992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876947.944979:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.944982:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876947.944984:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876947.944987:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1930 00000100:00080000:0.0:1788876947.944989:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876947.944992:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876947.945003:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99880 x1875771532453248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876947.945030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.945033:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876947.945034:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876947.945037:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1930 00000100:00080000:0.0:1788876947.945040:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788876947.945043:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876947.945052:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f452f800 x1875771532453632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876947.945133:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532453120:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945202:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876947.945273:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876947.945280:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532453376:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945307:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876947.945345:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532453760:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945369:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876947.945392:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876947.945397:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945417:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876947.945445:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453376 00000100:00100000:2.0:1788876947.945451:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453376 00000100:00100000:2.0:1788876947.945507:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453760 00000100:00100000:2.0:1788876947.945510:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453760 00000100:00100000:2.0:1788876947.945533:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1788876947.945540:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532453376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945585:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532453376:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.945591:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1788876947.945624:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:2.0:1788876947.945630:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532453760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945658:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532453760:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.945663:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:2.0:1788876947.945680:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453120 00000100:00100000:2.0:1788876947.945683:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453120 00000100:00100000:2.0:1788876947.945705:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453504 00000100:00100000:2.0:1788876947.945707:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453504 00000100:00100000:2.0:1788876947.945723:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788876947.945729:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532453120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945757:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532453120:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.945763:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1788876947.945774:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788876947.945779:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945805:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532453504:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.945811:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00080000:2.0:1788876947.945826:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876947.945829:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876947.945832:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876947.945866:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945874:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532453760:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945897:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532453376:0@lo:400:kworker.0 00000100:00100000:2.0:1788876947.945904:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532453120:0@lo:400:kworker.0 00000100:00100000:1.0:1788876947.946175:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876937/real 1788876937] req@ffff8a13cfd7fb80 x1875771532450176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876947 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876947.946191:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13cfd7fb80 x1875771532450176/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788876947 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876947.946204:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532452864:0@lo:38:kworker.0 00000100:00100000:1.0:1788876947.946229:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876947.946258:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532452992:0@lo:38:kworker.0 00000100:00100000:1.0:1788876947.946279:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876947.946294:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532453248:0@lo:38:kworker.0 00000100:00100000:1.0:1788876947.946313:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876947.946330:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532453632:0@lo:38:kworker.0 00000100:00100000:1.0:1788876947.946351:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788876947.946365:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.946377:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788876947.946384:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532450176:0@lo:250:kworker.0 00000100:00100000:1.0:1788876947.946417:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452992 00000100:00100000:1.0:1788876947.946421:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452992 00000100:00100000:1.0:1788876947.946437:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453248 00000100:00100000:1.0:1788876947.946439:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453248 00000100:00100000:1.0:1788876947.946446:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532453632 00000100:00100000:1.0:1788876947.946448:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532453632 00000100:00100000:1.0:1788876947.946458:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1788876947.946462:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532452992:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876947.946480:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876947.946524:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532452992:12345-0@lo:38:kworker.0 Request processed in 59us (243us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876947.946530:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1788876947.946541:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788876947.946544:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532453248:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876947.946553:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876947.946575:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532453248:12345-0@lo:38:kworker.0 Request processed in 29us (261us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876947.946580:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1788876947.946590:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1788876947.946594:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532453632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876947.946621:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876947.946643:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532453632:12345-0@lo:38:kworker.0 Request processed in 47us (291us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876947.946648:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00080000:1.0:1788876947.946669:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.946673:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876947.946676:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532452992:0@lo:38:kworker.0 00000100:00080000:1.0:1788876947.946682:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.946684:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876947.946687:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532453248:0@lo:38:kworker.0 00000100:00080000:1.0:1788876947.946694:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.946697:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876947.946699:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532453632:0@lo:38:kworker.0 00000100:00080000:1.0:1788876947.946720:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876947.946724:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788876947.946727:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876947.946730:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1925 00000100:00080000:1.0:1788876947.946734:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788876947.946739:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876947.946756:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7979880 x1875771532453888/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:1.0:1788876947.946782:0:3661:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a13e7979880 x1875771532453888/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876947.948269:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532452864 00000100:00100000:3.0:1788876947.948279:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532452864 00000100:00100000:3.0:1788876947.948317:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1788876947.948325:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532452864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876947.948344:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876947.948405:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532452864:12345-0@lo:38:kworker.0 Request processed in 79us (2173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876947.948411:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 10000000:01000000:3.0:1788876947.948498:0:53032:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1788876947.948515:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948526:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948532:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788876947.948542:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948551:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72000/0xf5bf0f7e313afc08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afc0f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948570:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948576:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948585:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948588:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948592:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72200/0xf5bf0f7e313afb7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afb83 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948651:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948659:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948664:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948685:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948689:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313afb8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afb91 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948698:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948704:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948709:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948713:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948715:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313afba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbad expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948724:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948734:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948739:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948743:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948745:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313afbb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbbb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948753:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948759:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948764:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948767:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948770:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72e00/0xf5bf0f7e313afbd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbd7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948779:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948785:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948790:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948793:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948796:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220e00/0xf5bf0f7e313afbec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbf3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948811:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948817:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948822:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948825:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948828:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73400/0xf5bf0f7e313afc24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afc2b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948839:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948845:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948849:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948852:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948855:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220800/0xf5bf0f7e313afbde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbe5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948865:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948870:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948875:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:3.0:1788876947.948878:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948881:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73e00/0xf5bf0f7e313afbfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afc01 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948891:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948897:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948903:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788876947.948907:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948910:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960800/0xf5bf0f7e313afb98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afb9f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948918:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948924:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948929:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788876947.948931:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948934:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7960000/0xf5bf0f7e313afbc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afbc9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.948942:0:53032:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788876947.948947:0:53032:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876947.948955:0:53032:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788876947.948958:0:53032:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1788876947.948961:0:53032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7961000/0xf5bf0f7e313afc16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313afc1d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876947.950806:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788876947.950831:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532454016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876947.950895:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876947.950943:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454016 00000100:00100000:2.0:1788876947.950950:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454016 00000100:00100000:2.0:1788876947.950995:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788876947.951003:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532454016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876947.951038:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876947.951081:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532454016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876947.951088:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788876947.951148:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532454016:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788876947.981707:0:53032:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 46, was 0): CONNECTING 00000100:00080000:3.0:1788876947.981717:0:53032:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1788876947.983259:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.983282:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1788876947.983298:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:0:1875771532453888:0@lo:250:kworker.0 00000100:00080000:1.0:1788876947.983336:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788876947.983340:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788876947.983343:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532452864:0@lo:38:kworker.0 00000100:00080000:0.0:1788876947.983449:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876947.983454:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788876947.983457:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876947.983462:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1935 00000100:00080000:0.0:1788876947.983466:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788876947.983473:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876947.983521:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f452f800 x1875771532454144/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876947.983651:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532454144:0@lo:250:kworker.0 00000100:00100000:1.0:1788876947.983709:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876947.983804:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454144 00000100:00100000:0.0:1788876947.983820:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454144 00000100:00100000:0.0:1788876947.983860:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788876947.983867:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3661:x1875771532454144:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788876947.983890:0:53040:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 1935 last 0 00000020:00000080:0.0:1788876947.983915:0:53040:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313aff7a 00000100:00080000:0.0:1788876947.984044:0:53040:0:(import.c:65:import_set_state_nolock()) ffff8a13f43d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788876947.984090:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532454144:12345-0@lo:250:kworker.0 Request processed in 222us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876947.984108:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788876947.984283:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 21 00000100:00080000:1.0:1788876947.984291:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:1.0:1788876947.984298:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788876947.984302:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788876947.984306:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788876947.984308:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788876947.984329:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788876947.984334:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532454144:0@lo:250:kworker.0 00000020:01000000:0.0:1788876947.984416:0:36:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:0.0:1788876947.984431:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788876947.984434:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876947.984435:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788876947.984437:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876947.984438:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876947.984439:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876947.984441:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876947.984442:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788876947.984444:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876947.984446:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876947.984483:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788876947.984498:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788876947.984501:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876947.984502:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788876947.984503:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876947.984504:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876947.984505:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876947.984506:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876947.984508:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876947.984509:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876947.984510:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876947.984528:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788876947.984533:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788876947.984535:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788876947.984536:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788876947.984537:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876947.984538:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876947.984539:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876947.984540:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876947.984541:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876947.984543:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876947.984543:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788876947.984552:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1788876947.984577:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532454400:0@lo:253:kworker.0 00000100:00100000:0.0:1788876947.984636:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876947.984662:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876947.984667:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532454528:0@lo:253:kworker.0 00000100:00100000:0.0:1788876947.984696:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788876947.984698:0:53032:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1788876947.984711:0:53032:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1788876947.984717:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876947.984725:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532454272:0@lo:253:kworker.0 00000100:00100000:0.0:1788876947.984754:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788876947.984759:0:53032:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788876947.984765:0:53032:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:0.0:1788876947.984775:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454400 00000100:00100000:0.0:1788876947.984780:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454400 00000100:00100000:0.0:1788876947.984799:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454528 00000100:00100000:0.0:1788876947.984815:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454528 00000100:00100000:0.0:1788876947.984826:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454272 00000100:00100000:0.0:1788876947.984828:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454272 00000100:00100000:0.0:1788876947.984838:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788876947.984845:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532454400:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788876947.984865:0:53037:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000040:01000000:3.0:1788876947.984866:0:53032:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788876947.984892:0:53032:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788876947.984895:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788876947.984897:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876947.984898:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876947.984899:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876947.984900:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876947.984901:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876947.984903:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876947.984904:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876947.984905:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876947.984906:0:53032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788876947.984909:0:53032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788876947.984910:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788876947.984912:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788876947.984912:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788876947.984913:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788876947.984914:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788876947.984916:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788876947.984917:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788876947.984918:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788876947.984920:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788876947.984921:0:53032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788876947.984934:0:53032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788876947.984945:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788876947.984999:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876947.985013:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c72036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876947.985019:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454656 00000100:00100000:0.0:1788876947.985025:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454656 00000100:00100000:0.0:1788876947.985044:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788876947.985050:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3662:x1875771532454528:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788876947.985106:0:53040:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:3.0:1788876947.985385:0:53042:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788876947.985692:0:53037:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 83 20000000:01000000:2.0:1788876947.993661:0:53043:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788876947.993668:0:53043:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788876947.993671:0:53043:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788876947.993674:0:53043:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788876947.993920:0:53043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788876947.994197:0:53037:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788876947.994227:0:53037:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788876947.998461:0:53040:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788876947.998594:0:53037:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788876947.998793:0:53042:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788876947.998799:0:53042:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788876947.998832:0:53042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998849:0:53042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788876947.998858:0:53042:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000060885s 00010000:00010000:3.0:1788876947.998863:0:53042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998871:0:53042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998878:0:53042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998885:0:53042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998892:0:53042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876947.998896:0:53042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998904:0:53042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998920:0:53042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998928:0:53042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876947.998934:0:53042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313aff81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876947.999035:0:53037:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788876948.018643:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3662:x1875771532454400:12345-0@lo:253:kworker.0 Request processed in 33790us (33997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.018666:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788876948.018708:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788876948.018718:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3664:x1875771532454272:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788876948.018746:0:53037:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:0.0:1788876948.018838:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876948.018841:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788876948.018843:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876948.018844:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876948.018845:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876948.018847:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876948.018848:0:3662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876948.018850:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876948.018851:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876948.018855:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532454400:0@lo:253:kworker.0 20000000:01000000:2.0:1788876948.018950:0:53040:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788876948.018964:0:53040:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788876948.019071:0:53037:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788876948.019125:0:53042:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788876948.019129:0:53042:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788876948.019168:0:53042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019186:0:53042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788876948.019196:0:53042:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067096s 00010000:00010000:3.0:1788876948.019200:0:53042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019206:0:53042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019213:0:53042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019221:0:53042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019227:0:53042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876948.019232:0:53042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019239:0:53042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019251:0:53042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019269:0:53042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.019278:0:53042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313aff88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876948.020622:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532454528:12345-0@lo:253:kworker.0 Request processed in 35567us (35922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.020637:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788876948.020669:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788876948.020680:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:53032:x1875771532454656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788876948.020714:0:53040:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788876948.020716:0:53040:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788876948.020719:0:53040:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1788876948.020724:0:53040:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1788876948.020836:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788876948.020840:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788876948.020841:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788876948.020842:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788876948.020844:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788876948.020846:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788876948.020847:0:3662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788876948.020849:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788876948.020850:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788876948.020853:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532454528:0@lo:253:kworker.0 20000000:01000000:0.0:1788876948.023562:0:53037:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788876948.023617:0:53037:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788876948.025397:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:53032:x1875771532454656:12345-0@lo:253:mount.lustre.0 Request processed in 4712us (40390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.025411:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788876948.025471:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788876948.025487:0:53032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788876948.025491:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788876948.025492:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876948.025494:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876948.025496:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876948.025497:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876948.025498:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876948.025499:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876948.025501:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876948.025502:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876948.025503:0:53032:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788876948.025525:0:53032:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13f43d5000 from lustre-MDT0000 10000000:01000000:2.0:1788876948.025550:0:53032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788876948.025553:0:53032:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788876948.025561:0:53032:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a13f43d5000 10000000:01000000:2.0:1788876948.025565:0:53032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788876948.025570:0:53032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a13f43d5000 10000000:01000000:2.0:1788876948.025572:0:53032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788876948.025576:0:53032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13f43d5000 from 1 10000000:01000000:2.0:1788876948.025579:0:53032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788876948.025631:0:53032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025643:0:53032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025652:0:53032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876948.025672:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876948.025710:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.025740:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454784 00000100:00100000:2.0:1788876948.025745:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454784 00000100:00100000:2.0:1788876948.025772:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788876948.025779:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:53032:x1875771532454784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876948.025789:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876948.025800:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c200/0xf5bf0f7e313aff96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aff8f expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025822:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c200/0xf5bf0f7e313aff96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aff8f expref: 7 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025832:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c200/0xf5bf0f7e313aff96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aff8f expref: 7 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025841:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c200, rc 0) 00000100:00100000:2.0:1788876948.025864:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:53032:x1875771532454784:12345-0@lo:101:mount.lustre.0 Request processed in 85us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.025870:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788876948.025903:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.025914:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876948.025926:0:53032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025935:0:53032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876948.025947:0:53032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788876948.025957:0:53032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.025965:0:53032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876948.025972:0:53032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788876948.025984:0:53032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788876948.025987:0:53032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a13f43d5000 10000000:01000000:2.0:1788876948.025990:0:53032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788876948.025992:0:53032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788876948.025994:0:53032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788876948.026006:0:53032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.026017:0:53032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.026025:0:53032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876948.026035:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876948.026055:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.026069:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532454912 00000100:00100000:2.0:1788876948.026072:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532454912 00000100:00100000:2.0:1788876948.026085:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788876948.026091:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:53032:x1875771532454912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788876948.026108:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876948.026115:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8ce00/0xf5bf0f7e313affa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313aff9d expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.026127:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8ce00/0xf5bf0f7e313affa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313aff9d expref: 8 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.026134:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8ce00/0xf5bf0f7e313affa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313aff9d expref: 8 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.026141:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8ce00, rc 0) 00000100:00100000:0.0:1788876948.026934:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532454272:12345-0@lo:253:kworker.0 Request processed in 8214us (42174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.026944:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1788876948.027041:0:53042:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788876948.027046:0:53042:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788876948.027061:0:53042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027072:0:53042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788876948.027080:0:53042:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000067096s 00010000:00010000:3.0:1788876948.027084:0:53042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027090:0:53042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027108:0:53042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027120:0:53042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027126:0:53042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788876948.027130:0:53042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027893:0:53042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027906:0:53042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027915:0:53042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.027922:0:53042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313affab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876948.027988:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47c2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.028308:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:53032:x1875771532454912:12345-0@lo:101:mount.lustre.0 Request processed in 2214us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.028316:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788876948.028437:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532454912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876948.028455:0:53032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.028465:0:53032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876948.028540:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532455040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876948.028578:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.028630:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.028897:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455040 00000100:00100000:0.0:1788876948.028903:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455040 00000100:00100000:0.0:1788876948.028946:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788876948.028954:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:53032:x1875771532455040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876948.029088:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53032:x1875771532455040:12345-0@lo:501:mount.lustre.0 Request processed in 135us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.029104:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788876948.029135:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532455040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788876948.029329:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532455168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876948.029371:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.029396:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47c2300 going to sleep for 11 seconds 00000020:01000004:1.0:1788876948.029466:0:3664:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788876948.029469:0:3664:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788876948.029471:0:3664:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876948.029472:0:3664:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876948.029474:0:3664:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876948.029475:0:3664:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876948.029476:0:3664:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876948.029478:0:3664:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876948.029479:0:3664:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788876948.029482:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532454272:0@lo:253:kworker.0 00000100:00100000:3.0:1788876948.029634:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455168 00000100:00100000:3.0:1788876948.029639:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455168 00000100:00100000:3.0:1788876948.029661:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788876948.029668:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53032:x1875771532455168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876948.030406:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53032:x1875771532455168:12345-0@lo:503:mount.lustre.0 Request processed in 737us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.030414:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788876948.030439:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532455168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788876948.030990:0:53044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53044:1875771532455296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876948.031028:0:53044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.031088:0:53044:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.035002:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455296 00000100:00100000:3.0:1788876948.035017:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455296 00000100:00100000:2.0:1788876948.035168:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788876948.035181:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53044:x1875771532455296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876948.035983:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53044:x1875771532455296:12345-0@lo:502:llog_process_th.0 Request processed in 802us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.035991:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788876948.036252:0:53044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53044:1875771532455296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788876948.036286:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876948.036297:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.036300:0:53044:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788876948.036307:0:53044:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788876948.036309:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876948.036323:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c25ecd40) 00000020:00000080:1.0:1788876948.036343:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788876948.036349:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788876948.036432:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788876948.036441:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313affb9 00000020:00000080:1.0:1788876948.036657:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788876948.036662:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876948.036665:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.036667:0:53044:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788876948.036670:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876948.036673:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.036675:0:53044:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788876948.036678:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876948.036685:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c25eb380) 00000020:00000080:1.0:1788876948.036698:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788876948.036702:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788876948.036704:0:53044:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788876948.036707:0:53044:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788876948.036712:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788876948.036749:0:53044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13f43d5000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788876948.036759:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c25e8000) 00000020:00000080:1.0:1788876948.036768:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788876948.036814:0:53044:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788876948.036819:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313affce 00000020:00000080:1.0:1788876948.036901:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788876948.036906:0:53044:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788876948.036910:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313affd5 00080000:01000000:1.0:1788876948.036915:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788876948.036918:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313affdc 00010000:00010000:3.0:1788876948.143189:0:53044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788876948.143390:0:53044:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 85899345920 lx: 0 gen 1 00000001:00080000:3.0:1788876948.143433:0:53044:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 81604378634 srv lr: 85899345920 lx: 0 gen 4 00000001:00000004:3.0:1788876948.143457:0:53044:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 21, last_transno is 85899345920 00000001:00080000:3.0:1788876948.143557:0:53044:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788876948.143631:0:53044:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c7203e40: xid 1875771511290368, transno 85899345921, client gen 4, slot idx 0 00000001:00080000:3.0:1788876948.143641:0:53044:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c72036c0: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:3.0:1788876948.143646:0:53044:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c72033c0: xid 1875771511290624, transno 85899345922, client gen 4, slot idx 2 00000001:00080000:3.0:1788876948.143652:0:53044:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13d364f3c0: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:3.0:1788876948.144181:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a12c3f63380) 00000020:00000080:3.0:1788876948.144201:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788876948.144282:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788876948.144289:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313afff8 00000020:00000080:0.0:1788876948.147935:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788876948.151419:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313affff 00000020:00000080:1.0:1788876948.159344:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788876948.159361:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876948.159369:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.159372:0:53044:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788876948.159375:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788876948.159378:0:53044:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788876948.159379:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876948.159381:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876948.159382:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788876948.159385:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.159386:0:53044:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788876948.159389:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876948.159393:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.159395:0:53044:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788876948.159400:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788876948.159448:0:53044:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788876948.159465:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876948.159468:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.159469:0:53044:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788876948.159472:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788876948.159474:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.159476:0:53044:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788876948.159478:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788876948.159483:0:53044:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:1.0:1788876948.159507:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876948.159521:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a12c25e99c0) 00000020:00000080:1.0:1788876948.159541:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788876948.159547:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788876948.159649:0:53044:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788876948.159656:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788876948.159666:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b000d 00010000:00080000:1.0:1788876948.159698:0:53044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ef00a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1788876948.166238:0:53044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1788876948.168546:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788876948.168562:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788876948.168683:0:53044:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788876948.168711:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0014 00000100:00080000:0.0:1788876948.168722:0:53044:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788876948.168728:0:53044:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a13ef00a000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876948.168765:0:53044:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f452dc00 x1875771532455424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876948.168792:0:53044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788876948.168947:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532455424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788876948.169038:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.169159:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455424 00000100:00100000:2.0:1788876948.169167:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455424 00000100:00100000:2.0:1788876948.169199:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1788876948.169206:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532455424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788876948.169229:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1936 last 0 00000020:00000080:2.0:1788876948.169332:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b001b 00000020:01000000:0.0:1788876948.170245:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876948.170251:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.170254:0:53044:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788876948.170267:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788876948.170271:0:53044:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788876948.170272:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876948.170275:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788876948.170276:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788876948.170279:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.170281:0:53044:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788876948.170284:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788876948.170289:0:53044:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788876948.170292:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.170293:0:53044:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788876948.170296:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788876948.170301:0:53044:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000100:00080000:1.0:1788876948.170383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876948.170388:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876948.170391:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876948.170396:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1935 00000100:00080000:1.0:1788876948.170399:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876948.170404:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876948.170420:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7978a80 x1875771532455680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876948.170430:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876948.170433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876948.170436:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876948.170439:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1935 00000100:00080000:1.0:1788876948.170441:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876948.170444:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876948.170454:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c365b100 x1875771532455808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876948.170470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876948.170473:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876948.170474:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876948.170477:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1935 00000100:00080000:1.0:1788876948.170480:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876948.170483:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876948.170494:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfd7fb80 x1875771532456064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876948.170532:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788876948.170535:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788876948.170537:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788876948.170541:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1935 00000100:00080000:1.0:1788876948.170543:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788876948.170547:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876948.170557:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1ea00 x1875771532456448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788876948.170593:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532455552:0@lo:400:kworker.0 00000004:00100000:2.0:1788876948.171368:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788876948.171491:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788876948.171570:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532455424:12345-0@lo:38:llog_process_th.0 Request processed in 2362us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.171581:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1788876948.173253:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532456192:0@lo:400:kworker.0 00000100:00100000:0.0:1788876948.173459:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.173504:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876948.173511:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532456320:0@lo:400:kworker.0 00000100:00100000:0.0:1788876948.173539:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788876948.173579:0:53044:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788876948.173585:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788876948.174195:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c4e30000) 00000020:00000080:0.0:1788876948.174222:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788876948.174230:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788876948.174354:0:53044:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788876948.174361:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788876948.174369:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0029 00010000:00080000:0.0:1788876948.174401:0:53044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ff364800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788876948.174619:0:53044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1788876948.176402:0:53044:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788876948.176437:0:53044:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788876948.177218:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456320 00000100:00100000:2.0:1788876948.177228:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456320 00000100:00100000:2.0:1788876948.177296:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1788876948.177307:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876948.177395:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532456320:12345-0@lo:400:kworker.0 Request processed in 90us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.177402:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1788876948.177460:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532456320:0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178182:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.178223:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532456576:0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178269:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.178291:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876948.178297:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532455936:0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178321:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.178363:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456192 00000100:00100000:1.0:1788876948.178368:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456192 00000100:00100000:1.0:1788876948.178395:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456576 00000100:00100000:1.0:1788876948.178398:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456576 00000100:00100000:1.0:1788876948.178413:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1788876948.178420:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532456192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178455:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532456192:12345-0@lo:400:kworker.0 Request processed in 35us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.178461:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1788876948.178473:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:1.0:1788876948.178478:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532456576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178506:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532456576:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.178512:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:1.0:1788876948.178535:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532456576:0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178555:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455552 00000100:00100000:1.0:1788876948.178558:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455552 00000100:00100000:1.0:1788876948.178590:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788876948.178597:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876948.178648:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3664:x1875771532455552:12345-0@lo:400:kworker.0 Request processed in 51us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.178657:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788876948.178688:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532455552:0@lo:400:kworker.0 00000040:00080000:0.0:1788876948.178943:0:53044:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 19, last_idx 20 00000040:00080000:0.0:1788876948.179973:0:53044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788876948.179996:0:53044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].21, 64 off9536 00000100:00100000:2.0:1788876948.180821:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455936 00000100:00100000:2.0:1788876948.180828:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455936 00000100:00100000:2.0:1788876948.180863:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788876948.180871:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532455936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876948.180931:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532455936:12345-0@lo:400:kworker.0 Request processed in 61us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.180938:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1788876948.180976:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532456192:0@lo:400:kworker.0 00000100:00100000:2.0:1788876948.181005:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532455936:0@lo:400:kworker.0 00000040:00080000:0.0:1788876948.181330:0:53044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x54:0x0].1, 64 off8256 00000040:00080000:0.0:1788876948.182965:0:53050:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 21 synced_idx: 0 lgh_last_idx: 21 00000040:00080000:0.0:1788876948.182972:0:53050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788876948.183528:0:53050:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 20, last_idx 21 00000040:00080000:0.0:1788876948.183546:0:53050:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x50:0x0] at index 20 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788876948.183727:0:53050:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:0.0:1788876948.183731:0:53050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x54:0x0] at index 21 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788876948.184326:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876948.184341:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788876948.184383:0:53044:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788876948.184406:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0030 00000100:00080000:1.0:1788876948.184419:0:53044:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788876948.184425:0:53044:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13ff364800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788876948.184468:0:53044:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1d180 x1875771532456704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788876948.184485:0:53044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788876948.184629:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788876948.184635:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.184638:0:53044:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788876948.184641:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788876948.184644:0:53044:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788876948.184646:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876948.184648:0:53044:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788876948.184650:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788876948.184653:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.184654:0:53044:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788876948.184657:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788876948.184661:0:53044:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788876948.184664:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788876948.184666:0:53044:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788876948.184669:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788876948.184672:0:53044:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1788876948.184701:0:53044:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788876948.184704:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788876948.184721:0:53044:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a13c79c4d40) 00000020:00000080:1.0:1788876948.184739:0:53044:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788876948.184744:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788876948.184833:0:53044:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788876948.184839:0:53044:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788876948.184847:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b003e 00010000:00080000:1.0:1788876948.184878:0:53044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a12c3408000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1788876948.185087:0:53044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788876948.185169:0:53044:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788876948.185188:0:53044:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788876948.186165:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876948.186177:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788876948.186185:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788876948.186190:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788876948.186193:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef00a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788876948.186210:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532455424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788876948.186236:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532455680:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186387:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.186423:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455680 00000100:00100000:3.0:1788876948.186430:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455680 00000100:00100000:3.0:1788876948.186458:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1788876948.186465:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532455680:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186510:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532455680:12345-0@lo:38:kworker.0 Request processed in 44us (123us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788876948.186517:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00080000:3.0:1788876948.186547:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876948.186552:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788876948.186555:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532455680:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186561:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532455808:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186588:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.186628:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532455808 00000100:00100000:3.0:1788876948.186632:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532455808 00000100:00100000:3.0:1788876948.186649:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:3.0:1788876948.186654:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532455808:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186696:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532455808:12345-0@lo:38:kworker.0 Request processed in 40us (107us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788876948.186701:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00080000:3.0:1788876948.186725:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876948.186730:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788876948.186732:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c365b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532455808:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186739:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532456064:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.186759:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.186779:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456064 00000100:00100000:3.0:1788876948.186783:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456064 00000100:00100000:3.0:1788876948.186802:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:3.0:1788876948.186806:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532456064:12345-0@lo:38:kworker.0 00000040:00080000:1.0:1788876948.187013:0:53044:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 19, last_idx 20 00000100:00100000:3.0:1788876948.187155:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532456064:12345-0@lo:38:kworker.0 Request processed in 347us (394us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788876948.187162:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00080000:3.0:1788876948.187188:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876948.187193:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788876948.187196:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532456064:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.187203:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532456448:0@lo:38:kworker.0 00000100:00100000:3.0:1788876948.187226:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.187243:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532456704:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788876948.187333:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.187357:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456704 00000100:00100000:3.0:1788876948.187361:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456704 00000100:00100000:3.0:1788876948.187381:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1788876948.187386:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3661:x1875771532456704:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788876948.187404:0:43954:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1936 last 0 00000020:00000080:3.0:1788876948.187429:0:43954:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0045 00002000:00100000:3.0:1788876948.187442:0:43954:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13fa7ac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788876948.187446:0:43954:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788876948.187449:0:43954:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788876948.187497:0:43954:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788876948.187518:0:43954:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876948.187552:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532456704:12345-0@lo:8:llog_process_th.0 Request processed in 165us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.187559:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1788876948.187589:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876948.187594:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788876948.187756:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788876948.187762:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788876948.187764:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff364800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788876948.187771:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788876948.187775:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532456704:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788876948.190485:0:53050:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788876948.190530:0:53050:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1936085927577ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788876948.190537:0:53050:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788876948.190576:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532456832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876948.190646:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.190769:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456448 00000100:00100000:2.0:1788876948.190775:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456448 00000100:00100000:2.0:1788876948.190805:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:2.0:1788876948.190825:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532456448:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788876948.190881:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532456448:12345-0@lo:38:kworker.0 Request processed in 55us (3653us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788876948.190888:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:2.0:1788876948.190911:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532456960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876948.190941:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.190985:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456960 00000100:00100000:2.0:1788876948.190989:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456960 00000100:00100000:2.0:1788876948.191015:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1788876948.191021:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532456960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876948.191046:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876948.191094:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532456960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.191110:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1788876948.191144:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532456960:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788876948.193165:0:53044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788876948.193224:0:53044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].21, 64 off9536 00000040:00080000:1.0:1788876948.193513:0:53044:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x56:0x0].1, 64 off8256 00000100:00100000:3.0:1788876948.193722:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532456832 00000100:00100000:3.0:1788876948.193730:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532456832 00000100:00100000:3.0:1788876948.193778:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1788876948.193786:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532456832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876948.193871:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876948.193948:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532456832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.193954:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1788876948.194010:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532456832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788876948.194043:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876948.194047:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788876948.194051:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532456448:0@lo:38:kworker.0 00000100:00080000:1.0:1788876948.194142:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788876948.194573:0:53052:0:(llog.c:805:llog_process_thread()) index: 20, lh_last_idx: 21 synced_idx: 0 lgh_last_idx: 21 00000040:00080000:1.0:1788876948.194579:0:53052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788876948.194759:0:53052:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 20, last_idx 21 00000040:00080000:1.0:1788876948.194773:0:53052:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x52:0x0] at index 20 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788876948.195203:0:53052:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 21 synced_idx: 21 lgh_last_idx: 21 00000040:00080000:1.0:1788876948.195206:0:53052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x56:0x0] at index 21 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788876948.197271:0:53033:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:2.0:1788876948.198215:0:53044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876948.198228:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788876948.198328:0:53044:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788876948.198354:0:53044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b004c 00000100:00080000:2.0:1788876948.198364:0:53044:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788876948.198370:0:53044:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a12c3408000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876948.198405:0:53044:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3658000 x1875771532457088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876948.198465:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532457088:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788876948.198538:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788876948.198726:0:53044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788876948.198782:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876948.198786:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876948.198788:0:53044:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788876948.198790:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876948.198794:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876948.198795:0:53044:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788876948.198798:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788876948.198800:0:53044:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788876948.198802:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876948.198804:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876948.198805:0:53044:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788876948.198818:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788876948.198821:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876948.198823:0:53044:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788876948.198826:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788876948.198854:0:53044:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53044:1875771532457216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876948.198901:0:53044:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.198931:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457216 00000100:00100000:2.0:1788876948.198937:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457216 00000100:00100000:2.0:1788876948.198975:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788876948.198983:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53044:x1875771532457216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876948.199200:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53044:x1875771532457216:12345-0@lo:502:llog_process_th.0 Request processed in 216us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.199208:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788876948.199244:0:53044:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fe900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.199331:0:53044:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53044:1875771532457216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788876948.199363:0:53044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788876948.199368:0:53044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788876948.199369:0:53044:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788876948.199373:0:53044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1788876948.199788:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457088 00000100:00100000:0.0:1788876948.199794:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457088 00000100:00100000:0.0:1788876948.199831:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1788876948.199836:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3661:x1875771532457088:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1788876948.199862:0:8456:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1936 last 0 00000020:00000080:0.0:1788876948.199886:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0053 00002000:00100000:0.0:1788876948.199898:0:8456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ff363000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788876948.199902:0:8456:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788876948.199905:0:8456:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788876948.199964:0:8456:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788876948.199985:0:8456:0:(import.c:65:import_set_state_nolock()) ffff8a12c22f1000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1788876948.200210:0:53032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788876948.200237:0:53032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788876948.200263:0:53032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200276:0:53032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876948.200290:0:53032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13f43d5000 from 1 10000000:01000000:1.0:1788876948.200293:0:53032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788876948.200319:0:53032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200327:0:53032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200336:0:53032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.200352:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788876948.200385:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.200413:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788876948.200431:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457344 00000100:00100000:1.0:1788876948.200435:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457344 00000100:00100000:1.0:1788876948.200459:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788876948.200466:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:53032:x1875771532457344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876948.200474:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876948.200489:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b005a expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200512:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 9 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200523:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 9 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200536:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41e00, rc 0) 00000100:00100000:1.0:1788876948.200564:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:53032:x1875771532457344:12345-0@lo:101:mount.lustre.0 Request processed in 99us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.200570:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788876948.200635:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876948.200648:0:53032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.200657:0:53032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.201393:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457472:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788876948.201429:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.201589:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532457088:12345-0@lo:8:llog_process_th.0 Request processed in 1750us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.201621:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1788876948.201698:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.203166:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457472 00000100:00100000:2.0:1788876948.203176:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457472 00000100:00100000:2.0:1788876948.203224:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788876948.203233:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:53032:x1875771532457472:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788876948.203255:0:53040:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788876948.203392:0:53040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788876948.203396:0:53040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788876948.203400:0:53040:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788876948.203403:0:53040:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 86 00000100:00100000:2.0:1788876948.203650:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:53032:x1875771532457472:12345-0@lo:256:mount.lustre.0 Request processed in 418us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.203658:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788876948.203745:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876948.203754:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788876948.203762:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788876948.203768:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788876948.203772:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788876948.203796:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788876948.203803:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532457088:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788876948.203952:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876948.203961:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532457600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876948.203993:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.204021:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457600 00000100:00100000:2.0:1788876948.204025:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457600 00000100:00100000:2.0:1788876948.204068:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1788876948.204075:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532457600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876948.204088:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876948.204130:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532457600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.204136:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1788876948.204166:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532457600:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788876948.204352:0:53052:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788876948.204428:0:53052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1936099825741ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788876948.204434:0:53052:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788876948.205626:0:53033:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788876948.206507:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457472:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788876948.207499:0:53032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876948.207666:0:53032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.207679:0:53032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876948.207687:0:53032:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13f43d5000 from 1 10000000:01000000:1.0:1788876948.207690:0:53032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788876948.207726:0:53032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.207740:0:53032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.207749:0:53032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.207770:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788876948.207837:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.207879:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00080000:1.0:1788876948.207898:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876948.208004:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457728 00000100:00100000:3.0:1788876948.208011:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457728 00000100:00100000:3.0:1788876948.208065:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788876948.208074:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:53032:x1875771532457728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788876948.208086:0:53037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876948.208110:0:53037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b006f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0068 expref: -99 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.208132:0:53037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b006f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0068 expref: 10 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.208143:0:53037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b006f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0068 expref: 10 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876948.208156:0:53037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9c00, rc 0) 00000100:00100000:3.0:1788876948.208194:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532457728:12345-0@lo:101:mount.lustre.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.208200:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788876948.208514:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876948.208529:0:53032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.208538:0:53032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.208632:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788876948.208658:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.208686:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.208739:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457856 00000100:00100000:3.0:1788876948.208743:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457856 00000100:00100000:3.0:1788876948.208773:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788876948.208780:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532457856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876948.208916:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532457856:12345-0@lo:501:mount.lustre.0 Request processed in 135us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.208923:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788876948.209172:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876948.209205:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876948.209253:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.209574:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.209626:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532457984 00000100:00100000:3.0:1788876948.209631:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532457984 00000100:00100000:3.0:1788876948.209658:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788876948.209665:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532457984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788876948.209754:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532457984:12345-0@lo:503:mount.lustre.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.209761:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788876948.209847:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532457984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788876948.210487:0:53054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53054:1875771532458112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876948.210529:0:53054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.210558:0:53054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.210628:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458112 00000100:00100000:3.0:1788876948.210633:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458112 00000100:00100000:3.0:1788876948.210667:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788876948.210675:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53054:x1875771532458112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876948.211152:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53054:x1875771532458112:12345-0@lo:502:llog_process_th.0 Request processed in 477us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.211159:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788876948.211248:0:53054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53054:1875771532458112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876948.211337:0:53054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876948.211346:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.211348:0:53054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788876948.211355:0:53054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13f43d5000 00000020:00000080:0.0:1788876948.211358:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788876948.211365:0:53054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876948.211367:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.211368:0:53054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788876948.211371:0:53054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788876948.211373:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.211375:0:53054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788876948.211378:0:53054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13f43d5000 00000020:00000080:0.0:1788876948.211380:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788876948.211448:0:53054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53054:1875771532458240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876948.211483:0:53054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.211505:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458240 00000100:00100000:0.0:1788876948.211510:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458240 00000100:00100000:0.0:1788876948.211531:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788876948.211537:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53054:x1875771532458240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876948.211618:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53054:x1875771532458240:12345-0@lo:502:llog_process_th.0 Request processed in 64us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.211625:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788876948.211651:0:53054:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.211664:0:53054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53054:1875771532458240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788876948.211682:0:53054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788876948.211686:0:53054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788876948.211687:0:53054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788876948.211691:0:53054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788876948.212726:0:53032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788876948.212751:0:53032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876948.212772:0:53032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.212782:0:53032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876948.212892:0:53032:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788876948.212895:0:53032:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a13f43d5000 10000000:01000000:2.0:1788876948.212898:0:53032:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a13f43d5000 10000000:01000000:2.0:1788876948.212901:0:53032:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788876948.212908:0:53032:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13f43d5000 from 1 10000000:01000000:2.0:1788876948.212910:0:53032:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876948.212936:0:53032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.212945:0:53032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.212954:0:53032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876948.212969:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788876948.213005:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876948.214167:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c31fef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876948.219377:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458368 00000100:00100000:1.0:1788876948.219390:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458368 00000100:00100000:1.0:1788876948.219447:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788876948.219457:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:53032:x1875771532458368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788876948.219473:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876948.219490:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef41a00/0xf5bf0f7e313b007d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0076 expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.219519:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef41a00/0xf5bf0f7e313b007d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0076 expref: 11 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.219531:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef41a00/0xf5bf0f7e313b007d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0076 expref: 11 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.219539:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41a00, rc 0) 00000100:00100000:1.0:1788876948.219641:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532458368:12345-0@lo:101:mount.lustre.0 Request processed in 185us (6634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.219648:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788876948.219755:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788876948.219774:0:53032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876948.219784:0:53032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876948.219877:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876948.219913:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.219949:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.220047:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458496 00000100:00100000:3.0:1788876948.220051:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458496 00000100:00100000:3.0:1788876948.220083:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788876948.220090:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532458496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788876948.220207:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532458496:12345-0@lo:501:mount.lustre.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.220215:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788876948.220282:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788876948.220309:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876948.220346:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.220366:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.220380:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458624 00000100:00100000:0.0:1788876948.220384:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458624 00000100:00100000:0.0:1788876948.220400:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788876948.220405:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532458624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876948.220476:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532458624:12345-0@lo:503:mount.lustre.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.220482:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788876948.220517:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532458624:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788876948.220704:0:53056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532458752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876948.220739:0:53056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.220756:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458752 00000100:00100000:0.0:1788876948.220760:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458752 00000100:00100000:0.0:1788876948.220775:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788876948.220781:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532458752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788876948.220862:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532458752:12345-0@lo:502:llog_process_th.0 Request processed in 80us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.220869:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788876948.220897:0:53056:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.220907:0:53056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532458752:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788876948.220956:0:53056:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788876948.220969:0:53056:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c4e319c0) 00000020:00000080:0.0:1788876948.220994:0:53056:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788876948.221066:0:53056:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13f43d5000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788876948.221070:0:53056:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13f43d5000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788876948.221073:0:53056:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13f43d5000 4 00010000:00080000:0.0:1788876948.221111:0:53056:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13d0608800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788876948.222740:0:53056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788876948.222922:0:53056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788876948.222958:0:53056:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788876948.222971:0:53056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313b008b 00000100:00080000:0.0:1788876948.222981:0:53056:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788876948.222987:0:53056:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13d0608800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876948.223016:0:53056:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f452dc00 x1875771532458880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876948.223034:0:53056:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788876948.224680:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532458880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788876948.224766:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.224808:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532458880 00000100:00100000:3.0:1788876948.224815:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532458880 00000100:00100000:3.0:1788876948.224852:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:3.0:1788876948.224859:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532458880:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788876948.224907:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532458880:12345-0@lo:38:llog_process_th.0 Request processed in 46us (140us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788876948.224914:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:3.0:1788876948.224956:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788876948.224963:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d0608800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876948.224967:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788876948.224971:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532458880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788876948.238895:0:53056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532459008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876948.238976:0:53056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.239204:0:53056:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.240463:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459008 00000100:00100000:2.0:1788876948.240473:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459008 00000100:00100000:2.0:1788876948.240554:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788876948.240564:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532459008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788876948.240721:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532459008:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.240729:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788876948.240964:0:53056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532459008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876948.241021:0:53056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532459136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788876948.241060:0:53056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.241220:0:53056:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.241345:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459136 00000100:00100000:3.0:1788876948.241351:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459136 00000100:00100000:3.0:1788876948.241373:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788876948.241380:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532459136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788876948.241477:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53056:x1875771532459136:12345-0@lo:502:llog_process_th.0 Request processed in 97us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.241488:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788876948.244402:0:53056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53056:1875771532459136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788876948.244444:0:53056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788876948.244923:0:53032:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788876948.244948:0:53032:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788876948.244964:0:53032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.244976:0:53032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788876948.245032:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788876948.245034:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788876948.245036:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876948.245037:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876948.245038:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876948.245040:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876948.245041:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876948.245043:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788876948.245045:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876948.245046:0:53032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788876948.245050:0:53032:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788876948.245052:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788876948.245054:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788876948.245055:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788876948.245057:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788876948.245058:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788876948.245059:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788876948.245060:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788876948.245061:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788876948.245062:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788876948.245063:0:53032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788876948.245086:0:53032:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788876948.245114:0:53032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532459264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788876948.245177:0:53032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.245217:0:53032:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62180 going to sleep for 11 seconds 00000100:00100000:3.0:1788876948.245963:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459264 00000100:00100000:3.0:1788876948.245971:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459264 00000100:00100000:3.0:1788876948.246019:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788876948.246028:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532459264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788876948.246058:0:53038:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788876948.246074:0:53038:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788876948.249385:0:53038:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788876948.249442:0:53038:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788876948.249840:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:53032:x1875771532459264:12345-0@lo:253:mount.lustre.0 Request processed in 3807us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.249854:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788876948.250010:0:53032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:53032:1875771532459264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788876948.250024:0:53032:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788876948.250027:0:53032:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788876948.250029:0:53032:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788876948.250030:0:53032:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788876948.250031:0:53032:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788876948.250033:0:53032:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788876948.250034:0:53032:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788876948.250035:0:53032:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788876948.250037:0:53032:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788876948.250039:0:53032:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788876948.250040:0:53032:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788876948.250059:0:53032:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788876948.250742:0:53042:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788876948.250748:0:53042:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788876948.250768:0:53042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876948.250785:0:53042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 10 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876948.250793:0:53042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876948.250898:0:53042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 10 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876948.250914:0:53042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 10 pid: 53038 timeout: 2036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876948.250928:0:53042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:53042:1875771532459392:0@lo:104: 00000100:00100000:0.0:1788876948.250980:0:53042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876948.251026:0:53042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876948.251080:0:6523:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788876948.251104:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459392 00000100:00100000:2.0:1788876948.251110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459392 00000100:00100000:2.0:1788876948.251157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788876948.251166:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5594850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:53042:x1875771532459392:12345-0@lo:104: 00010000:00010000:2.0:1788876948.251179:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876948.251233:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788876948.251239:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5594850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:53042:x1875771532459392:12345-0@lo:104: Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876948.251245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788876948.251394:0:53042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:53042:1875771532459392:0@lo:104: 00010000:00010000:2.0:1788876948.251414:0:53042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.251966:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876948.251974:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.251988:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40800 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788876948.251992:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252002:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788876948.252010:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876948.252018:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788876948.252061:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252069:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788876948.252107:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252114:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b005a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0061 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252131:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876948.252133:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876948.252135:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876948.252143:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876948.252158:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532459520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788876948.252203:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876948.252246:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459520 00000100:00100000:1.0:1788876948.252251:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459520 00010000:00010000:1.0:1788876948.252288:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 11 pid: 53038 timeout: 2036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.252316:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788876948.252324:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3665:x1875771532459520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788876948.252335:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876948.252341:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 11 pid: 53038 timeout: 2036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252352:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 11 pid: 53038 timeout: 2036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252366:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef41e00/0xf5bf0f7e313b0061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313b005a expref: 11 pid: 53038 timeout: 2036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252379:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252388:0:9553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788876948.252403:0:9553:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001656031s 00010000:00010000:1.0:1788876948.252408:0:9553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252415:0:9553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252422:0:9553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252429:0:9553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252435:0:9553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876948.252439:0:9553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252447:0:9553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252462:0:9553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252473:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788876948.252504:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3665:x1875771532459520:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.252512:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:1.0:1788876948.252536:0:53042:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252543:0:53042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.252550:0:53042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0092 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 53042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876948.252577:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532459520:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788876948.257744:0:53032:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:2.0:1788876948.258061:0:53032:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788876948.258137:0:53062:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:3.0:1788876948.258141:0:53062:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:3.0:1788876948.258517:0:53063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788876948.263395:0:53032:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788876948.263819:0:53063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788876948.263890:0:53063:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788876948.264590:0:53064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.264683:0:53064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.264710:0:53064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b840 going to sleep for 11 seconds 00000040:01000000:2.0:1788876948.265073:0:53032:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788876948.265120:0:53032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788876948.266672:0:53032:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788876948.266687:0:53032:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788876948.266754:0:53032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788876948.269041:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459648 00000100:00100000:0.0:1788876948.269054:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459648 00000100:00100000:0.0:1788876948.269128:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1788876948.269138:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876948.269267:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 131us (4583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.269275:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1788876948.269410:0:53064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459648:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788876948.269444:0:53064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788876948.269481:0:53064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.269521:0:53064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.269550:0:53064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b840 going to sleep for 11 seconds 00000040:00080000:2.0:1788876948.270197:0:53032:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788876948.270345:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459776 00000100:00100000:0.0:1788876948.270351:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459776 00000100:00100000:0.0:1788876948.270389:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1788876948.270396:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876948.270506:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.270514:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1788876948.270583:0:53064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.270690:0:53064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.270719:0:53064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.270737:0:53064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.270789:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532459904 00000100:00100000:0.0:1788876948.270793:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532459904 00000100:00100000:0.0:1788876948.270831:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788876948.270838:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876948.270885:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532459904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.270892:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1788876948.271007:0:53064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532459904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.271075:0:53064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532460032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788876948.271149:0:53064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.271170:0:53064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788876948.271362:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460032 00000100:00100000:0.0:1788876948.271366:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460032 00000100:00100000:0.0:1788876948.271397:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788876948.271404:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532460032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788876948.271580:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:53064:x1875771532460032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 176us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876948.271587:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1788876948.271775:0:53064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:53064:1875771532460032:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788876948.275573:0:53064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788876948.275884:0:53064:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788876948.275890:0:53064:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788876948.276735:0:53032:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788876948.276779:0:53032:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788876948.276952:0:53032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788876948.277519:0:53032:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x48:0x0] (8/32) registered 00010000:00080000:3.0:1788876948.279966:0:53032:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 85899345922 00010000:00080000:3.0:1788876948.280984:0:53065:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 53065 00010000:02000000:3.0:1788876948.280997:0:53065:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788876948.281001:0:53065:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788876948.281004:0:53065:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1788876948.281211:0:53032:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788876948.281226:0:53032:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788876948.281244:0:53032:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788876948.281282:0:53032:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788876948.282132:0:53032:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788876948.282445:0:53032:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788876948.779192:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876948.977060:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876948.977186:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299328 00000100:00100000:1.0:1788876948.977196:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299328 00000100:00100000:1.0:1788876948.977253:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1788876948.977263:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511299328:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876948.977279:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876948.977300:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef40200/0xf5bf0f7e313b0099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489dd expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.977330:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef40200/0xf5bf0f7e313b0099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489dd expref: 6 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.977342:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef40200/0xf5bf0f7e313b0099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489dd expref: 6 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876948.977351:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40200, rc 0) 00000100:00100000:1.0:1788876948.977406:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511299328:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 144us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.977413:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1788876948.978423:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532460160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788876948.978471:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876948.981530:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876948.981560:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299456 00000100:00100000:3.0:1788876948.981569:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299456 00000100:00100000:3.0:1788876948.981637:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1788876948.981647:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511299456:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788876948.981686:0:53038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1788876948.981711:0:53038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788876948.981714:0:53038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788876948.981718:0:53038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788876948.981721:0:53038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788876948.981724:0:53038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 87 00000100:00100000:3.0:1788876948.985318:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511299456:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 3648us (3769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876948.985336:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1788876948.987177:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460160 00000100:00100000:1.0:1788876948.987194:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460160 00000100:00100000:1.0:1788876948.987259:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1788876948.987268:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532460160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876948.987292:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876948.987375:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532460160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (8901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876948.987382:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1788876948.987447:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532460160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876949.010898:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876949.010945:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876949.010977:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299584 00000100:00100000:1.0:1788876949.010986:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299584 00000100:00100000:1.0:1788876949.011028:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2689 00000100:00100000:1.0:1788876949.011037:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511299584:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 00010000:00080000:1.0:1788876949.011067:0:8722:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13c3002800, cookie 0xf5bf0f7e313affea 00010000:00080000:1.0:1788876949.011073:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t85899345923 exp ffff8a13c3002800 cur 1936 last 1788876948 00010000:02000400:1.0:1788876949.011106:0:8722:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788876949.011113:0:8722:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788876949.011137:0:8722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788876949.011283:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd62800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788876949.011349:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511299584:12345-192.168.203.11@tcp:38:ll_cfg_requeue.0 Request processed in 311us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876949.011356:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2689 00000100:00100000:3.0:1788876949.014919:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299712 00000100:00100000:3.0:1788876949.014933:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299712 00000100:00100000:1.0:1788876949.014955:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876949.014981:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1788876949.014985:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511292800 00000100:00100000:1.0:1788876949.014989:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511292800 00000100:00100000:3.0:1788876949.014991:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511299712:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876949.015007:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788876949.015021:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2690 00000100:00100000:1.0:1788876949.015027:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511292800:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:3.0:1788876949.015027:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313b00a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489e4 expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788876949.015046:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 85899345923, current: 85899345923, replaying 00010000:00010000:3.0:1788876949.015057:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313b00a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489e4 expref: 7 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876949.015059:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511292800:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 33us (108us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876949.015066:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2690 00010000:00010000:3.0:1788876949.015071:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313b00a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489e4 expref: 7 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.015081:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8a00, rc 0) 00000100:00100000:3.0:1788876949.015152:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511299712:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 162us (4265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876949.015158:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00010000:00080000:3.0:1788876949.015191:0:53065:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1788876949.021350:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876949.022106:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299840 00000100:00100000:0.0:1788876949.022117:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299840 00000100:00100000:0.0:1788876949.022176:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:0.0:1788876949.022187:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511299840:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.022352:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511299840:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 166us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.022360:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1788876949.027559:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876949.027689:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511299968 00000100:00100000:1.0:1788876949.027699:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511299968 00000100:00100000:1.0:1788876949.027750:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1788876949.027760:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511299968:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.027909:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511299968:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 150us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876949.027917:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1788876949.044702:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876949.045405:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300096 00000100:00100000:1.0:1788876949.045417:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300096 00000100:00100000:1.0:1788876949.045481:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1788876949.045492:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511300096:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876949.045509:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876949.045526:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef40800/0xf5bf0f7e313b00a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489eb expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876949.045556:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef40800/0xf5bf0f7e313b00a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489eb expref: 9 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876949.045567:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef40800/0xf5bf0f7e313b00a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489eb expref: 9 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876949.045577:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40800, rc 0) 00000100:00100000:1.0:1788876949.046002:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300096:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 160us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876949.046010:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1788876949.067565:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876949.075820:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300224 00000100:00100000:0.0:1788876949.075839:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300224 00000100:00100000:0.0:1788876949.075915:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1788876949.075927:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300224:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.076106:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300224:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 179us (8551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.076115:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1788876949.082010:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876949.082110:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300352 00000100:00100000:0.0:1788876949.082120:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300352 00000100:00100000:1.0:1788876949.082260:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1788876949.082271:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300352:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.082421:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300352:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876949.082429:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1788876949.100237:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876949.100584:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300480 00000100:00100000:2.0:1788876949.100595:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300480 00000100:00100000:2.0:1788876949.100677:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1788876949.100689:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511300480:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876949.100709:0:53037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876949.100729:0:53037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c800/0xf5bf0f7e313b00ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489f2 expref: -99 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.100761:0:53037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c800/0xf5bf0f7e313b00ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f2 expref: 10 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.100772:0:53037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c800/0xf5bf0f7e313b00ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f2 expref: 10 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.100781:0:53037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c800, rc 0) 00000100:00100000:2.0:1788876949.100841:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511300480:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 155us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.100848:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:3.0:1788876949.103867:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876949.103948:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300608 00000100:00100000:2.0:1788876949.103963:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300608 00000100:00100000:2.0:1788876949.104032:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1788876949.104043:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511300608:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.104171:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511300608:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 130us (317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788876949.104179:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00010000:00010000:2.0:1788876949.803845:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788876949.928756:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788876949.928766:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13f43d5000 from 87 10000000:01000000:0.0:1788876949.928773:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788876949.928834:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.928849:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.928863:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.928896:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.928992:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.929059:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.929266:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460288 00000100:00100000:2.0:1788876949.929275:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460288 00000100:00100000:2.0:1788876949.929360:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788876949.929372:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532460288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876949.929391:0:53037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876949.929411:0:53037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313b00bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00b5 expref: -99 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.929445:0:53037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313b00bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00b5 expref: 11 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.929459:0:53037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313b00bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00b5 expref: 11 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.929470:0:53037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8cc00, rc 0) 00000100:00100000:2.0:1788876949.929525:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532460288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.929533:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788876949.931145:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876949.931182:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.931200:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.931325:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.931413:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.931478:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.938961:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460416 00000100:00100000:2.0:1788876949.938983:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460416 00000100:00100000:2.0:1788876949.939069:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788876949.939081:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532460416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788876949.939126:0:53038:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788876949.939150:0:53038:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788876949.939154:0:53038:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 87 00000100:00100000:2.0:1788876949.939315:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532460416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 237us (7902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.939324:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788876949.940011:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788876949.940110:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788876949.940123:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.940136:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876949.940151:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788876949.940154:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:0.0:1788876949.940157:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788876949.940199:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.940208:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.940218:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.940242:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.940293:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.940341:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.940409:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460544 00000100:00100000:2.0:1788876949.940416:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460544 00000100:00100000:2.0:1788876949.940460:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788876949.940468:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532460544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876949.940480:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876949.940494:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313b00ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00c3 expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.940520:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313b00ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00c3 expref: 12 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.940532:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313b00ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00c3 expref: 12 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.940541:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8de00, rc 0) 00000100:00100000:2.0:1788876949.940599:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e1cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.940649:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788876949.940845:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876949.940861:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.940873:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876949.940947:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.940976:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876949.941004:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.942891:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460672 00000100:00100000:2.0:1788876949.942910:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460672 00000100:00100000:2.0:1788876949.942999:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788876949.943011:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.943246:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eeffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.943256:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788876949.943746:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.943818:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.943886:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876949.943922:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876949.944046:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460800 00000100:00100000:0.0:1788876949.944054:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460800 00000100:00100000:0.0:1788876949.944106:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788876949.944115:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.944223:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.944230:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788876949.944587:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876949.948584:0:53126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788876949.959426:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788876949.959489:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788876949.959508:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.959522:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876949.959535:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788876949.959538:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788876949.959542:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788876949.959620:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.959841:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.959855:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.959888:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.959978:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.960033:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.960109:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532460928 00000100:00100000:2.0:1788876949.960119:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532460928 00000100:00100000:2.0:1788876949.960181:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788876949.960191:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532460928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876949.960212:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876949.960228:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8da00/0xf5bf0f7e313b00d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00d1 expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.960256:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8da00/0xf5bf0f7e313b00d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00d1 expref: 13 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.960268:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8da00/0xf5bf0f7e313b00d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00d1 expref: 13 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.960278:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8da00, rc 0) 00000100:00100000:2.0:1788876949.960329:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532460928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.960337:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788876949.960431:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532460928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876949.960449:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.960459:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.960525:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.960551:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.960575:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876949.960921:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461056 00000100:00100000:3.0:1788876949.961031:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461056 00000100:00100000:3.0:1788876949.961063:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788876949.961070:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532461056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.961254:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532461056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876949.961261:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788876949.961893:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.961949:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.962008:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.962094:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876949.962854:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461184 00000100:00100000:3.0:1788876949.962862:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461184 00000100:00100000:3.0:1788876949.962917:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788876949.963033:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532461184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.967641:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532461184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4674us (5591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.967659:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788876949.967689:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876949.971687:0:53127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1788876949.971990:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1788876949.972012:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788876949.972023:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.972035:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876949.972044:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788876949.972047:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:0.0:1788876949.972050:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788876949.972097:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.972106:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.972117:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788876949.972142:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.972213:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876949.972264:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.972286:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461312 00000100:00100000:2.0:1788876949.972301:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461312 00000100:00100000:2.0:1788876949.972375:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788876949.972387:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532461312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788876949.972408:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876949.972428:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313b00e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00df expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.972462:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313b00e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00df expref: 14 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.972475:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313b00e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00df expref: 14 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.972487:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7b8c000, rc 0) 00000100:00100000:2.0:1788876949.972574:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.972580:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788876949.972637:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876949.972666:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876949.972677:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876949.972759:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.972798:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876949.972835:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.972942:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461440 00000100:00100000:2.0:1788876949.972946:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461440 00000100:00100000:2.0:1788876949.972988:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788876949.972996:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.973135:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.973143:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788876949.973262:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.973292:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.973343:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876949.973366:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.973546:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461568 00000100:00100000:2.0:1788876949.973551:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461568 00000100:00100000:2.0:1788876949.973578:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788876949.973585:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.973887:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 303us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.973894:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788876949.974030:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876949.975115:0:53128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788876949.975319:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788876949.975348:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788876949.975362:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.975375:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876949.975392:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788876949.975395:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:2.0:1788876949.975398:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788876949.975438:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.975447:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.975458:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876949.975481:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.975546:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876949.975590:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876949.975686:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461696 00000100:00100000:3.0:1788876949.975695:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461696 00000100:00100000:3.0:1788876949.976002:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788876949.976014:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c5ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532461696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876949.976029:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876949.976047:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9000/0xf5bf0f7e313b00f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00ed expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.976078:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9000/0xf5bf0f7e313b00f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00ed expref: 15 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.976100:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9000/0xf5bf0f7e313b00f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00ed expref: 15 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.976109:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9000, rc 0) 00000100:00100000:3.0:1788876949.976161:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c5ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532461696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876949.976168:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788876949.976218:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876949.976236:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.976246:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876949.976310:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.976339:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876949.976361:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876949.976374:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461824 00000100:00100000:3.0:1788876949.976377:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461824 00000100:00100000:3.0:1788876949.976398:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788876949.976404:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532461824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.979140:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532461824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2723us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.979157:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788876949.979663:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.980958:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.983518:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876949.984336:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788876949.985103:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532461952 00000100:00100000:1.0:1788876949.985119:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532461952 00000100:00100000:1.0:1788876949.985343:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788876949.985358:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532461952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.985633:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532461952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876949.985642:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788876949.985672:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532461952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876949.986414:0:53129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788876949.987046:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788876949.987077:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788876949.987105:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.987120:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876949.987137:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788876949.987140:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788876949.987143:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788876949.987194:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.987203:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.987214:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876949.987241:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.987317:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876949.987688:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db840 going to sleep for 11 seconds 00000100:00100000:3.0:1788876949.990403:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462080 00000100:00100000:3.0:1788876949.990423:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462080 00000100:00100000:0.0:1788876949.990893:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788876949.990905:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532462080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876949.990925:0:53037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876949.990947:0:53037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b00fb expref: -99 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.991039:0:53037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00fb expref: 16 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.991052:0:53037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b00fb expref: 16 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.991063:0:53037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221000, rc 0) 00000100:00100000:0.0:1788876949.991256:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 352us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.991263:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788876949.991308:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876949.991332:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876949.991343:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876949.991450:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876949.991491:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876949.991746:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c371a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788876949.992085:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462208 00000100:00100000:2.0:1788876949.992100:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462208 00000100:00100000:2.0:1788876949.992143:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788876949.992151:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.992330:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876949.992337:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788876949.992577:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.992681:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876949.992735:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876949.992767:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788876949.992865:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462336 00000100:00100000:0.0:1788876949.992871:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462336 00000100:00100000:0.0:1788876949.992906:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788876949.992914:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876949.994028:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1106us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.994043:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788876949.994131:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876949.998790:0:53130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1788876949.999103:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1788876949.999143:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788876949.999160:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.999173:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876949.999187:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788876949.999190:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:2.0:1788876949.999193:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788876949.999244:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.999252:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876949.999265:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876949.999301:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788876949.999398:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876949.999465:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db840 going to sleep for 11 seconds 00000100:00100000:0.0:1788876949.999532:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462464 00000100:00100000:0.0:1788876949.999547:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462464 00000100:00100000:0.0:1788876949.999658:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788876949.999671:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532462464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876949.999693:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876949.999714:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220800/0xf5bf0f7e313b0110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0109 expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.999746:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220800/0xf5bf0f7e313b0110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0109 expref: 17 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.999757:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220800/0xf5bf0f7e313b0110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0109 expref: 17 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876949.999768:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220800, rc 0) 00000100:00100000:0.0:1788876949.999861:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876949.999869:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788876950.000825:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876950.000862:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.000876:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.001068:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.001145:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.001205:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876950.003148:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462592 00000100:00100000:3.0:1788876950.003163:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462592 00000100:00100000:3.0:1788876950.003261:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788876950.003273:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.003473:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876950.003482:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788876950.005409:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.005507:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.005685:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.005739:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788876950.005942:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462720 00000100:00100000:3.0:1788876950.005950:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462720 00000100:00100000:3.0:1788876950.006011:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788876950.006022:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.006199:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876950.006211:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788876950.006424:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876950.010727:0:53133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788876950.012917:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788876950.012965:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788876950.012981:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.012997:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.013010:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788876950.013013:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:3.0:1788876950.013017:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788876950.013067:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.013077:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.013100:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876950.013137:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.013229:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876950.013312:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462848 00000100:00100000:3.0:1788876950.013313:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.013327:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462848 00000100:00100000:0.0:1788876950.013386:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788876950.013395:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532462848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.013410:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876950.013426:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220e00/0xf5bf0f7e313b011e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0117 expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.013450:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220e00/0xf5bf0f7e313b011e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0117 expref: 18 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.013462:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220e00/0xf5bf0f7e313b011e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0117 expref: 18 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.013471:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220e00, rc 0) 00000100:00100000:0.0:1788876950.013553:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532462848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.013559:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788876950.013656:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876950.013679:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.013690:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.013779:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.013826:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.013855:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.014025:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532462976 00000100:00100000:0.0:1788876950.014032:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532462976 00000100:00100000:0.0:1788876950.014072:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876950.014080:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532462976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.014221:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532462976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.014227:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788876950.016735:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532462976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.017040:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.017173:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.017226:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.023397:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463104 00000100:00100000:0.0:1788876950.023410:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463104 00000100:00100000:0.0:1788876950.023471:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788876950.023488:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532463104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.023659:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532463104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (6485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.023672:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788876950.023755:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788876950.025097:0:53135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788876950.025226:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788876950.025271:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788876950.025288:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.025304:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.025317:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788876950.025321:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 84 10000000:01000000:3.0:1788876950.025324:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788876950.025374:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.025383:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.025396:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876950.025430:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.025521:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.025595:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c34e99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.025771:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463232 00000100:00100000:0.0:1788876950.025780:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463232 00000100:00100000:0.0:1788876950.025833:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788876950.025844:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532463232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.025859:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876950.025875:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221600/0xf5bf0f7e313b012c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0125 expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.025907:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221600/0xf5bf0f7e313b012c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0125 expref: 19 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.025919:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221600/0xf5bf0f7e313b012c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0125 expref: 19 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.025929:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221600, rc 0) 00000100:00100000:0.0:1788876950.025983:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532463232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.025990:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788876950.026643:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876950.026672:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.026685:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.026767:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.026829:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.026875:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876950.026945:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463360 00000100:00100000:3.0:1788876950.026954:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463360 00000100:00100000:3.0:1788876950.026998:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788876950.027007:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c48fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532463360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788876950.027029:0:53037:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788876950.027054:0:53037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788876950.027058:0:53037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788876950.027061:0:53037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788876950.027065:0:53037:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788876950.027068:0:53037:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 87 00000100:00100000:3.0:1788876950.027195:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c48fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532463360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876950.027203:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788876950.027346:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788876950.027431:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788876950.027439:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.027448:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876950.027456:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788876950.027459:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788876950.027462:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788876950.027495:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.027502:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.027511:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.027524:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.027555:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.027575:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876950.028269:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463488 00000100:00100000:3.0:1788876950.028279:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463488 00000100:00100000:3.0:1788876950.028325:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788876950.028334:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532463488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876950.028347:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876950.028364:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b013a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0133 expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.028390:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b013a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0133 expref: 20 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.028407:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b013a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0133 expref: 20 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.028417:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9600, rc 0) 00000100:00100000:3.0:1788876950.028480:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876950.028487:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788876950.028765:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.028785:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.028795:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.028952:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.028996:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.029029:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.029191:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463616 00000100:00100000:0.0:1788876950.029198:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463616 00000100:00100000:0.0:1788876950.029237:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788876950.029246:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.029431:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efde2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.029440:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788876950.029493:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.029534:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.029593:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.029652:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788876950.029658:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463744 00000100:00100000:3.0:1788876950.029665:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463744 00000100:00100000:3.0:1788876950.029700:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788876950.029707:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.034793:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4878us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876950.034803:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.034819:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:3.0:1788876950.035806:0:53137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788876950.045030:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788876950.045080:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788876950.045103:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.045115:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876950.045126:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788876950.045128:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:1.0:1788876950.045131:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788876950.045174:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.045182:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.045193:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.045221:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.045303:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.045358:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.045380:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532463872 00000100:00100000:0.0:1788876950.045400:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532463872 00000100:00100000:0.0:1788876950.045478:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788876950.045489:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532463872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.045508:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876950.045528:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3220400/0xf5bf0f7e313b0148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0141 expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.045581:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3220400/0xf5bf0f7e313b0148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0141 expref: 21 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.045594:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3220400/0xf5bf0f7e313b0148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0141 expref: 21 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.045644:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3220400, rc 0) 00000100:00100000:0.0:1788876950.045729:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532463872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.045737:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788876950.045861:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532463872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876950.045882:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.045894:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.045911:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788876950.045916:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.045923:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.045930:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788876950.045932:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788876950.045935:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788876950.045955:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.045963:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.045971:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876950.045985:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.046022:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.046056:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f36523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.046128:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464000 00000100:00100000:0.0:1788876950.046136:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464000 00000100:00100000:0.0:1788876950.046189:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788876950.046200:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532464000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.046214:0:53040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876950.046227:0:53040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313b0156 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b014f expref: -99 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.046249:0:53040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313b0156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b014f expref: 22 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.046259:0:53040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313b0156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b014f expref: 22 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.046268:0:53040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221200, rc 0) 00000100:00100000:0.0:1788876950.046315:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532464000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.046321:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788876950.046398:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876950.046409:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.046417:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.046434:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788876950.046439:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.046446:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788876950.046454:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788876950.046456:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:3.0:1788876950.046459:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788876950.046475:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.046482:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.046490:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876950.046503:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.046533:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.046561:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f36523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876950.046652:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464128 00000100:00100000:1.0:1788876950.046657:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464128 00000100:00100000:1.0:1788876950.046689:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788876950.046698:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532464128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876950.046707:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876950.046716:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef40000/0xf5bf0f7e313b0164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b015d expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.046729:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef40000/0xf5bf0f7e313b0164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b015d expref: 23 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.046736:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef40000/0xf5bf0f7e313b0164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b015d expref: 23 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.046743:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40000, rc 0) 00000100:00100000:1.0:1788876950.046773:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876950.046779:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788876950.046875:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788876950.046884:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876950.046891:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876950.046934:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.046956:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.046978:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f36523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.047684:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464256 00000100:00100000:0.0:1788876950.047690:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464256 00000100:00100000:0.0:1788876950.047721:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788876950.047729:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.047832:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.047839:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788876950.047906:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.047933:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788876950.047975:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876950.048002:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f36523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876950.048052:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464384 00000100:00100000:1.0:1788876950.048056:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464384 00000100:00100000:1.0:1788876950.048085:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788876950.048101:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.048184:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876950.048192:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788876950.048260:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788876950.049488:0:53138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788876950.049747:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788876950.049779:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788876950.049789:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.049800:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876950.049811:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788876950.049814:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:1.0:1788876950.049817:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788876950.049845:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.049853:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.049862:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.049879:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.049924:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.049960:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.050010:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464512 00000100:00100000:0.0:1788876950.050015:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464512 00000100:00100000:0.0:1788876950.050049:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788876950.050057:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532464512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788876950.050070:0:53038:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788876950.050083:0:53038:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313b0172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b016b expref: -99 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.050117:0:53038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313b0172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b016b expref: 24 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.050129:0:53038:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313b0172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b016b expref: 24 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.050139:0:53038:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a12c3221e00, rc 0) 00000100:00100000:0.0:1788876950.050194:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532464512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876950.050201:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788876950.050277:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788876950.050291:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876950.050300:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876950.050352:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788876950.050378:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876950.050440:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788876950.064207:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464640 00000100:00100000:0.0:1788876950.064226:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464640 00000100:00100000:0.0:1788876950.064297:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788876950.064308:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532464640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788876950.064451:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532464640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (14071us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788876950.064460:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788876950.068920:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532464640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788876950.068968:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788876950.068978:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.068990:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876950.826386:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876951.855485:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876952.238862:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876952.238909:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876952.238945:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876952.238984:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876952.239025:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301120 00000100:00100000:1.0:1788876952.239039:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301120 00000100:00100000:1.0:1788876952.239116:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300992 00000100:00100000:1.0:1788876952.239119:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300992 00000100:00100000:1.0:1788876952.239147:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1449 00000100:00100000:1.0:1788876952.239158:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511301120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876952.239249:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511301120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876952.239257:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1449 00000100:00100000:1.0:1788876952.239277:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1450 00000100:00100000:1.0:1788876952.239284:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511300992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876952.239310:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511300992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876952.239318:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1450 00000100:00080000:1.0:1788876952.239338:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876952.239343:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788876952.239515:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300864 00000100:00100000:3.0:1788876952.239520:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300864 00000100:00100000:3.0:1788876952.239570:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1892 00000100:00100000:3.0:1788876952.239578:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511300864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876952.239644:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511300864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876952.239650:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1892 00000100:00100000:0.0:1788876952.240058:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511300736 00000100:00100000:0.0:1788876952.240065:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511300736 00000100:00100000:0.0:1788876952.240110:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1788876952.240118:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511300736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876952.240163:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511300736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876952.240170:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00080000:1.0:1788876952.240842:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788876952.874902:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876953.067157:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532464768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876953.067223:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876953.072144:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464768 00000100:00100000:2.0:1788876953.072158:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464768 00000100:00100000:2.0:1788876953.072250:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788876953.072261:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532464768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876953.072292:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491901376 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876953.072383:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532464768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.072390:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788876953.072442:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532464768:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788876953.072559:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876953.577159:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876953.577166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876953.577169:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876953.577181:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876953.577216:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb270000 x1875771532465024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876953.577231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876953.577234:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876953.577236:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876953.577240:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876953.577250:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb272a00 x1875771532465152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876953.577272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876953.577275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876953.577277:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876953.577281:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876953.577290:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb270380 x1875771532465408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876953.577307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788876953.577311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876953.577312:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876953.577316:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876953.577325:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb271500 x1875771532465792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788876953.577349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788876953.577352:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788876953.577354:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d0608800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788876953.577358:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13d0608800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788876953.577366:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb271880 x1875771532466432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876953.577894:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.577959:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578008:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578032:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578056:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788876953.578061:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532464896:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578097:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578118:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532465920:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578138:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578171:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532465024:0@lo:38:kworker.0 00000100:00100000:3.0:1788876953.578193:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578208:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532465152:0@lo:38:kworker.0 00000100:00100000:3.0:1788876953.578224:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578235:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532465408:0@lo:38:kworker.0 00000100:00100000:3.0:1788876953.578251:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578264:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532465792:0@lo:38:kworker.0 00000100:00100000:3.0:1788876953.578278:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578289:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532466432:0@lo:38:kworker.0 00000100:00100000:3.0:1788876953.578305:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.578334:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465664 00000100:00100000:3.0:1788876953.578340:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465664 00000100:00100000:3.0:1788876953.578374:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466304 00000100:00100000:3.0:1788876953.578376:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466304 00000100:00100000:3.0:1788876953.578408:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1788876953.578416:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532465664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578460:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532465664:12345-0@lo:400:kworker.0 Request processed in 44us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.578467:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1788876953.578481:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1788876953.578487:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532466304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578511:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532466304:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.578517:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1788876953.578723:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532464896 00000100:00100000:3.0:1788876953.578727:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532464896 00000100:00100000:3.0:1788876953.578752:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788876953.578760:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532464896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.578803:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532464896:12345-0@lo:400:kworker.0 Request processed in 30us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.578811:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788876953.578835:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465024 00000100:00100000:3.0:1788876953.578838:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465024 00000100:00100000:3.0:1788876953.578858:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1788876953.578862:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532465024:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.578884:0:13623:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a13c3000800, cookie 0xf5bf0f7e313affe3 00010000:00080000:3.0:1788876953.578890:0:13623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a13c3000800 cur 1941 last 1788876948 00000004:00100000:3.0:1788876953.578907:0:13623:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876953.579034:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e64800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876953.579087:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532465024:12345-0@lo:38:kworker.0 Request processed in 224us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579094:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1788876953.579113:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465920 00000100:00100000:3.0:1788876953.579117:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465920 00000100:00100000:3.0:1788876953.579139:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465152 00000100:00100000:3.0:1788876953.579142:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465152 00000100:00100000:3.0:1788876953.579150:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465408 00000100:00100000:3.0:1788876953.579152:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465408 00000100:00100000:3.0:1788876953.579159:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465792 00000100:00100000:3.0:1788876953.579161:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465792 00000100:00100000:3.0:1788876953.579169:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466432 00000100:00100000:3.0:1788876953.579171:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466432 00000100:00100000:3.0:1788876953.579180:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1788876953.579187:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532465920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.579216:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532465920:12345-0@lo:400:kworker.0 Request processed in 30us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579222:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1788876953.579234:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:3.0:1788876953.579238:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532465152:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.579250:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1941 last 0 00000020:00000080:3.0:1788876953.579279:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313b0179 00000004:00100000:3.0:1788876953.579286:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876953.579301:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e61800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876953.579326:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532465152:12345-0@lo:38:kworker.0 Request processed in 87us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579333:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:3.0:1788876953.579345:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:3.0:1788876953.579349:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532465408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.579360:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1941 last 0 00000020:00000080:3.0:1788876953.579379:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313b0180 00000004:00100000:3.0:1788876953.579384:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876953.579398:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13ff33b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876953.579422:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532465408:12345-0@lo:38:kworker.0 Request processed in 71us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579428:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:3.0:1788876953.579439:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1788876953.579443:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532465792:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.579453:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1941 last 0 00000020:00000080:3.0:1788876953.579473:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313b0187 00000004:00100000:3.0:1788876953.579478:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876953.579491:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a13eefda800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876953.579517:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532465792:12345-0@lo:38:kworker.0 Request processed in 73us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579523:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1788876953.579535:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1788876953.579538:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532466432:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.579552:0:6540:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 1941 last 0 00000020:00000080:3.0:1788876953.579571:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313b018e 00000004:00100000:3.0:1788876953.579578:0:6540:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788876953.579591:0:6540:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788876953.579635:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532466432:12345-0@lo:38:kworker.0 Request processed in 95us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.579642:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00080000:3.0:1788876953.579663:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876953.579667:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788876953.579682:0:53065:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788876953.579686:0:53065:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 85899345923 00000020:00080000:3.0:1788876953.579691:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.579694:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 85899345923, next_transno: 85899345923 00010000:00080000:3.0:1788876953.579698:0:53065:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (85899345923) 00000020:00080000:3.0:1788876953.579700:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.579710:0:53065:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511292800 t85899345923 from 192.168.203.11@tcp req@ffff8a13fad1ed80 x1875771511292800/t0(85899345923) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:345/0 lens 528/0 e 0 to 0 dl 1788876960 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.579865:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 21 00000100:00080000:3.0:1788876953.579875:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788876953.579880:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788876953.579882:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1788876953.579886:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788876953.579889:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:3.0:1788876953.579912:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532464896:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.579925:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532465920:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.579938:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788876953.579948:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532466304:0@lo:400:kworker.0 00000004:00080000:3.0:1788876953.580344:0:53065:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 582us 00000100:00100000:1.0:1788876953.583844:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532465536:0@lo:400:kworker.0 00000100:00100000:1.0:1788876953.583914:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.583954:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532466176:0@lo:400:kworker.0 00000100:00100000:1.0:1788876953.583978:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.584003:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788876953.584010:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788876953.584032:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.584050:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532466048:0@lo:400:kworker.0 00000100:00100000:1.0:1788876953.584084:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.584122:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465536 00000100:00100000:1.0:1788876953.584128:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465536 00000100:00100000:1.0:1788876953.584180:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1788876953.584188:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532465536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876953.584240:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532465536:12345-0@lo:400:kworker.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876953.584247:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1788876953.584402:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532465536:0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.589314:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466176 00000100:00100000:2.0:1788876953.589330:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466176 00000100:00100000:2.0:1788876953.589388:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532465280 00000100:00100000:2.0:1788876953.589391:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532465280 00000100:00100000:2.0:1788876953.589416:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1788876953.589426:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532466176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.589514:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532466176:12345-0@lo:400:kworker.0 Request processed in 90us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.589521:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1788876953.589537:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1788876953.589543:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532465280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.589569:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532465280:12345-0@lo:400:kworker.0 Request processed in 27us (5536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.589575:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1788876953.589775:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532465280:0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.589802:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532466176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.589846:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532466560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876953.589885:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876953.589928:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466048 00000100:00100000:2.0:1788876953.589932:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466048 00000100:00100000:2.0:1788876953.589954:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466560 00000100:00100000:2.0:1788876953.589957:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466560 00000100:00100000:2.0:1788876953.589967:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1788876953.589972:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3665:x1875771532466048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.590008:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3665:x1875771532466048:12345-0@lo:400:kworker.0 Request processed in 35us (5923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.590014:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1788876953.590025:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788876953.590031:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532466560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876953.590055:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876953.590099:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532466560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.590105:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788876953.590132:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532466048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876953.590156:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f521b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532466560:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788876953.590207:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788876953.590211:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876953.590555:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532465024:0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.590578:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb272a00 x1875771532465152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.590594:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 21 00000100:00080000:3.0:1788876953.591437:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a13eb272a00 x1875771532465152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.591448:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876953.591453:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876953.591456:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876953.591461:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532465152:0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.591479:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb270380 x1875771532465408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.591490:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 21 00000100:00080000:3.0:1788876953.592326:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13eb270380 x1875771532465408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.592336:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876953.592341:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876953.592344:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876953.592349:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532465408:0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.592374:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb271500 x1875771532465792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.592386:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 21 00000100:00080000:3.0:1788876953.593275:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13eb271500 x1875771532465792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876978 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.593284:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1788876953.593287:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876953.593291:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1788876953.593296:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532465792:0@lo:38:kworker.0 00010000:00080000:3.0:1788876953.593316:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb271880 x1875771532466432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788876963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.593327:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 21 00000100:00080000:3.0:1788876953.593332:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788876953.593336:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788876953.593338:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d0608800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788876953.593342:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532466432:0@lo:38:kworker.0 00010000:00080000:0.0:1788876953.593559:0:53273:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1788876953.593564:0:53273:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1788876953.593569:0:53273:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1788876953.594094:0:53273:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1788876953.599200:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532466688:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876953.599274:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.599333:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466688 00000100:00100000:3.0:1788876953.599340:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466688 00000100:00100000:3.0:1788876953.599384:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788876953.599392:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532466688:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788876953.599412:0:13623:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a12c91f5180 x1875771532466688/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:349/0 lens 224/0 e 0 to 0 dl 1788876964 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876953.599428:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532466688:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 38us (155us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788876953.599434:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00010000:00010000:3.0:1788876953.629680:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.629705:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.629723:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.629735:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.629742:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.629749:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630147:0:53065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630156:0:53065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630163:0:53065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630170:0:53065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876953.630174:0:53065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630182:0:53065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630193:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d9f51300) 00010000:00010000:3.0:1788876953.630197:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876953.630201:0:53065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630207:0:53065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0195 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876953.630222:0:53065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003039b535 reply state 00000000a17a9b47 transno 85899345923 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630233:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.630239:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d9f51000) 00010000:00010000:3.0:1788876953.630242:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876953.630245:0:53065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788876953.630343:0:53065:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788876953.630362:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.630366:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345924 00000020:00080000:3.0:1788876953.630370:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.630372:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345924 00000100:00100000:0.0:1788876953.637676:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876953.637804:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511293312 00000100:00100000:1.0:1788876953.637814:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511293312 00000100:00100000:1.0:1788876953.637869:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2695 00000100:00100000:1.0:1788876953.637879:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511293312:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:1.0:1788876953.637897:0:8722:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 85899345924, current: 85899345924, replaying 00000100:00100000:1.0:1788876953.637911:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511293312:12345-192.168.203.11@tcp:36:rm.0 Request processed in 35us (245us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876953.637918:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2695 00000020:00080000:1.0:1788876953.637933:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876953.637938:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 85899345924, next_transno: 85899345924 00010000:00080000:1.0:1788876953.637942:0:53065:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (85899345924) 00000020:00080000:1.0:1788876953.637945:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876953.637954:0:53065:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511293312 t85899345924 from 192.168.203.11@tcp req@ffff8a13eb270a80 x1875771511293312/t0(85899345924) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:349/0 lens 512/0 e 0 to 0 dl 1788876964 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788876953.638033:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638048:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638060:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638085:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638094:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638100:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638194:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638202:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638209:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638414:0:53065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638423:0:53065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638430:0:53065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638440:0:53065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876953.638444:0:53065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638452:0:53065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638463:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x111:0x0].0x0 (ffff8a13d3620300) 00010000:00010000:1.0:1788876953.638466:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788876953.638470:0:53065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638476:0:53065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b01b1 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x111:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638493:0:53065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638500:0:53065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638506:0:53065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638510:0:53065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876953.638513:0:53065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638518:0:53065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638529:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d3620800) 00010000:00010000:1.0:1788876953.638531:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876953.638534:0:53065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638540:0:53065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b01a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876953.638551:0:53065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025f9d879 reply state 00000000b3ea190a transno 85899345924 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638561:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.638567:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d9f51000) 00010000:00010000:1.0:1788876953.638569:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876953.638572:0:53065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1788876953.638660:0:53065:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1788876953.638672:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876953.638675:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345925 00000020:00080000:1.0:1788876953.638678:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1788876953.638680:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345925 00000001:00080000:2.0:1788876953.640774:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 85899345923 is committed 00010000:00010000:3.0:1788876953.641130:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641141:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641150:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641156:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876953.641159:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641167:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641182:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d9f51000) 00010000:00010000:3.0:1788876953.641185:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876953.641190:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.641197:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b019c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876953.660289:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876953.661223:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511294336 00000100:00100000:1.0:1788876953.661234:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511294336 00000100:00100000:1.0:1788876953.661305:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2696 00000100:00100000:1.0:1788876953.661315:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511294336:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:1.0:1788876953.661338:0:6541:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 85899345925, current: 85899345925, replaying 00000100:00100000:1.0:1788876953.661361:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511294336:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 48us (1083us total) trans 0 rc 0/-999 00000100:00100000:1.0:1788876953.661369:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2696 00000020:00080000:3.0:1788876953.663157:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.663164:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 85899345925, next_transno: 85899345925 00010000:00080000:3.0:1788876953.663169:0:53065:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (85899345925) 00000020:00080000:3.0:1788876953.663172:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.663185:0:53065:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511294336 t85899345925 from 192.168.203.11@tcp req@ffff8a12c91f6300 x1875771511294336/t0(85899345925) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:349/0 lens 520/0 e 0 to 0 dl 1788876964 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788876953.663328:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663344:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663357:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663370:0:53065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663378:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663385:0:53065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663751:0:53065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663759:0:53065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663766:0:53065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663772:0:53065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876953.663777:0:53065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663784:0:53065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663796:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13ca177100) 00010000:00010000:3.0:1788876953.663799:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876953.663803:0:53065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663811:0:53065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b01b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788876953.663829:0:53065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bf1ac55 reply state 00000000bf41eaf0 transno 85899345925 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663839:0:53065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.663845:0:53065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13ca177c00) 00010000:00010000:3.0:1788876953.663848:0:53065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788876953.663851:0:53065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788876953.663930:0:53065:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788876953.663946:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.663949:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345926 00000020:00080000:3.0:1788876953.663952:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788876953.663955:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 85899345926 00000100:00100000:1.0:1788876953.688623:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876953.690020:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301248 00000100:00100000:0.0:1788876953.690032:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301248 00000100:00100000:0.0:1788876953.690108:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1895 00000100:00100000:0.0:1788876953.690121:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511301248:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1788876953.690147:0:51736:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13fad1c700 x1875771511301248/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:349/0 lens 224/0 e 0 to 0 dl 1788876964 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876953.690168:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511301248:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 51us (1571us total) trans 0 rc 0/-999 00000100:00100000:0.0:1788876953.690175:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1895 00000020:00080000:0.0:1788876953.690196:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876953.690200:0:53065:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 85899345926 00010000:00080000:0.0:1788876953.690204:0:53065:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1788876953.690207:0:53065:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1788876953.690215:0:53065:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1788876953.690219:0:53065:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1788876953.690326:0:53065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 21, last_transno is 90194313216 00000001:00100000:0.0:1788876953.703099:0:53033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:0.0:1788876953.703111:0:53033:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1788876953.703133:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 85899345925 is committed 00000001:00080000:0.0:1788876953.703187:0:53065:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1788876953.703237:0:53065:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1788876953.703253:0:53065:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a12c91f5180 x1875771532466688/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:349/0 lens 224/0 e 0 to 0 dl 1788876964 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788876953.703302:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703316:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703325:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703333:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876953.703338:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703352:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703369:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d9f51000) 00010000:00010000:3.0:1788876953.703373:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876953.703378:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703384:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b01aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703409:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703416:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703421:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703426:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876953.703429:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703435:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703443:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13ca177c00) 00010000:00010000:3.0:1788876953.703445:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876953.703448:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876953.703454:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b01bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 53065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788876953.703523:0:53065:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13fad1c700 x1875771511301248/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:349/0 lens 224/0 e 0 to 0 dl 1788876964 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.703543:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1788876953.703552:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a13eb272680 x1875771532466688/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876969 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.703563:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a13eb272680 x1875771532466688/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876969 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788876953.703571:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1788876953.703585:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:0.0:1788876953.703592:0:53065:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1788876953.703593:0:3661:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000749ac80d): req@ffff8a13eb14bb80 x1875771532444288/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788876937 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876953.703635:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532466688:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1788876953.703729:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.703767:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532466816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876953.703791:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.703825:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532444288 00000100:00100000:3.0:1788876953.703830:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532444288 00000100:00100000:3.0:1788876953.703862:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466816 00000100:00100000:3.0:1788876953.703865:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466816 00000100:00100000:3.0:1788876953.703878:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788876953.703886:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3662:x1875771532444288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876953.703912:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876953.703948:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3662:x1875771532444288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.703957:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788876953.703971:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788876953.703976:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532466816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876953.703986:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876953.704010:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532466816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.704015:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788876953.704045:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532466816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876953.704067:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532444288:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1788876953.739621:0:53065:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620879b7e10 00100000:10000000:0.0:1788876953.739635:0:53065:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788876953.741729:0:53053:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876953.741779:0:53053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:53053:1875771532466944:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876953.741847:0:53053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.741878:0:53053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b986c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788876953.741899:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532466944 00000100:00100000:1.0:1788876953.741905:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532466944 00000100:00100000:1.0:1788876953.741948:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1788876953.741956:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:53053:x1875771532466944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788876953.741981:0:43959:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -178 00002000:02000040:1.0:1788876953.741986:0:43959:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:737) 00000004:00080000:2.0:1788876953.745169:0:53051:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788876953.745218:0:53051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3024000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:53051:1875771532467072:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788876953.745278:0:53051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876953.745305:0:53051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db900 going to sleep for 11 seconds 00000100:00100000:2.0:1788876953.745333:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467072 00000100:00100000:2.0:1788876953.745340:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467072 00000100:00100000:2.0:1788876953.745386:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788876953.745394:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f521b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:53051:x1875771532467072:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788876953.745418:0:43960:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -178 00002000:02000040:2.0:1788876953.745422:0:43960:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:737) 00002000:00010000:1.0:1788876953.758631:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.758644:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.758661:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.758666:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.758672:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.758689:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.758700:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.758708:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.759583:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876953.759895:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.759902:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.759916:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.759920:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.759925:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.759937:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.759946:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.759953:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764883:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.764898:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764912:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.764917:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764929:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764952:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764959:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad288dae/0xf5bf0f7e313b01c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764987:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.764991:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.764998:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.765001:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.765009:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.765024:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.765031:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.765772:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876953.765790:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084427fc/0xf5bf0f7e313b01cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.765823:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.766283:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.766290:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766302:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.766307:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.766312:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766325:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766334:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766341:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766356:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.766363:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.766368:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766375:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.766379:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766387:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766399:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766406:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006305e6b1/0xf5bf0f7e313b01d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766419:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766420:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766422:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.766463:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.766468:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766476:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.766480:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.766484:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766493:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766507:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766514:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766527:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.766534:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.766538:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766545:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.766548:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766556:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766566:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766572:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000176b0903/0xf5bf0f7e313b01db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766584:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766586:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766588:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.766646:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.766652:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766661:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.766664:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.766668:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766676:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766683:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766689:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766701:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.766707:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.766711:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766718:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.766721:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766734:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766744:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766751:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b01e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766764:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766766:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766767:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.766812:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.766817:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766825:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.766828:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.766832:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766841:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766849:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766856:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766873:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.766880:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.766883:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766889:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.766892:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766899:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766909:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766915:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b11993fe/0xf5bf0f7e313b01e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766926:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766928:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.766929:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.766967:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.766973:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766980:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.766982:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.766985:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766993:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.766999:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767005:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767016:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.767021:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.767024:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767031:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.767364:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767376:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767388:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767396:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001633982d/0xf5bf0f7e313b01f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.767409:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.767411:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.767413:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.767567:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.767571:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.767754:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.767761:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767770:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.767773:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.767778:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767875:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767885:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767892:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767907:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.767946:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.767952:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767961:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.767964:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.767968:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767977:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767985:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.767992:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768007:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876953.768015:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.768018:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768025:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.768029:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788876953.768312:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788876953.768328:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.768332:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.768339:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.768343:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.768351:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.768364:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.768372:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030540fb2/0xf5bf0f7e313b01fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.768387:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.768388:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.768390:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.768425:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768437:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768444:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8bc20e9/0xf5bf0f7e313b01f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768457:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.768459:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.768461:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.768507:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.768513:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768520:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.768523:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.768527:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768535:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768543:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768551:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768579:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.768638:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.768643:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768650:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.768653:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.768656:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768666:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768675:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768682:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768696:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876953.768703:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.768706:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768713:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.768716:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768724:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768733:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768740:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076fd9dbf/0xf5bf0f7e313b0205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768751:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.768754:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768760:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3220a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.768763:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768771:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768838:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768847:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd98264b/0xf5bf0f7e313b020c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768860:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.768861:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.768863:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.768905:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.768910:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768917:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.768920:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.768924:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768933:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768941:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768948:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768959:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.768965:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.768968:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768981:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.768984:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.768992:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769002:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769010:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083fb9f6/0xf5bf0f7e313b0213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769021:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769023:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769024:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.769142:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.769148:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769155:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.769158:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.769163:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769173:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769182:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769189:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769202:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.769207:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.769211:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769217:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.769221:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769229:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769240:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769248:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b63f865/0xf5bf0f7e313b021a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769260:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769262:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769264:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.769298:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.769303:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769311:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.769314:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.769318:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769327:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769335:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769342:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769352:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.769358:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.769361:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769368:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.769372:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769385:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769395:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769402:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d237399/0xf5bf0f7e313b0221 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769413:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769414:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769416:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.769449:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.769454:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769462:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.769465:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.769469:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769478:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769485:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769494:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769505:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.769511:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.769514:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769520:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.769523:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769530:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769540:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769547:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a4c4832/0xf5bf0f7e313b0228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769560:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769561:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769563:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.769624:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.769630:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769638:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.769641:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.769645:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769653:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769662:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769669:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769680:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.769685:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.769689:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769695:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.769698:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769705:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769715:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769722:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82fac18/0xf5bf0f7e313b022f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.769733:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769735:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.769737:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.769771:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.769777:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.770881:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.771687:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.771691:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.771697:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771712:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771722:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771729:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771795:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.771872:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.771878:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771887:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.771890:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.771893:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771902:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771910:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.771918:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788876953.773172:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.773181:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.773193:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.773197:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.773202:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.773217:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.773227:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.773235:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775012:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788876953.775025:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775046:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.775052:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775063:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775094:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775102:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025ea6be4/0xf5bf0f7e313b0236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775130:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876953.775564:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775574:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.775578:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775586:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775599:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775623:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.775627:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775634:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.775637:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775645:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775655:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.775663:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.775665:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.775667:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.775792:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876953.775800:0:43959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044ea4211/0xf5bf0f7e313b023d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.775827:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.775970:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.775976:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.775987:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.775991:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.775997:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776008:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776016:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776025:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776196:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.776205:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.776210:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776217:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.776221:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776229:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776240:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776248:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f29465/0xf5bf0f7e313b024b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776261:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776262:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776264:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.776307:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.776313:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776321:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.776324:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.776328:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776337:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776345:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776352:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776371:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.776406:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.776411:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776418:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.776421:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.776425:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776434:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776441:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776448:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776461:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876953.776467:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.776471:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776477:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.776481:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776489:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776499:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776506:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4d64dc/0xf5bf0f7e313b0252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776519:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.776522:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776528:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.776531:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776538:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776548:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776555:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f92da3a4/0xf5bf0f7e313b0259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776567:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776568:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776570:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.776627:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.776632:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776640:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.776643:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.776647:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776656:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776663:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776670:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776681:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.776687:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.776691:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776702:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.776705:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776712:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776722:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776728:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007cd7897/0xf5bf0f7e313b0260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776740:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776742:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776744:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.776790:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.776796:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776803:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.776806:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.776810:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776818:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776827:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776833:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776845:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.776851:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.776854:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776861:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.776864:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776872:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776881:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776888:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006744913e/0xf5bf0f7e313b0267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776900:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776902:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.776904:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.776945:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.776950:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776958:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.776961:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.776965:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776974:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776982:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.776989:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777000:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.777006:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.777009:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777016:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.777019:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777031:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777165:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777173:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da7ae5c/0xf5bf0f7e313b026e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777186:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777188:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777190:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.777229:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.777234:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777241:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.777244:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.777248:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777257:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777264:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777272:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777284:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.777289:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.777293:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777299:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.777302:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777310:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777319:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777326:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aff4397/0xf5bf0f7e313b0275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777338:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777340:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777342:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.777377:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.777383:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777391:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.777394:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.777398:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777407:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777414:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777422:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777433:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.777439:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.777442:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777449:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400587600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.777452:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777459:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777469:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777476:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d86225b1/0xf5bf0f7e313b027c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777488:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777490:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777492:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.777526:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.777531:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777539:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.777542:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.777546:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777554:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777562:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777569:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777587:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.777593:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.777597:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777621:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1400586000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.777625:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777633:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777643:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777650:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d00085/0xf5bf0f7e313b0283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777663:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777665:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.777666:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.777704:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.777710:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777717:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.777721:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.777725:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777733:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777741:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777748:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777760:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.777766:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.777769:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.777775:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.777877:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788876953.777885:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ae82a63/0xf5bf0f7e313b0244 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788876953.777986:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.777992:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778000:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778003:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778007:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778017:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778025:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778032:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778053:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788876953.778101:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778107:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778115:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778119:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778123:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778133:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778141:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778149:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778164:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788876953.778198:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778204:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778212:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778216:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778220:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778229:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778238:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778246:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778255:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788876953.778286:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778292:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778299:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778303:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778306:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778316:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778324:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778332:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778340:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788876953.778375:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778380:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778388:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778391:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778395:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778404:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778412:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778420:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778428:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788876953.778463:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778468:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778477:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778480:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778484:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778493:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778502:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778509:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778517:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788876953.778550:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778555:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778562:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778565:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778570:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778579:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778587:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778595:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778632:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788876953.778667:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778671:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778679:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778682:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778686:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778695:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778709:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778717:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778726:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788876953.778758:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.778763:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.778771:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.778774:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.778778:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.778952:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.778967:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.778984:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.778996:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d03c6a8/0xf5bf0f7e313b028a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779014:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788876953.779018:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779025:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779028:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779093:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779105:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779113:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002501da0a/0xf5bf0f7e313b0291 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779129:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788876953.779133:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779139:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779143:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779151:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779159:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779166:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cce7dc9/0xf5bf0f7e313b0298 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779177:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788876953.779181:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779186:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779189:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779196:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779205:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779212:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000375d75ce/0xf5bf0f7e313b029f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779223:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788876953.779226:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779232:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779235:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779242:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779250:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779257:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe4717c7/0xf5bf0f7e313b02a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779267:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788876953.779270:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779276:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779279:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779291:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779299:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779306:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eccb19c/0xf5bf0f7e313b02ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779316:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788876953.779319:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779325:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779328:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779335:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779344:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779351:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed62efc9/0xf5bf0f7e313b02b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779366:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.779370:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779376:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779379:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779386:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779395:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779402:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbaea817/0xf5bf0f7e313b02bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779411:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.779415:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779421:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.779424:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779435:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779444:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779451:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c724278e/0xf5bf0f7e313b02c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.779460:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.779462:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.779464:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.780114:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.780124:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.780131:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.780153:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876953.781178:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.781186:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781195:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.781199:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781209:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781227:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781235:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308b3909/0xf5bf0f7e313b02c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781255:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.781257:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.781259:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876953.781347:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.781359:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781370:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.781375:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.781381:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781392:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781400:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781408:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781423:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876953.781430:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.781434:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781441:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.781445:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781453:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781464:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781477:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd49438/0xf5bf0f7e313b02d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781490:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.781491:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.781493:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876953.781531:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.781537:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.781544:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.781547:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.781551:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782442:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782459:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782467:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782482:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876953.782492:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.782496:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782501:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.782505:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782512:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782525:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782532:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6e0269/0xf5bf0f7e313b02d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782546:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.782548:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.782550:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788876953.782619:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.782624:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782633:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.782636:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.782641:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782654:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782661:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782669:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782681:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876953.782687:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.782690:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782697:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.782701:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782709:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782718:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.782725:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d966557a/0xf5bf0f7e313b02de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.783214:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.783778:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.784022:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.784024:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.784026:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.784387:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.784396:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.784412:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.784416:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.784421:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.784437:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.784449:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.784458:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.784474:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.784482:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.784487:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788876953.784661:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788876953.784667:0:43959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.784677:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:2.0:1788876953.784680:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788876953.784685:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.784696:0:43959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.784705:0:43959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.784713:0:43959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.784725:0:43959:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788876953.785754:0:43959:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00010000:00010000:1.0:1788876953.785878:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.785885:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.785894:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.785899:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.785909:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.785926:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.785932:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e5942a8/0xf5bf0f7e313b02ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.785950:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.785952:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.785953:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788876953.786009:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788876953.786181:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:53053:x1875771532466944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 44220us (44329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876953.786190:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00010000:00010000:0.0:1788876953.786259:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefec00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.786263:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786272:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786284:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786290:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07be7ab/0xf5bf0f7e313b02e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786305:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786306:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786308:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.786407:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.786414:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786423:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.786426:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.786431:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786441:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786449:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786457:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786471:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.786479:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.786483:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786489:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.786492:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786511:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786522:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786529:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002758702/0xf5bf0f7e313b02f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786541:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786543:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786545:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.786582:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.786587:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786595:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.786598:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.786620:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786629:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786637:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786644:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786660:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.786667:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.786671:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786678:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.786681:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786688:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786698:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786706:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b02fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786718:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786719:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.786721:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.786755:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.786760:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786767:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.786771:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.786775:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786796:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786804:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786812:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786824:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.786829:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.786833:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786839:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.786842:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786850:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786860:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.786872:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b0301 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788876953.787229:0:53053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:53053:1875771532466944:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788876953.787244:0:53053:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788876953.787317:0:53053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:53053:1875771532467328:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788876953.787359:0:53053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876953.787382:0:53053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d0b986c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788876953.787420:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.787421:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.787423:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.787469:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.787475:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787484:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.787487:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.787491:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787564:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787572:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787579:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787617:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.787658:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.787663:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787671:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.787674:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.787678:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787687:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787695:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787702:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787714:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788876953.787721:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876953.787725:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787732:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.787736:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787749:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787761:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787768:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b0308 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787844:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.787848:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787855:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.787858:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787866:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787877:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787884:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b030f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787902:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.787904:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.787906:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.787946:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.787951:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787958:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.787961:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.787965:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787974:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787981:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.787988:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788000:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.788006:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.788009:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788020:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffe00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.788024:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788031:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788041:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788048:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae0b3a8/0xf5bf0f7e313b0316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788059:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788061:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788063:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.788112:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.788117:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788124:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.788127:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.788131:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788140:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788148:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788155:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788166:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.788171:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.788175:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788181:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefea00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.788184:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788191:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788201:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788208:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b031d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788219:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788221:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788223:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.788255:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.788261:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788268:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.788271:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.788275:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788284:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788291:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788299:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788310:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.788316:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.788320:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788326:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.788330:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788342:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788351:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788359:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b0324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788371:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788372:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788374:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.788410:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.788414:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788422:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.788425:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.788429:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788437:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788445:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788452:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788463:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788876953.788468:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876953.788472:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788478:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876953.788481:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788489:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.788942:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.788983:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.788993:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b032b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789008:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.789010:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876953.789012:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788876953.789128:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.789134:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789142:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.789145:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.789150:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789159:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789168:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789176:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789229:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788876953.789266:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788876953.789272:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789279:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:0.0:1788876953.789283:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788876953.789288:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789298:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789307:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876953.789315:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876953.789407:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532467200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876953.789462:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876953.789519:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467328 00000100:00100000:3.0:1788876953.789525:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467328 00000100:00100000:3.0:1788876953.789565:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1788876953.789573:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:53053:x1875771532467328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788876953.789627:0:43953:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00010000:00010000:1.0:1788876953.790150:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876953.790156:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790165:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.790169:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790179:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790192:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790200:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b0332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790216:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.790220:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790227:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.790230:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790237:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790248:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.790256:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.790258:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.790260:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876953.791052:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:53053:x1875771532467328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1478us (3690us total) trans 4294967569 rc 0/0 00000100:00100000:3.0:1788876953.791060:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1788876953.791099:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467200 00000100:00100000:3.0:1788876953.791104:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467200 00000100:00100000:3.0:1788876953.791141:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1788876953.791148:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532467200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788876953.791163:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876953.791197:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532467200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876953.791203:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1788876953.791246:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532467200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876953.793404:0:53053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:53053:1875771532467328:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788876953.793422:0:53053:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00010000:00010000:0.0:1788876953.793661:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788876953.793671:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b0339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.795641:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.797102:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.797113:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797130:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.797134:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.797141:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797154:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797164:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797172:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797201:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876953.797239:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.797245:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797252:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.797255:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.797259:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797268:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797276:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797283:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797299:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788876953.797308:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788876953.797313:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797320:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.797325:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797334:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797349:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797356:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001633982d/0xf5bf0f7e313b0340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797373:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.797377:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797383:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.797386:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797393:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797401:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797409:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11993fe/0xf5bf0f7e313b0347 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797419:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797421:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797423:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.797459:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.797465:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797472:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.797475:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.797479:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797487:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797506:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797513:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797525:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.797532:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.797537:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797549:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.797552:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797560:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797570:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797577:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfc48e56/0xf5bf0f7e313b034e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797588:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797589:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797591:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.797647:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.797652:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797660:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.797663:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.797667:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797676:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797684:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797691:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797702:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.797708:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.797711:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797717:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.797721:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797728:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797738:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797745:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000176b0903/0xf5bf0f7e313b0355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.797757:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797759:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.797761:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.797968:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.798012:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.798018:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798026:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.798029:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.798042:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798051:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798059:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798066:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798162:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876953.798202:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.798207:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798215:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.798218:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.798222:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798231:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798239:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.798247:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800212:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876953.800224:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800236:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.800241:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800251:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800267:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800274:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006305e6b1/0xf5bf0f7e313b035c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800295:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.800299:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800305:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.800308:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800315:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800324:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800330:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.800332:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.800334:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.800406:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876953.800413:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084427fc/0xf5bf0f7e313b0363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.800573:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.800658:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.800664:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800675:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.800679:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.800684:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800697:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800710:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800717:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800761:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788876953.800875:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.800881:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800890:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.800893:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.800897:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800905:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800913:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.800918:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801231:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788876953.801236:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801244:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.801248:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801257:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801269:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801276:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007516dedd/0xf5bf0f7e313b036a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801290:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.801293:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801300:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.801303:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801310:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801319:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.801327:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.801329:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.801331:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.804183:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876953.804197:0:43960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad288dae/0xf5bf0f7e313b0371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788876953.804350:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.804357:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804370:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.804376:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.804382:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804395:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804406:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804413:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804432:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876953.804446:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876953.804452:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804460:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876953.804464:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804474:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804490:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804975:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0378 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.804991:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.804993:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876953.804994:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788876953.805120:0:43960:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788876953.805126:0:43960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.805134:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=1941s v=(0 0) 00010000:00010000:1.0:1788876953.805137:0:43960:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788876953.805141:0:43960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.805149:0:43960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.805157:0:43960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.805164:0:43960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876953.805176:0:43960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876953.805244:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876953.805252:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.805259:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788876953.805263:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.805271:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.805284:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.805292:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027de8643/0xf5bf0f7e313b037f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876953.805305:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.805307:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.805309:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876953.805315:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788876953.809376:0:43960:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:1.0:1788876953.809899:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f521b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:53051:x1875771532467072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 64501us (64615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876953.809909:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788876953.810131:0:53051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3024000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:53051:1875771532467072:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788876953.810148:0:53051:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788876953.810231:0:53051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:53051:1875771532467584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788876953.810271:0:53051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876953.810292:0:53051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788876953.810309:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467584 00000100:00100000:2.0:1788876953.810314:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467584 00000100:00100000:2.0:1788876953.810353:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1788876953.810361:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:53051:x1875771532467584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788876953.810401:0:43960:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:0.0:1788876953.810889:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532467456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876953.810926:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876953.810963:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467456 00000100:00100000:0.0:1788876953.810967:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467456 00000100:00100000:0.0:1788876953.810990:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1788876953.810995:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532467456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788876953.811007:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491646016 pending 896 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876953.811051:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532467456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876953.811057:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1788876953.811108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532467456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876953.814132:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:53051:x1875771532467584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3766us (3855us total) trans 8589934861 rc 0/0 00000100:00100000:2.0:1788876953.814144:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1788876953.814875:0:53051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:53051:1875771532467584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788876953.814892:0:53051:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00010000:00010000:1.0:1788876953.908462:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876954.090825:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532467712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876954.090912:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876954.093012:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467712 00000100:00100000:0.0:1788876954.093031:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467712 00000100:00100000:0.0:1788876954.093114:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1788876954.093126:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532467712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788876954.093154:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876954.093235:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532467712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876954.093242:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788876954.093428:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532467712:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788876954.097985:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788876954.287411:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876954.287454:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876954.287489:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876954.287513:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876954.287541:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876954.287573:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301504 00000100:00100000:1.0:1788876954.287583:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301504 00000100:00100000:1.0:1788876954.287649:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301632 00000100:00100000:1.0:1788876954.287653:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301632 00000100:00100000:1.0:1788876954.287684:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1896 00000100:00100000:1.0:1788876954.287695:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511301504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876954.287768:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511301504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876954.287779:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1896 00000100:00100000:1.0:1788876954.287797:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1897 00000100:00100000:1.0:1788876954.287804:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511301632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876954.287829:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511301632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876954.287836:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1897 00000100:00100000:1.0:1788876954.287856:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301760 00000100:00100000:1.0:1788876954.287859:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301760 00000100:00100000:1.0:1788876954.287882:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301888 00000100:00100000:1.0:1788876954.287884:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301888 00000100:00100000:1.0:1788876954.287904:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1455 00000100:00100000:1.0:1788876954.287911:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511301760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876954.287949:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511301760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876954.287956:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1455 00000100:00100000:1.0:1788876954.287967:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1456 00000100:00100000:1.0:1788876954.287973:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511301888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876954.287995:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511301888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876954.288000:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1456 00000100:00080000:1.0:1788876954.288017:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876954.288021:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876954.288023:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876954.288401:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511301376 00000100:00100000:0.0:1788876954.288406:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511301376 00000100:00100000:0.0:1788876954.288445:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:0.0:1788876954.288452:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511301376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876954.288491:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511301376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876954.288497:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000001:02000400:0.0:1788876954.295360:0:53319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788876954.921881:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788876955.277879:0:53372:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788876955.278200:0:53372:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788876955.956292:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788876956.586196:0:53422:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788876956.587590:0:53422:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788876956.968942:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876957.992904:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876958.188313:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532467840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876958.188385:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876958.188573:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467840 00000100:00100000:2.0:1788876958.188583:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467840 00000100:00100000:2.0:1788876958.188667:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1788876958.188678:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532467840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876958.188712:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876958.188767:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532467840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876958.188774:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788876958.188858:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532467840:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788876958.188966:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876958.696914:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532468096:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.696984:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697035:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532468608:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697069:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697097:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532469120:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697118:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697139:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788876958.697145:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532468224:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697164:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697178:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532468736:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697196:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697208:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532469248:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697233:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697369:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468608 00000100:00100000:0.0:1788876958.697376:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468608 00000100:00100000:0.0:1788876958.697425:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468224 00000100:00100000:0.0:1788876958.697428:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468224 00000100:00100000:0.0:1788876958.697442:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468736 00000100:00100000:0.0:1788876958.697444:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468736 00000100:00100000:0.0:1788876958.697463:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1788876958.697471:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532468608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697521:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532468608:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.697528:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1788876958.697543:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1788876958.697548:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532468224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697573:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532468224:12345-0@lo:400:kworker.0 Request processed in 25us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.697579:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1788876958.697589:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1788876958.697594:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532468736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697649:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532468736:12345-0@lo:400:kworker.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.697656:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00080000:0.0:1788876958.697671:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876958.697675:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876958.697685:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532468352:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697709:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697724:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532468864:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697741:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697755:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.697776:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.697787:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788876958.697792:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532467968:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698123:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468096 00000100:00100000:3.0:1788876958.698128:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468096 00000100:00100000:3.0:1788876958.698160:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788876958.698167:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698204:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532468096:12345-0@lo:400:kworker.0 Request processed in 37us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698211:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1788876958.698232:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469120 00000100:00100000:3.0:1788876958.698235:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469120 00000100:00100000:3.0:1788876958.698265:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469248 00000100:00100000:3.0:1788876958.698267:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469248 00000100:00100000:3.0:1788876958.698286:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468352 00000100:00100000:3.0:1788876958.698289:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468352 00000100:00100000:3.0:1788876958.698306:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788876958.698311:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532469120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698340:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532469120:12345-0@lo:400:kworker.0 Request processed in 29us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698347:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788876958.698358:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1788876958.698364:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532469248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698389:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532469248:12345-0@lo:400:kworker.0 Request processed in 26us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698395:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1788876958.698406:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1788876958.698411:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532468352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698437:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532468352:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698443:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1788876958.698553:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468864 00000100:00100000:3.0:1788876958.698557:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468864 00000100:00100000:3.0:1788876958.698575:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469376 00000100:00100000:3.0:1788876958.698577:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469376 00000100:00100000:3.0:1788876958.698589:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1788876958.698594:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532468864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698650:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532468864:12345-0@lo:400:kworker.0 Request processed in 55us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698657:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1788876958.698668:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1788876958.698674:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532469376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698700:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532469376:12345-0@lo:400:kworker.0 Request processed in 27us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.698706:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:3.0:1788876958.698747:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698773:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532468736:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698785:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532469248:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698796:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698808:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532468608:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.698820:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532469120:0@lo:400:kworker.0 00000100:00080000:3.0:1788876958.698873:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876958.698877:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876958.698879:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876958.699099:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.699142:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699167:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.699185:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532468992:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699215:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876958.699238:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532468352:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699250:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532468864:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699259:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699285:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468992 00000100:00100000:0.0:1788876958.699289:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468992 00000100:00100000:0.0:1788876958.699317:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1788876958.699323:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532468992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699360:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532468992:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.699367:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1788876958.699384:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532468480 00000100:00100000:0.0:1788876958.699387:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532468480 00000100:00100000:0.0:1788876958.699410:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:0.0:1788876958.699416:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532468480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699442:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532468480:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.699448:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:0.0:1788876958.699459:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876958.699473:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788876958.699483:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532468992:0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.700949:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532467968 00000100:00100000:3.0:1788876958.700960:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532467968 00000100:00100000:3.0:1788876958.700999:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788876958.701058:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532467968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876958.701120:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa54c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532467968:12345-0@lo:400:kworker.0 Request processed in 74us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876958.701127:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788876958.701724:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788876958.703963:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876958.703985:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532469504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876958.704067:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876958.704180:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469504 00000100:00100000:2.0:1788876958.704187:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469504 00000100:00100000:2.0:1788876958.704243:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1788876958.704255:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532469504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788876958.704288:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788876958.704345:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532469504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876958.704352:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788876958.704428:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532469504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876958.717945:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876958.718029:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302016 00000100:00100000:2.0:1788876958.718041:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302016 00000100:00100000:2.0:1788876958.718122:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2697 00000100:00100000:2.0:1788876958.718132:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:40303:x1875771511302016:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876958.718152:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876958.718176:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc370489f9 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718241:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718256:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718270:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876958.718320:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876958.718324:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876958.718361:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718384:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f9 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718402:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f9 expref: 7 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876958.718411:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:2.0:1788876958.718414:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876958.718418:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73c00, rc 0) 00000100:00100000:2.0:1788876958.718467:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40303:x1875771511302016:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 337us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876958.718475:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2697 00000100:00080000:1.0:1788876958.718708:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876958.734348:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876958.734415:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302144 00000100:00100000:2.0:1788876958.734426:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302144 00000100:00100000:2.0:1788876958.734488:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2698 00000100:00100000:2.0:1788876958.734498:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40303:x1875771511302144:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876958.734553:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876958.734644:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40303:x1875771511302144:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876958.734656:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2698 00000100:00100000:2.0:1788876958.746004:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876958.746087:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302272 00000100:00100000:1.0:1788876958.746099:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302272 00000100:00100000:1.0:1788876958.746186:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2699 00000100:00100000:1.0:1788876958.746198:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:40303:x1875771511302272:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876958.746231:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876958.746308:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:40303:x1875771511302272:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876958.746315:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2699 00000100:00080000:0.0:1788876958.746364:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876958.755328:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876958.755428:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302400 00000100:00100000:0.0:1788876958.755439:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302400 00000100:00100000:0.0:1788876958.755524:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1143 00000100:00100000:0.0:1788876958.755534:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40303:x1875771511302400:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876958.755565:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876958.755665:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40303:x1875771511302400:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 132us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876958.755673:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1143 00000100:00080000:1.0:1788876958.755796:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876958.772598:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876958.772772:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302528 00000100:00100000:2.0:1788876958.772785:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302528 00000100:00100000:2.0:1788876958.772872:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1144 00000100:00100000:2.0:1788876958.772883:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40303:x1875771511302528:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876958.772927:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876958.773008:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40303:x1875771511302528:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 127us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876958.773017:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1144 00000100:00080000:1.0:1788876958.773315:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788876959.017198:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876959.209349:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532469760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876959.209462:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876959.209535:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788876959.209541:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876959.209574:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876959.209635:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469632 00000100:00100000:3.0:1788876959.209647:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469632 00000100:00100000:3.0:1788876959.209717:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1788876959.209728:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532469632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876959.209756:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876959.209808:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532469632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876959.209815:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1788876959.209877:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876959.210097:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469760 00000100:00100000:0.0:1788876959.210102:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469760 00000100:00100000:0.0:1788876959.210137:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1788876959.210144:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532469760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876959.210178:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788876959.210229:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532469760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876959.210236:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1788876959.210265:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532469760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876959.210766:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532470016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788876959.210811:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876959.210841:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876959.210847:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532469888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876959.211137:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470016 00000100:00100000:2.0:1788876959.211143:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470016 00000100:00100000:2.0:1788876959.211233:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788876959.211242:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532470016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788876959.211264:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876959.211324:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876959.211335:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532470016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876959.211342:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788876959.211355:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532469888 00000100:00100000:2.0:1788876959.211357:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532469888 00000100:00100000:3.0:1788876959.211362:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532470016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876959.211377:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788876959.211382:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532469888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876959.211394:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876959.211424:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532469888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876959.211431:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:3.0:1788876959.211444:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532469888:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788876959.213794:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967569 is committed 00000001:00080000:1.0:1788876959.219256:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934861 is committed 00000100:00100000:3.0:1788876959.410521:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876959.411465:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302656 00000100:00100000:0.0:1788876959.411481:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302656 00000100:00100000:0.0:1788876959.411575:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1788876959.411588:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511302656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876959.411749:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511302656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 164us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876959.411758:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:0.0:1788876960.041791:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876961.073094:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876962.090714:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876963.119292:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876963.305098:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876963.305121:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532470144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876963.305191:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876963.305329:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470144 00000100:00100000:1.0:1788876963.305338:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470144 00000100:00100000:1.0:1788876963.305401:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1788876963.305411:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532470144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876963.305486:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876963.305536:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532470144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876963.305543:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1788876963.305585:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532470144:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876963.305803:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876963.817265:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788876963.817287:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876963.817361:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876963.817436:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470272 00000100:00100000:0.0:1788876963.817443:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470272 00000100:00100000:0.0:1788876963.817489:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1788876963.817498:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532470272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876963.817534:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876963.817581:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532470272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876963.817588:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1788876963.817662:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532470272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876963.817853:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532470528:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.817885:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876963.817902:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532470784:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.817912:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532471040:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.817933:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876963.817934:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876963.817989:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.818050:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828304:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532471552:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828365:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876963.828431:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470784 00000100:00100000:3.0:1788876963.828438:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470784 00000100:00100000:3.0:1788876963.828492:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471552 00000100:00100000:3.0:1788876963.828496:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471552 00000100:00100000:3.0:1788876963.828528:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1788876963.828538:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532470784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828590:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532470784:12345-0@lo:400:kworker.0 Request processed in 53us (10654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.828598:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1788876963.828630:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1788876963.828637:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532471552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828670:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532471552:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.828677:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00080000:3.0:1788876963.828692:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788876963.828695:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788876963.828720:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967569 gen 2 00000100:00100000:3.0:1788876963.828754:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532471552:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828796:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470528 00000100:00100000:3.0:1788876963.828800:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470528 00000100:00100000:3.0:1788876963.828826:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788876963.828832:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532470528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828869:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532470528:12345-0@lo:400:kworker.0 Request processed in 37us (10982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.828875:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788876963.828900:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532470528:0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.828925:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471040 00000100:00100000:3.0:1788876963.828928:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471040 00000100:00100000:3.0:1788876963.828972:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1788876963.828980:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532471040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.829014:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532471040:12345-0@lo:400:kworker.0 Request processed in 36us (11079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.829031:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00080000:3.0:1788876963.829047:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876963.829064:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532471040:0@lo:400:kworker.0 00000100:00100000:1.0:1788876963.831154:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532470784:0@lo:400:kworker.0 00000100:00100000:1.0:1788876963.831170:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532471296:0@lo:400:kworker.0 00000100:00100000:1.0:1788876963.831221:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876963.831628:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471296 00000100:00100000:3.0:1788876963.831636:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471296 00000100:00100000:3.0:1788876963.832704:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1788876963.832720:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.832812:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532471296:12345-0@lo:400:kworker.0 Request processed in 98us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.832819:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1788876963.833376:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876963.833431:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532470912:0@lo:400:kworker.0 00000100:00100000:2.0:1788876963.833465:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876963.833483:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532471424:0@lo:400:kworker.0 00000100:00100000:2.0:1788876963.833511:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876963.833538:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471424 00000100:00100000:2.0:1788876963.833545:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471424 00000100:00100000:2.0:1788876963.833585:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1788876963.833592:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876963.833642:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532471424:12345-0@lo:400:kworker.0 Request processed in 50us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876963.833649:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1788876963.833683:0:3664:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934861 gen 2 00000100:00100000:2.0:1788876963.833700:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532471424:0@lo:400:kworker.0 00000100:00100000:1.0:1788876963.833796:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470912 00000100:00100000:1.0:1788876963.833801:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470912 00000100:00100000:1.0:1788876963.833838:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1788876963.833846:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532470912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876963.833884:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532470912:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876963.833890:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00080000:1.0:1788876963.833910:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876963.833915:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876963.833917:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876963.833937:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532471296:0@lo:400:kworker.0 00000100:00100000:2.0:1788876963.834010:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532470912:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834099:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876963.834132:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834156:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876963.834182:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532471680:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834202:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876963.834231:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470656 00000100:00100000:0.0:1788876963.834235:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470656 00000100:00100000:0.0:1788876963.834256:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471168 00000100:00100000:0.0:1788876963.834258:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471168 00000100:00100000:0.0:1788876963.834273:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471680 00000100:00100000:0.0:1788876963.834276:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471680 00000100:00100000:0.0:1788876963.834291:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:0.0:1788876963.834296:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532470656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834328:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532470656:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876963.834335:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:0.0:1788876963.834348:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1788876963.834355:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532471168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834381:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532471168:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876963.834386:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1788876963.834396:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1788876963.834402:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834424:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532471680:12345-0@lo:400:kworker.0 Request processed in 23us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876963.834430:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1788876963.834455:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834464:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532471168:0@lo:400:kworker.0 00000100:00100000:0.0:1788876963.834472:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532471680:0@lo:400:kworker.0 00000100:00080000:1.0:1788876963.834541:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876963.835059:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532470400 00000100:00100000:3.0:1788876963.835065:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532470400 00000100:00100000:3.0:1788876963.835097:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788876963.835103:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532470400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876963.835153:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532470400:12345-0@lo:400:kworker.0 Request processed in 49us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876963.835159:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788876963.835696:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532470400:0@lo:400:kworker.0 00010000:00010000:2.0:1788876964.136825:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876964.328808:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532471808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876964.328878:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876964.328936:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471808 00000100:00100000:3.0:1788876964.328944:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471808 00000100:00100000:3.0:1788876964.329004:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1788876964.329013:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532471808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876964.329049:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876964.329093:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532471808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876964.329100:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1788876964.329129:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532471808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876964.329534:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532471936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876964.329578:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876964.329635:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876964.329638:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532471936 00000100:00100000:1.0:1788876964.329642:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532471936 00000100:00100000:0.0:1788876964.329644:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532472192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876964.329672:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1788876964.329680:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532471936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876964.329684:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788876964.329694:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876964.329716:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472192 00000100:00100000:0.0:1788876964.329720:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472192 00000100:00100000:1.0:1788876964.329730:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532471936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876964.329736:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1788876964.329753:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1788876964.329761:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532472192:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876964.329766:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532471936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876964.329778:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00000024:0.0:1788876964.329784:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788876964.329785:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532472064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788876964.329812:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876964.329822:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532472192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876964.329827:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1788876964.329830:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472064 00000100:00100000:1.0:1788876964.329832:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472064 00000100:00100000:0.0:1788876964.329856:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532472192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876964.329856:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1788876964.329863:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532472064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788876964.329876:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876964.329916:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532472064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876964.329922:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1788876964.329944:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532472064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876964.526846:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876964.526890:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876964.526933:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876964.526966:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876964.526992:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876964.527011:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302784 00000100:00100000:2.0:1788876964.527031:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302784 00000100:00100000:2.0:1788876964.527091:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1788876964.527103:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511302784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876964.527168:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511302784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876964.527175:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:1.0:1788876964.527194:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303168 00000100:00100000:1.0:1788876964.527199:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303168 00000100:00100000:1.0:1788876964.527236:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303296 00000100:00100000:1.0:1788876964.527238:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303296 00000100:00100000:1.0:1788876964.527261:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1463 00000100:00100000:1.0:1788876964.527269:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511303168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876964.527301:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1464 00000100:00100000:1.0:1788876964.527302:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511303168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876964.527309:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1463 00000100:00100000:2.0:1788876964.527309:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511303296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1788876964.527328:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876964.527331:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511303296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00080000:1.0:1788876964.527332:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876964.527337:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1464 00000100:00100000:0.0:1788876964.527515:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511302912 00000100:00100000:0.0:1788876964.527519:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511302912 00000100:00080000:1.0:1788876964.527760:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788876964.527826:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303040 00000100:00100000:0.0:1788876964.527831:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303040 00000100:00100000:2.0:1788876964.527897:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1910 00000100:00100000:2.0:1788876964.527905:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511302912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876964.527943:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2396:x1875771511302912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876964.527950:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1910 00000100:00100000:2.0:1788876964.527976:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1911 00000100:00100000:2.0:1788876964.527983:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511303040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876964.528006:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511303040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876964.528011:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1911 00000100:00080000:3.0:1788876964.528116:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788876965.166779:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876966.189481:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788876966.199521:0:53617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1788876967.211674:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876968.236369:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788876968.263573:0:53665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1788876968.429732:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788876968.429767:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532472320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876968.429874:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.429980:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472320 00000100:00100000:1.0:1788876968.429992:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472320 00000100:00100000:1.0:1788876968.430077:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1788876968.430089:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532472320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876968.430127:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876968.430179:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532472320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.430187:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00080000:1.0:1788876968.430213:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876968.430406:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532472320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876968.937335:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876968.937370:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532472448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876968.937475:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876968.937849:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472448 00000100:00100000:0.0:1788876968.937862:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472448 00000100:00100000:0.0:1788876968.937972:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1788876968.937984:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532472448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788876968.938041:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788876968.938112:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532472448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876968.938120:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1788876968.938210:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532472448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788876968.940133:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.940241:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876968.940296:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532473344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.940322:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876968.940344:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532473856:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.940365:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876968.940397:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788876968.940404:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.940434:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940654:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532472960:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.940693:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940731:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532473472:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.940757:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940780:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876968.940786:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532472576:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.940820:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940846:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532473088:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.940870:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940887:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.940908:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876968.940943:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472832 00000100:00100000:1.0:1788876968.940952:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472832 00000100:00100000:1.0:1788876968.941018:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473344 00000100:00100000:1.0:1788876968.941022:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473344 00000100:00100000:1.0:1788876968.941046:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473856 00000100:00100000:1.0:1788876968.941049:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473856 00000100:00100000:1.0:1788876968.941058:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473472 00000100:00100000:1.0:1788876968.941061:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473472 00000100:00100000:1.0:1788876968.941074:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473088 00000100:00100000:1.0:1788876968.941076:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473088 00000100:00100000:1.0:1788876968.941094:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1788876968.941104:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532472832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941170:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532472832:12345-0@lo:400:kworker.0 Request processed in 66us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941177:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1788876968.941275:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1788876968.941282:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532473344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941314:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c1a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532473344:12345-0@lo:400:kworker.0 Request processed in 34us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941320:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1788876968.941330:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1788876968.941336:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532473856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941363:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532473856:12345-0@lo:400:kworker.0 Request processed in 28us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941369:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1788876968.941380:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1788876968.941385:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941420:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532473472:12345-0@lo:400:kworker.0 Request processed in 34us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941430:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1788876968.941441:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1788876968.941447:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532473088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941487:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532473088:12345-0@lo:400:kworker.0 Request processed in 40us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941493:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1788876968.941516:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472960 00000100:00100000:1.0:1788876968.941520:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472960 00000100:00100000:1.0:1788876968.941548:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473600 00000100:00100000:1.0:1788876968.941551:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473600 00000100:00100000:1.0:1788876968.941569:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788876968.941575:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532472960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941639:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532472960:12345-0@lo:400:kworker.0 Request processed in 64us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941645:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1788876968.941657:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:1.0:1788876968.941663:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532473600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941692:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532473600:12345-0@lo:400:kworker.0 Request processed in 29us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941698:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00080000:1.0:1788876968.941735:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876968.941740:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876968.941743:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876968.941785:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532473088:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941799:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941813:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532472960:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941824:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532473472:0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941893:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472576 00000100:00100000:1.0:1788876968.941897:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472576 00000100:00100000:1.0:1788876968.941927:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788876968.941933:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532472576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876968.941974:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2431850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532472576:12345-0@lo:400:kworker.0 Request processed in 41us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876968.941981:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788876968.942031:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532472576:0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.945364:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532472704 00000100:00100000:2.0:1788876968.945388:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532472704 00000100:00100000:3.0:1788876968.945438:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.945490:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1788876968.945501:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.945538:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876968.945571:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532473728:0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.945584:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532472704:12345-0@lo:400:kworker.0 Request processed in 85us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876968.945593:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1788876968.945598:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876968.945667:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473216 00000100:00100000:2.0:1788876968.945671:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473216 00000100:00100000:2.0:1788876968.945722:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1788876968.945729:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532473216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.945764:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532473216:12345-0@lo:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876968.945770:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00080000:2.0:1788876968.945792:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876968.949916:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.949936:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532473344:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.949949:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532473856:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.950008:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788876968.950026:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.950391:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473728 00000100:00100000:2.0:1788876968.950402:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473728 00000100:00100000:2.0:1788876968.950577:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1788876968.950591:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532473728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876968.950724:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532473728:12345-0@lo:400:kworker.0 Request processed in 136us (5123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876968.950732:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1788876968.950848:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532473728:0@lo:400:kworker.0 00000100:00080000:1.0:1788876968.950913:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788876969.260422:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876969.449158:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788876969.449187:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532473984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876969.449287:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876969.449349:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532473984 00000100:00100000:1.0:1788876969.449358:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532473984 00000100:00100000:1.0:1788876969.449415:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788876969.449424:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532473984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876969.449463:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876969.449518:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532473984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876969.449526:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788876969.449581:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532473984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876969.450640:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788876969.450658:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532474112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876969.450730:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876969.450778:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474112 00000100:00100000:0.0:1788876969.450784:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474112 00000100:00100000:0.0:1788876969.450845:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1788876969.450854:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532474112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876969.450876:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876969.450921:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532474112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876969.450927:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1788876969.450970:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532474112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876969.456368:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876969.456403:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876969.456500:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876969.456947:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532474368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876969.456985:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876969.457105:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474368 00000100:00100000:3.0:1788876969.457116:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474368 00000100:00100000:3.0:1788876969.457183:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1788876969.457194:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532474368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876969.457248:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876969.457317:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532474368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876969.457325:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1788876969.457493:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532474368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876969.457936:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474240 00000100:00100000:2.0:1788876969.457942:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474240 00000100:00100000:2.0:1788876969.457993:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1788876969.458011:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532474240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876969.458030:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876969.458090:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532474240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876969.458098:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1788876969.458178:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876969.648389:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876969.648438:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876969.648480:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876969.648596:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303680 00000100:00100000:1.0:1788876969.648661:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303680 00000100:00100000:1.0:1788876969.648764:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1918 00000100:00100000:1.0:1788876969.648777:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511303680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876969.648883:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511303680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876969.648891:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1918 00000100:00080000:2.0:1788876969.649287:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876969.649407:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303424 00000100:00100000:3.0:1788876969.649415:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303424 00000100:00100000:3.0:1788876969.649464:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1788876969.649472:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511303424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876969.649528:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511303424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 56us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876969.649535:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1788876969.650017:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303936 00000100:00100000:0.0:1788876969.650025:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303936 00000100:00100000:0.0:1788876969.650092:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1468 00000100:00100000:0.0:1788876969.650100:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511303936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876969.650156:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511303936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876969.650163:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1468 00000100:00080000:2.0:1788876969.650490:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876969.652105:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876969.652166:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876969.652271:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303808 00000100:00100000:3.0:1788876969.652285:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303808 00000100:00100000:3.0:1788876969.652370:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1469 00000100:00100000:3.0:1788876969.652382:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511303808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876969.652468:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511303808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876969.652475:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1469 00000100:00100000:2.0:1788876969.652580:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511303552 00000100:00100000:2.0:1788876969.652585:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511303552 00000100:00100000:2.0:1788876969.652664:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1919 00000100:00100000:2.0:1788876969.652672:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511303552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876969.652705:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2397:x1875771511303552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876969.653330:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1919 00000100:00080000:1.0:1788876969.653487:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788876969.653493:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788876970.281019:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876970.513448:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876970.515884:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304064 00000100:00100000:2.0:1788876970.515905:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304064 00000100:00100000:2.0:1788876970.516030:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2700 00000100:00100000:2.0:1788876970.516043:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40771:x1875771511304064:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788876970.516241:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788876970.516353:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40771:x1875771511304064:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 311us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876970.516361:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2700 00000100:00100000:3.0:1788876970.521376:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876970.522222:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304192 00000100:00100000:1.0:1788876970.522237:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304192 00000100:00100000:1.0:1788876970.522328:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2701 00000100:00100000:1.0:1788876970.522341:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:40771:x1875771511304192:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876970.522393:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876970.522498:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:40771:x1875771511304192:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 159us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876970.522506:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2701 00000100:00100000:1.0:1788876970.536050:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876970.536227:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304320 00000100:00100000:0.0:1788876970.536241:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304320 00000100:00100000:0.0:1788876970.536320:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1156 00000100:00100000:0.0:1788876970.536331:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40771:x1875771511304320:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1788876970.536368:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876970.536461:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40771:x1875771511304320:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 132us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876970.536469:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1156 00000100:00100000:3.0:1788876970.544472:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876970.544759:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304448 00000100:00100000:2.0:1788876970.544774:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304448 00000100:00100000:2.0:1788876970.544868:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1157 00000100:00100000:2.0:1788876970.544882:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40771:x1875771511304448:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788876970.544941:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876970.545058:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40771:x1875771511304448:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 178us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876970.545073:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1157 00000100:00100000:3.0:1788876970.634470:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876970.634586:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304576 00000100:00100000:1.0:1788876970.634636:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304576 00000100:00100000:1.0:1788876970.634726:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2702 00000100:00100000:1.0:1788876970.634747:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:40788:x1875771511304576:12345-192.168.203.11@tcp:101:ls.0 00010000:00010000:1.0:1788876970.634776:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876970.634804:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a00 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.634901:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.634923:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635194:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635217:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635226:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635234:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635353:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635362:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635370:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876970.635427:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x112:0x0]: returning size 0 00000004:00200000:1.0:1788876970.635432:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876970.635480:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635495:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635504:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635512:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635520:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635527:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876970.635533:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635542:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.635557:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:1.0:1788876970.635560:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876970.635565:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.637047:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b039b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.637081:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638808:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638830:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638838:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876970.638844:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638868:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638890:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13fae83b00) 00010000:00010000:1.0:1788876970.638894:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876970.638900:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.638909:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b03a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.639337:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a00 expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.639358:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a00 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.639368:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x112:0x0].0x0 (ffff8a13fae83600) 00010000:00010000:1.0:1788876970.639371:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788876970.639376:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486a00, rc 0) 00000100:00100000:1.0:1788876970.639479:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40788:x1875771511304576:12345-192.168.203.11@tcp:101:ls.0 Request processed in 4741us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876970.639491:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2702 00000100:00100000:1.0:1788876970.689778:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876970.689999:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304832 00000100:00100000:2.0:1788876970.690013:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304832 00000100:00100000:2.0:1788876970.690085:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2703 00000100:00100000:2.0:1788876970.690097:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40791:x1875771511304832:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876970.690172:0:15659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876970.690210:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03a9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x112:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a00 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690240:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x112:0x0].0x0 (ffff8a13fae83600) 00010000:00010000:2.0:1788876970.690262:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73c00/0xf5bf0f7e313b038d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f9 expref: 7 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690272:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:2.0:1788876970.690280:0:15659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876970.690325:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690370:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690384:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690400:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.690408:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691004:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691159:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691169:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691176:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691485:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691497:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691505:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691513:0:15659:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691521:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691529:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691562:0:15659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876970.691591:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.691599:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693201:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693209:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876970.693215:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693227:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693250:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x112:0x0].0x0 (ffff8a13fae0bd00) 00010000:00010000:2.0:1788876970.693253:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876970.693258:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693267:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b03be lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x112:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693305:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693312:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693319:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693324:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876970.693329:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693335:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693342:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b200) 00010000:00010000:2.0:1788876970.693345:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876970.693348:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693354:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b03b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876970.693376:0:15659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a67f46b1 reply state 0000000049a4028c transno 90194313217 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693390:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876970.693398:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13fae0b100) 00010000:00010000:2.0:1788876970.693400:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876970.693807:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788876970.693817:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.693825:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788876970.693829:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.693836:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.693848:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x112:0x0].0x0 (ffff8a13fae0bd00) 00010000:00010000:1.0:1788876970.693850:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788876970.693853:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.693859:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03c5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x112:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876970.693875:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876970.693878:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876970.693879:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876970.695086:0:15659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876970.695259:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:40791:x1875771511304832:12345-192.168.203.11@tcp:36:rm.0 Request processed in 5154us (5487us total) trans 90194313217 rc 0/0 00000100:00100000:2.0:1788876970.695271:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2703 00010000:00010000:0.0:1788876971.305486:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876972.334335:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876973.353009:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876973.545038:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532474496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876973.545158:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876973.545362:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474496 00000100:00100000:2.0:1788876973.545374:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474496 00000100:00100000:2.0:1788876973.545473:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1788876973.545487:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532474496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876973.545527:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00080000:3.0:1788876973.545761:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876973.557451:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532474496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11951us (12276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876973.557471:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1788876973.557957:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532474496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876974.057528:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532475008:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.057655:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.057726:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532475520:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.057758:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.057786:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532476032:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.058068:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.058108:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788876974.058193:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532474624:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.058229:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.058324:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532475136:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.058350:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.058376:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532475648:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.058406:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.058441:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532474752:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.058466:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.058487:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532475264:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.059414:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.059449:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532475776:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.059478:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876974.059520:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475008 00000100:00100000:3.0:1788876974.059531:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475008 00000100:00100000:3.0:1788876974.059618:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475776 00000100:00100000:3.0:1788876974.059622:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475776 00000100:00100000:3.0:1788876974.059652:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1788876974.059664:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532475008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.060029:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532475008:12345-0@lo:400:kworker.0 Request processed in 366us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.060037:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1788876974.060069:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1788876974.060076:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.060111:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532475776:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.060117:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00080000:3.0:1788876974.060136:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876974.060221:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532475776:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.060565:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788876974.060579:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532474880:0@lo:400:kworker.0 00000100:00100000:0.0:1788876974.061442:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532476160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788876974.063338:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532475008:0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.063713:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475520 00000100:00100000:3.0:1788876974.063724:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475520 00000100:00080000:1.0:1788876974.063959:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788876974.063983:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475136 00000100:00100000:1.0:1788876974.063988:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475136 00000100:00100000:1.0:1788876974.064021:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475264 00000100:00100000:1.0:1788876974.064023:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475264 00000100:00100000:1.0:1788876974.064042:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1788876974.064053:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876974.064165:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532475520:12345-0@lo:400:kworker.0 Request processed in 115us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876974.064173:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:1.0:1788876974.064193:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1788876974.064198:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532475136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876974.064227:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532475136:12345-0@lo:400:kworker.0 Request processed in 29us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876974.064233:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:1.0:1788876974.064244:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1788876974.064250:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532475264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876974.064280:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532475264:12345-0@lo:400:kworker.0 Request processed in 30us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876974.064285:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00080000:1.0:1788876974.064298:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876974.064301:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876974.064343:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532475136:0@lo:400:kworker.0 00000100:00100000:1.0:1788876974.064359:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532475520:0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.064417:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476032 00000100:00100000:3.0:1788876974.064425:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476032 00000100:00100000:3.0:1788876974.064461:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1788876974.064468:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532476032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.064510:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532476032:12345-0@lo:400:kworker.0 Request processed in 43us (6695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.064517:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1788876974.064552:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474624 00000100:00100000:3.0:1788876974.064557:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474624 00000100:00100000:3.0:1788876974.064587:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788876974.064593:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532474624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.064652:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2433450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532474624:12345-0@lo:400:kworker.0 Request processed in 60us (6423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.064659:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788876974.064907:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532474624:0@lo:400:kworker.0 00000100:00100000:1.0:1788876974.064928:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532476032:0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.065944:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475648 00000100:00100000:3.0:1788876974.065959:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475648 00000100:00100000:3.0:1788876974.066026:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474752 00000100:00100000:3.0:1788876974.066030:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474752 00000100:00100000:3.0:1788876974.066049:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1788876974.066058:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532475648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.066159:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532475648:12345-0@lo:400:kworker.0 Request processed in 102us (7752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.066167:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1788876974.066193:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1788876974.066200:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532474752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.066232:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532474752:12345-0@lo:400:kworker.0 Request processed in 33us (7765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.066238:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1788876974.067376:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532475648:0@lo:400:kworker.0 00000100:00100000:0.0:1788876974.069674:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876974.070547:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476160 00000100:00100000:3.0:1788876974.070563:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476160 00000100:00100000:3.0:1788876974.070658:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788876974.070672:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532476160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876974.070966:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876974.071064:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532476160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 394us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.071072:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788876974.071170:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532476160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876974.076095:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.076196:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532475392:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.076272:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.076294:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532475904:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.076320:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876974.076373:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475904 00000100:00100000:2.0:1788876974.076382:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475904 00000100:00100000:2.0:1788876974.076448:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1788876974.076458:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532475904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.076520:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532475904:12345-0@lo:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876974.076527:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00080000:2.0:1788876974.076551:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876974.076590:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7ae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532475904:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.076656:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532474752:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.076671:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532475264:0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.077070:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532474880 00000100:00100000:3.0:1788876974.077077:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532474880 00000100:00100000:3.0:1788876974.077113:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532475392 00000100:00100000:3.0:1788876974.077117:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532475392 00000100:00100000:3.0:1788876974.077147:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1788876974.077154:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532474880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.077233:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532474880:12345-0@lo:400:kworker.0 Request processed in 79us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.077241:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1788876974.077259:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1788876974.077266:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532475392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876974.077295:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532475392:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.077302:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00080000:2.0:1788876974.078989:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876974.079066:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f41cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788876974.079083:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532475392:0@lo:400:kworker.0 00010000:00010000:2.0:1788876974.379131:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876974.572502:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532476288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876974.574368:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876974.574444:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876974.574458:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532476416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876974.574526:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876974.580326:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476288 00000100:00100000:3.0:1788876974.580346:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476288 00000100:00100000:3.0:1788876974.580427:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1788876974.580439:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532476288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876974.580483:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788876974.581772:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876974.581797:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532476544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876974.582986:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788876974.583005:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532476672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876974.585565:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876974.585678:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476672 00000100:00100000:1.0:1788876974.585690:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476672 00000100:00100000:1.0:1788876974.585759:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788876974.585771:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532476672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788876974.585805:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788876974.585866:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532476672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876974.585875:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1788876974.585936:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532476672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876974.588107:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532476288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7657us (13739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.588124:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1788876974.588198:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476416 00000100:00100000:3.0:1788876974.588207:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476416 00000100:00100000:3.0:1788876974.588372:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1788876974.588383:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532476416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788876974.588427:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876974.588487:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532476416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (13960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876974.588494:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1788876974.588672:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532476416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788876974.588697:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532476288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876974.592331:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876974.601067:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476544 00000100:00100000:1.0:1788876974.601091:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476544 00000100:00100000:1.0:1788876974.601193:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1788876974.601208:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532476544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876974.601245:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876974.601381:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532476544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (9057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876974.601389:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1788876974.601590:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532476544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876974.784129:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876974.784177:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876974.784211:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876974.784234:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876974.784260:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876974.784293:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305088 00000100:00100000:2.0:1788876974.784306:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305088 00000100:00100000:2.0:1788876974.784376:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305216 00000100:00100000:2.0:1788876974.784380:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305216 00000100:00100000:2.0:1788876974.784410:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1926 00000100:00100000:2.0:1788876974.784420:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876974.784519:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 100us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876974.784529:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1926 00000100:00100000:2.0:1788876974.784549:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1927 00000100:00100000:2.0:1788876974.784555:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511305216:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876974.784582:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511305216:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876974.784588:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1927 00000100:00100000:2.0:1788876974.784638:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305344 00000100:00100000:2.0:1788876974.784643:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305344 00000100:00100000:2.0:1788876974.784669:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305472 00000100:00100000:2.0:1788876974.784671:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305472 00000100:00100000:2.0:1788876974.784692:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1473 00000100:00100000:2.0:1788876974.784698:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305344:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876974.784727:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305344:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876974.784733:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1473 00000100:00100000:2.0:1788876974.784744:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1474 00000100:00100000:2.0:1788876974.784751:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305472:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1788876974.784766:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876974.784771:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876974.784773:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511305472:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00080000:0.0:1788876974.784774:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876974.784776:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876974.784779:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1474 00000100:00100000:0.0:1788876974.784797:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511304960 00000100:00100000:0.0:1788876974.784800:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511304960 00000100:00100000:0.0:1788876974.784835:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1788876974.784842:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511304960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876974.787763:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c2432850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511304960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2904us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876974.787783:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00010000:00010000:2.0:1788876975.402090:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788876976.107224:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313217 is committed 00010000:00010000:3.0:1788876976.107295:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107309:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107318:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107325:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876976.107331:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107338:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107356:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3cc93651 (ffff8a13fae0b100) 00010000:00010000:3.0:1788876976.107359:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876976.107364:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876976.107371:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b03b7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3cc93651 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876976.440944:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876977.451018:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876978.472834:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876978.677869:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876978.677895:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532476800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876978.677982:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876978.678059:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476800 00000100:00100000:2.0:1788876978.678069:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476800 00000100:00100000:2.0:1788876978.678138:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1788876978.678148:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532476800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876978.678182:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876978.678237:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532476800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876978.678244:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:0.0:1788876978.678311:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876978.684207:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532476800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788876979.179745:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532476928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876979.179819:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876979.179895:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532476928 00000100:00100000:1.0:1788876979.179904:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532476928 00000100:00100000:1.0:1788876979.179974:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1788876979.179985:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532476928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788876979.180017:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876979.180064:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532476928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876979.180071:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1788876979.180159:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532476928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876979.180237:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532477056:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180268:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876979.180289:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180293:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180315:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180318:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532477184:0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180338:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532477824:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180341:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180357:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180358:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180374:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876979.180374:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532478336:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180389:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532478208:0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180392:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180406:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876979.180409:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788876979.180413:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532477440:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180431:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477056 00000100:00100000:3.0:1788876979.180433:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180434:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477056 00000100:00100000:3.0:1788876979.180450:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532477952:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180461:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788876979.180467:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180484:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180494:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532477056:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876979.180500:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788876979.180502:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532478464:0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180521:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876979.180524:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477184 00000100:00100000:0.0:1788876979.180527:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477184 00000100:00100000:3.0:1788876979.180546:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477312 00000100:00100000:3.0:1788876979.180550:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477312 00000100:00100000:0.0:1788876979.180561:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1788876979.180567:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532477184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.180726:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532477184:12345-0@lo:400:kworker.0 Request processed in 34us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876979.180734:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1788876979.180735:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477696 00000100:00100000:3.0:1788876979.180738:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477696 00000100:00100000:0.0:1788876979.180752:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477952 00000100:00100000:0.0:1788876979.180755:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477952 00000100:00100000:3.0:1788876979.180765:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478464 00000100:00100000:3.0:1788876979.180767:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478464 00000100:00100000:0.0:1788876979.180770:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:0.0:1788876979.180775:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532477312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180779:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1788876979.180783:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876979.180809:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532477696:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876979.180810:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532477312:12345-0@lo:400:kworker.0 Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.180815:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1788876979.191730:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788876979.191749:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1788876979.191905:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532477184:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.191905:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:2.0:1788876979.191917:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532478464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.191924:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532477696:0@lo:400:kworker.0 00000100:00080000:0.0:1788876979.191960:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876979.191964:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876979.191986:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.192002:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192005:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532478464:12345-0@lo:400:kworker.0 Request processed in 92us (11482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192011:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:2.0:1788876979.192033:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477824 00000100:00100000:2.0:1788876979.192039:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477824 00000100:00100000:2.0:1788876979.192082:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478336 00000100:00100000:2.0:1788876979.192085:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478336 00000100:00100000:2.0:1788876979.192102:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478208 00000100:00100000:2.0:1788876979.192105:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478208 00000100:00100000:2.0:1788876979.192120:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477440 00000100:00100000:2.0:1788876979.192123:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477440 00000100:00100000:2.0:1788876979.192138:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1788876979.192143:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192174:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532477824:12345-0@lo:400:kworker.0 Request processed in 31us (11815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192180:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1788876979.192191:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1788876979.192197:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192218:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532478336:12345-0@lo:400:kworker.0 Request processed in 22us (11825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192224:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1788876979.192232:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788876979.192237:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532478208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192266:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532478208:12345-0@lo:400:kworker.0 Request processed in 29us (11859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192271:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788876979.192281:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788876979.192287:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532477440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192311:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532477440:12345-0@lo:400:kworker.0 Request processed in 25us (11877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192316:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788876979.192357:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876979.192383:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192410:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876979.192431:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532477056:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192552:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532477568 00000100:00100000:2.0:1788876979.192556:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532477568 00000100:00080000:0.0:1788876979.192573:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876979.192574:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478080 00000100:00080000:0.0:1788876979.192576:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788876979.192576:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478080 00000100:00080000:0.0:1788876979.192578:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876979.192581:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876979.192589:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1788876979.192594:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532477568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876979.192641:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192645:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532477568:12345-0@lo:400:kworker.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192651:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1788876979.192662:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:2.0:1788876979.192669:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192696:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532478080:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.192701:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:2.0:1788876979.192725:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532477568:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.192736:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.198691:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876979.198787:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532477952:12345-0@lo:400:kworker.0 Request processed in 7029us (18301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.198796:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1788876979.199230:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532477440:0@lo:400:kworker.0 00000100:00100000:1.0:1788876979.199244:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532477952:0@lo:400:kworker.0 00000100:00100000:1.0:1788876979.199257:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532477824:0@lo:400:kworker.0 00000100:00100000:1.0:1788876979.199267:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532478336:0@lo:400:kworker.0 00010000:00010000:1.0:1788876979.496857:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788876979.608475:0:53860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 10: create |X| rename unlink ======= 10:16:18 (1788876978) 00000100:00100000:3.0:1788876979.690120:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532478592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876979.690187:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876979.690226:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532478720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876979.690245:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876979.690283:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478592 00000100:00100000:3.0:1788876979.690289:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478592 00000100:00100000:3.0:1788876979.690331:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478720 00000100:00100000:3.0:1788876979.690334:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478720 00000100:00100000:3.0:1788876979.690352:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1788876979.690360:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532478592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876979.690387:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876979.690428:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532478592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.690436:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1788876979.690455:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1788876979.690460:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532478720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876979.690470:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876979.690494:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532478720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.690499:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1788876979.690541:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532478592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876979.690553:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532478720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788876979.693311:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876979.693347:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305600 00000100:00100000:3.0:1788876979.693356:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305600 00000100:00100000:3.0:1788876979.693416:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2704 00000100:00100000:3.0:1788876979.693426:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41374:x1875771511305600:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:3.0:1788876979.693444:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876979.693466:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b03cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a07 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693529:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693543:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693557:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876979.693637:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876979.693642:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876979.693660:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693696:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b03cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a07 expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693714:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a07 expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876979.693723:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606200) 00010000:00010000:3.0:1788876979.693727:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876979.693731:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9800, rc 0) 00000100:00100000:3.0:1788876979.693781:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41374:x1875771511305600:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 356us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.693799:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2704 00000100:00080000:0.0:1788876979.698320:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788876979.698436:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532478848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788876979.698515:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876979.698672:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788876979.698683:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532478976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876979.698718:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876979.698751:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478976 00000100:00100000:1.0:1788876979.698758:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478976 00000100:00100000:1.0:1788876979.698817:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1788876979.698826:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532478976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876979.698850:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876979.698900:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532478976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876979.698907:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1788876979.698963:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532478976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788876979.700062:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532478848 00000100:00100000:0.0:1788876979.700069:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532478848 00000100:00100000:0.0:1788876979.700103:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1788876979.700111:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532478848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876979.700139:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788876979.700187:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532478848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876979.700193:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788876979.700257:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532478848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876979.707156:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876979.707199:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305856 00000100:00100000:2.0:1788876979.707208:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305856 00000100:00100000:2.0:1788876979.707257:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2705 00000100:00100000:2.0:1788876979.707266:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41374:x1875771511305856:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:2.0:1788876979.707323:0:8722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876979.707348:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b03d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a07 expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707365:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606200) 00010000:00010000:2.0:1788876979.707376:0:8722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876979.707462:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707476:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707486:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707499:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707507:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707512:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707981:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707990:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.707997:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708003:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876979.708008:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708016:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708025:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b200) 00010000:00010000:2.0:1788876979.708028:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876979.708032:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708037:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b03da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876979.708051:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007af65d90 reply state 0000000071288f3c transno 90194313218 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708061:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876979.708067:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13fae0be00) 00010000:00010000:2.0:1788876979.708069:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876979.708072:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876979.708153:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41374:x1875771511305856:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 886us (1007us total) trans 90194313218 rc 0/0 00000100:00100000:2.0:1788876979.708160:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2705 00000100:00100000:3.0:1788876979.886131:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876979.886175:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876979.886207:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876979.886229:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876979.886254:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306240 00000100:00100000:3.0:1788876979.886263:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306240 00000100:00100000:3.0:1788876979.886316:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306368 00000100:00100000:3.0:1788876979.886320:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306368 00000100:00100000:3.0:1788876979.886344:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1479 00000100:00100000:3.0:1788876979.886354:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511306240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876979.886418:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511306240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.886425:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1479 00000100:00100000:3.0:1788876979.886443:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1480 00000100:00100000:3.0:1788876979.886449:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511306368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788876979.886473:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511306368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876979.886479:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1480 00000100:00100000:2.0:1788876979.886783:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306112 00000100:00100000:2.0:1788876979.886798:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306112 00000100:00100000:2.0:1788876979.886830:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1934 00000100:00100000:2.0:1788876979.886837:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511306112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876979.886866:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511306112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876979.886875:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1934 00000100:00100000:0.0:1788876979.888841:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511305984 00000100:00100000:0.0:1788876979.888852:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511305984 00000100:00100000:0.0:1788876979.888893:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:0.0:1788876979.888902:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511305984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876979.888969:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511305984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876979.888980:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00080000:0.0:1788876979.889009:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876979.889015:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876979.889018:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788876980.522025:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788876980.573580:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313218 is committed 00010000:00010000:0.0:1788876980.576137:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576155:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576162:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576169:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788876980.576174:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576183:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576202:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13fae0be00) 00010000:00010000:0.0:1788876980.576206:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788876980.576211:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.576217:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72800/0xf5bf0f7e313b03e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788876980.627174:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876980.627266:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306496 00000100:00100000:2.0:1788876980.627279:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306496 00000100:00100000:2.0:1788876980.627344:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2706 00000100:00100000:2.0:1788876980.627354:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41387:x1875771511306496:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788876980.627377:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876980.627401:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313b03e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a0e expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627467:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627483:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627495:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876980.627543:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876980.627547:0:6539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876980.627568:0:6539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627592:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73400/0xf5bf0f7e313b03e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a0e expref: 8 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627631:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a0e expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.627644:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b200) 00010000:00010000:2.0:1788876980.627647:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876980.627650:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73e00, rc 0) 00000100:00100000:2.0:1788876980.627712:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41387:x1875771511306496:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 360us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876980.627719:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2706 00000100:00100000:3.0:1788876980.634868:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876980.634919:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306624 00000100:00100000:3.0:1788876980.634928:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306624 00000100:00100000:3.0:1788876980.634988:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2707 00000100:00100000:3.0:1788876980.635334:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41387:x1875771511306624:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1788876980.635377:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788876980.635452:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41387:x1875771511306624:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 454us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876980.635459:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2707 00000100:00100000:3.0:1788876980.637772:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876980.639758:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306752 00000100:00100000:1.0:1788876980.639769:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306752 00000100:00100000:1.0:1788876980.639822:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2708 00000100:00100000:1.0:1788876980.639832:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41387:x1875771511306752:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788876980.639864:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788876980.639953:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41387:x1875771511306752:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 113us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876980.639961:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2708 00000100:00100000:3.0:1788876980.659492:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876980.659526:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511306880 00000100:00100000:3.0:1788876980.659537:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511306880 00000100:00100000:3.0:1788876980.659587:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1166 00000100:00100000:3.0:1788876980.659596:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41387:x1875771511306880:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788876980.659644:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876980.659711:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41387:x1875771511306880:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876980.659718:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1166 00000100:00100000:1.0:1788876980.665403:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876980.665623:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307008 00000100:00100000:3.0:1788876980.665634:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307008 00000100:00100000:3.0:1788876980.665690:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1167 00000100:00100000:3.0:1788876980.665701:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41387:x1875771511307008:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788876980.665736:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876980.665802:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41387:x1875771511307008:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876980.665810:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1167 00000100:00100000:1.0:1788876980.732205:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876980.732245:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307264 00000100:00100000:1.0:1788876980.732254:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307264 00000100:00100000:1.0:1788876980.732321:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2709 00000100:00100000:1.0:1788876980.732332:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41394:x1875771511307264:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:1.0:1788876980.732399:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788876980.732425:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73e00/0xf5bf0f7e313b03ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a0e expref: 7 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732441:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b200) 00010000:00010000:1.0:1788876980.732452:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788876980.732519:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732533:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732543:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732555:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732563:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.732570:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733452:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733461:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733469:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733474:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876980.733478:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733486:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733496:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae83500) 00010000:00010000:1.0:1788876980.733499:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876980.733502:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733508:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b03f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788876980.733525:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099d46cea reply state 000000005ef6e0f2 transno 90194313219 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733535:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.733541:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83700) 00010000:00010000:1.0:1788876980.733543:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788876980.733545:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788876980.733782:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41394:x1875771511307264:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 1447us (1581us total) trans 90194313219 rc 0/0 00000100:00100000:1.0:1788876980.733790:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2709 00000100:00100000:2.0:1788876980.759653:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876980.759787:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307392 00000100:00100000:3.0:1788876980.759796:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307392 00000100:00100000:3.0:1788876980.759856:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2710 00000100:00100000:3.0:1788876980.759868:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41397:x1875771511307392:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876980.759891:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876980.759915:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b0404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a15 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.759992:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.760007:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.760023:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876980.760064:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876980.760068:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876980.760090:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.760113:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b0404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a15 expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.760129:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a15 expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876980.760138:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606500) 00010000:00010000:3.0:1788876980.760141:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876980.760145:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00000100:00100000:3.0:1788876980.760206:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:41397:x1875771511307392:12345-192.168.203.11@tcp:101:rm.0 Request processed in 341us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876980.760212:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2710 00000100:00100000:3.0:1788876980.763796:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788876980.765049:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307520 00000100:00100000:1.0:1788876980.765062:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307520 00000100:00100000:1.0:1788876980.765149:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2711 00000100:00100000:1.0:1788876980.765158:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:41397:x1875771511307520:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1788876980.765176:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788876980.765196:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b0412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a1c expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765257:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765271:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765282:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765300:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765307:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765313:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765402:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765410:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765417:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788876980.765458:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x114:0x0]: returning size 0 00000004:00200000:1.0:1788876980.765462:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788876980.765482:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765494:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765501:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765507:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765519:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765524:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876980.765528:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765535:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765546:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606500) 00010000:00010000:1.0:1788876980.765549:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876980.765553:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765560:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487e00/0xf5bf0f7e313b0419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765569:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765574:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765580:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765585:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788876980.765588:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765597:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765625:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83700) 00010000:00010000:1.0:1788876980.765628:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788876980.765631:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765636:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486000/0xf5bf0f7e313b0420 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765661:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1486a00/0xf5bf0f7e313b0412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a1c expref: 11 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765674:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a1c expref: 10 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876980.765681:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x114:0x0].0x0 (ffff8a13fae83500) 00010000:00010000:1.0:1788876980.765683:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788876980.765686:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487200, rc 0) 00000100:00100000:1.0:1788876980.765741:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:41397:x1875771511307520:12345-192.168.203.11@tcp:101:rm.0 Request processed in 583us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876980.765747:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2711 00000100:00100000:3.0:1788876980.770990:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876980.771075:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307776 00000100:00100000:2.0:1788876980.771084:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307776 00000100:00100000:2.0:1788876980.771755:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2712 00000100:00100000:2.0:1788876980.771767:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:41397:x1875771511307776:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788876980.771819:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876980.771843:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487200/0xf5bf0f7e313b0427 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x114:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a1c expref: 10 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771861:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x114:0x0].0x0 (ffff8a13fae83500) 00010000:00010000:2.0:1788876980.771877:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b040b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a15 expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771888:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606500) 00010000:00010000:2.0:1788876980.771893:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876980.771915:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771928:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771953:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771965:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771973:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.771980:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772068:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772077:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772083:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772259:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772268:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772276:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772378:0:6539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772390:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772396:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772413:0:6539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788876980.772430:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772437:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772444:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772450:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876980.772454:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772462:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772470:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x114:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:2.0:1788876980.772473:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788876980.772477:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772483:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72200/0xf5bf0f7e313b043c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772501:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772507:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772513:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772518:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876980.772521:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772527:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772535:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0bb00) 00010000:00010000:2.0:1788876980.772537:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876980.772540:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772545:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b042e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876980.772557:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd1a840d reply state 0000000053eaaee3 transno 90194313220 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772567:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876980.772573:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83700) 00010000:00010000:2.0:1788876980.772575:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876980.772578:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788876980.773402:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:41397:x1875771511307776:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1634us (2416us total) trans 90194313220 rc 0/0 00000100:00100000:2.0:1788876980.773411:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2712 00010000:00010000:0.0:1788876980.773649:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876980.773667:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.773679:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788876980.773683:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.773690:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.773702:0:6528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x114:0x0].0x0 (ffff8a13fae0b600) 00010000:00010000:0.0:1788876980.773704:0:6528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788876980.773707:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.773714:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72c00/0xf5bf0f7e313b0443 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x114:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876980.773728:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876980.773729:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876980.773731:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876981.544840:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788876982.569957:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876983.592770:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876983.786057:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876983.786077:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532479104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876983.786144:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876983.786199:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479104 00000100:00100000:3.0:1788876983.786210:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479104 00000100:00100000:3.0:1788876983.786270:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788876983.786279:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532479104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788876983.786307:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788876983.786361:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532479104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876983.786368:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1788876983.786417:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532479104:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788876983.787435:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788876984.297741:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532479232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876984.297810:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.305776:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479232 00000100:00100000:3.0:1788876984.305792:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479232 00000100:00100000:3.0:1788876984.305863:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788876984.305873:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532479232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876984.305912:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876984.306021:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532479232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (8210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.306028:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788876984.306087:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532479232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788876984.306495:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532479488:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.306540:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.306589:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479488 00000100:00100000:0.0:1788876984.306594:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479488 00000100:00100000:0.0:1788876984.306652:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1788876984.306659:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e00ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532479488:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876984.306678:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e00ca050 x1875771532479488/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:380/0 lens 224/224 e 0 to 0 dl 1788876995 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876984.306711:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e00ca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532479488:12345-0@lo:400:kworker.0 Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.306717:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1788876984.307035:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532479488:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307071:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532479616:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307101:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.307136:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479616 00000100:00100000:0.0:1788876984.307141:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479616 00000100:00100000:0.0:1788876984.307171:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1788876984.307177:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532479616:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876984.307189:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e78e1880 x1875771532479616/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:380/0 lens 224/224 e 0 to 0 dl 1788876995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876984.307219:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532479616:12345-0@lo:400:kworker.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.307226:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1788876984.307253:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532479616:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307292:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532480000:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307314:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.307341:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480000 00000100:00100000:0.0:1788876984.307344:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480000 00000100:00100000:0.0:1788876984.307376:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:0.0:1788876984.307383:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307416:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532480000:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.307422:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00080000:0.0:1788876984.307437:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788876984.307457:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532480000:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307485:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532480128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307508:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.307555:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307574:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.307622:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480128 00000100:00100000:0.0:1788876984.307625:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480128 00000100:00100000:0.0:1788876984.307650:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480512 00000100:00100000:0.0:1788876984.307652:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480512 00000100:00100000:0.0:1788876984.307676:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1788876984.307683:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532480128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307717:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532480128:12345-0@lo:400:kworker.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.307729:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1788876984.307741:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1788876984.307746:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307775:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532480512:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.307780:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00080000:0.0:1788876984.307796:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876984.307815:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532480128:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307835:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532480512:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307862:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532480640:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307882:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.307907:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480640 00000100:00100000:0.0:1788876984.307911:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480640 00000100:00100000:0.0:1788876984.307948:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:0.0:1788876984.307955:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532480640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.307987:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532480640:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.307993:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:0.0:1788876984.308005:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788876984.308021:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532480640:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308204:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532479360:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308238:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308270:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532479872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308292:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308309:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532480384:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308327:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308345:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788876984.308350:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308369:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308385:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308405:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308416:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308434:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876984.308459:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479744 00000100:00100000:3.0:1788876984.308462:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479744 00000100:00100000:3.0:1788876984.308487:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1788876984.308493:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532479744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308522:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532479744:12345-0@lo:400:kworker.0 Request processed in 30us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.308528:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1788876984.308542:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479872 00000100:00100000:3.0:1788876984.308546:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479872 00000100:00100000:3.0:1788876984.308562:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480384 00000100:00100000:3.0:1788876984.308565:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480384 00000100:00100000:3.0:1788876984.308577:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480256 00000100:00100000:3.0:1788876984.308579:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480256 00000100:00100000:3.0:1788876984.308589:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480768 00000100:00100000:3.0:1788876984.308591:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480768 00000100:00100000:3.0:1788876984.308615:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1788876984.308622:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532479872:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876984.308634:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7adea00 x1875771532479872/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:380/0 lens 224/224 e 0 to 0 dl 1788876995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876984.308672:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1875771532479872:12345-0@lo:400:kworker.0 Request processed in 51us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.308678:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1788876984.308690:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:3.0:1788876984.308695:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532480384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308718:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532480384:12345-0@lo:400:kworker.0 Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.308723:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:3.0:1788876984.308733:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1788876984.308738:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532480256:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876984.308746:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c365b800 x1875771532480256/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:380/0 lens 224/224 e 0 to 0 dl 1788876995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876984.308771:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532480256:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.308777:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1788876984.308787:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:3.0:1788876984.308792:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532480768:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788876984.308801:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c365b100 x1875771532480768/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:380/0 lens 224/224 e 0 to 0 dl 1788876995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876984.308822:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532480768:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876984.308827:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:3.0:1788876984.308860:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308868:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308875:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532480768:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308883:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1875771532479872:0@lo:400:kworker.0 00000100:00100000:3.0:1788876984.308890:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532480384:0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.310741:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532479360 00000100:00100000:0.0:1788876984.310751:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532479360 00000100:00100000:0.0:1788876984.310788:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788876984.310796:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532479360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876984.310854:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3665:x1875771532479360:12345-0@lo:400:kworker.0 Request processed in 59us (2615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.310862:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788876984.310894:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876984.310898:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788876984.310901:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876984.310938:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532479360:0@lo:400:kworker.0 00010000:00010000:1.0:1788876984.618494:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876984.810408:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532480896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876984.810545:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876984.810654:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532481024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876984.810680:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876984.810717:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532480896 00000100:00100000:1.0:1788876984.810725:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532480896 00000100:00100000:1.0:1788876984.810766:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481024 00000100:00100000:1.0:1788876984.810769:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481024 00000100:00100000:1.0:1788876984.810789:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1788876984.810798:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532480896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788876984.810822:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876984.810867:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532480896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876984.810874:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1788876984.811153:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1788876984.811164:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532481024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788876984.811181:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876984.811220:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532481024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876984.811225:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1788876984.811416:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532481024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876984.811444:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532480896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876984.811643:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876984.811653:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532481152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788876984.811680:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876984.811702:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481152 00000100:00100000:2.0:1788876984.811706:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481152 00000100:00100000:2.0:1788876984.811726:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1788876984.811731:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532481152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788876984.811741:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788876984.811768:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532481152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876984.811774:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1788876984.811801:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532481152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876984.820593:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876984.820637:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532481280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876984.820745:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876984.820803:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481280 00000100:00100000:0.0:1788876984.820810:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481280 00000100:00100000:0.0:1788876984.820862:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1788876984.820871:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532481280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876984.820901:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:0.0:1788876984.820917:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e78e3480 x1875771532481280/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:380/0 lens 224/368 e 0 to 0 dl 1788876995 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876984.820969:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532481280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876984.820976:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1788876984.821035:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532481280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876985.007695:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876985.007729:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876985.007752:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876985.008556:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876985.008592:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876985.008634:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308032 00000100:00100000:2.0:1788876985.008643:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308032 00000100:00100000:2.0:1788876985.008692:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308160 00000100:00100000:2.0:1788876985.008695:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308160 00000100:00100000:2.0:1788876985.008718:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1941 00000100:00100000:2.0:1788876985.008728:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511308032:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:2.0:1788876985.008756:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4029180 x1875771511308032/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:381/0 lens 224/224 e 0 to 0 dl 1788876996 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876985.008945:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2396:x1875771511308032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 218us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876985.008954:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1941 00000100:00100000:2.0:1788876985.008973:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1942 00000100:00100000:2.0:1788876985.008980:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511308160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876985.009006:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511308160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876985.009013:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1942 00000100:00100000:2.0:1788876985.009031:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308288 00000100:00100000:2.0:1788876985.009035:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308288 00000100:00100000:2.0:1788876985.009055:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308416 00000100:00100000:2.0:1788876985.009058:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308416 00000100:00100000:2.0:1788876985.009074:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1485 00000100:00100000:2.0:1788876985.009080:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511308288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876985.009105:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511308288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876985.009110:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1485 00000100:00100000:2.0:1788876985.009120:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1486 00000100:00100000:2.0:1788876985.009125:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511308416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788876985.009145:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511308416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876985.009150:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1486 00000100:00100000:0.0:1788876985.009543:0:53038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307904 00000100:00100000:0.0:1788876985.009548:0:53038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307904 00000100:00100000:0.0:1788876985.009576:0:53038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:0.0:1788876985.009583:0:53038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511307904:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876985.009623:0:53038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511307904:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876985.009629:0:53038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00080000:0.0:1788876985.009662:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788876985.009666:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788876985.009669:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788876985.009671:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788876985.641989:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876986.673972:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788876987.041265:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313220 is committed 00010000:00010000:3.0:1788876987.047668:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047686:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047694:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047700:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876987.047705:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047713:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047730:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83700) 00010000:00010000:3.0:1788876987.047733:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876987.047738:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047746:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13c1487a00/0xf5bf0f7e313b03fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047766:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047773:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047778:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047787:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876987.047790:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047796:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047803:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13fae83700) 00010000:00010000:3.0:1788876987.047805:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876987.047808:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.047814:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73a00/0xf5bf0f7e313b0435 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876987.690905:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788876988.090291:0:54256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788876988.204261:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876988.204329:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308544 00000100:00100000:2.0:1788876988.204343:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308544 00000100:00100000:2.0:1788876988.204414:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2713 00000100:00100000:2.0:1788876988.204424:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41464:x1875771511308544:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:2.0:1788876988.204444:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876988.204471:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b044a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a23 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204541:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204560:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204576:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788876988.204673:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788876988.204677:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788876988.204723:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204750:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b044a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a23 expref: 8 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204765:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a23 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.204774:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4500) 00010000:00010000:2.0:1788876988.204777:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788876988.204781:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72400, rc 0) 00010000:00000080:2.0:1788876988.204788:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e78e0700 x1875771511308544/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 576/688 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/600/0 rc 0/0 job:'mv.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876988.204848:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41464:x1875771511308544:12345-192.168.203.11@tcp:101:mv.0 Request processed in 426us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876988.204855:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2713 00000100:00080000:0.0:1788876988.205121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788876988.208035:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876988.208576:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308672 00000100:00100000:3.0:1788876988.208588:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308672 00000100:00100000:3.0:1788876988.208665:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2714 00000100:00100000:3.0:1788876988.208675:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41464:x1875771511308672:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:3.0:1788876988.208698:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876988.208721:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313b0458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a2a expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208784:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208798:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208814:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208828:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208839:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208848:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208948:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208956:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.208963:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876988.209010:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x113:0x0]: returning size 0 00000004:00200000:3.0:1788876988.209014:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876988.209041:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209055:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209064:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209075:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209084:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209090:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876988.209094:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209105:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209119:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4500) 00010000:00010000:3.0:1788876988.209122:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876988.209127:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209136:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8400/0xf5bf0f7e313b045f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209147:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209197:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209204:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209209:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca8200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876988.209212:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209218:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209225:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13d5606b00) 00010000:00010000:3.0:1788876988.209227:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876988.209230:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209235:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8200/0xf5bf0f7e313b0466 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209263:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9200/0xf5bf0f7e313b0458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a2a expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209278:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a2a expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.209285:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13d5606f00) 00010000:00010000:3.0:1788876988.209290:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788876988.209293:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9400, rc 0) 00010000:00000080:3.0:1788876988.209303:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f402aa00 x1875771511308672/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 592/584 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/600/0 rc 0/0 job:'mv.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788876988.210539:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41464:x1875771511308672:12345-192.168.203.11@tcp:101:mv.0 Request processed in 1855us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876988.210550:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2714 00000100:00100000:2.0:1788876988.214006:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876988.214084:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511308800 00000100:00100000:3.0:1788876988.214095:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511308800 00000100:00100000:3.0:1788876988.214148:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2715 00000100:00100000:3.0:1788876988.214158:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41464:x1875771511308800:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:3.0:1788876988.214179:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876988.214201:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b0474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a31 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214275:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214291:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214303:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214318:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214325:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214331:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214839:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214849:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214855:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214862:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876988.214867:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214874:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214887:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4500) 00010000:00010000:3.0:1788876988.214889:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876988.214893:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214899:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9800/0xf5bf0f7e313b047b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214922:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214928:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214934:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214939:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efca9e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876988.214941:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214947:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214957:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13d5606700) 00010000:00010000:3.0:1788876988.214959:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876988.214961:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.214966:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b0482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.215004:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b0474 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a31 expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.215014:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4500) 00010000:00010000:3.0:1788876988.215016:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876988.215019:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b0474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a31 expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.215029:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8e00, rc 0) 00010000:00000080:3.0:1788876988.215037:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f402bb80 x1875771511308800/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 592/584 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/600/0 rc 301/0 job:'mv.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788876988.215116:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41464:x1875771511308800:12345-192.168.203.11@tcp:101:mv.0 Request processed in 958us (1119us total) trans 0 rc 301/301 00000100:00100000:3.0:1788876988.215124:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2715 00000100:00100000:3.0:1788876988.222828:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876988.223136:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309056 00000100:00100000:2.0:1788876988.223146:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309056 00000100:00100000:2.0:1788876988.223193:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1788876988.223202:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41464:x1875771511309056:12345-192.168.203.11@tcp:36:mv.0 00010000:00010000:2.0:1788876988.223252:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788876988.223280:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9400/0xf5bf0f7e313b046d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a2a expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223298:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13d5606f00) 00010000:00010000:2.0:1788876988.223313:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b0451 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a23 expref: 7 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223322:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4500) 00010000:00010000:2.0:1788876988.223329:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788876988.223355:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223369:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223378:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223390:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223397:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223404:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223417:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223424:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223431:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223529:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223537:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223544:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876988.223954:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0bc69e0 reply state 00000000f5128525 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223968:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223975:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13d27b4c00) 00010000:00010000:2.0:1788876988.223978:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:2.0:1788876988.223981:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788876988.223987:0:6552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223993:0:6552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.223999:0:6552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224004:0:6552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876988.224009:0:6552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224016:0:6552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224024:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d27b4600) 00010000:00010000:2.0:1788876988.224027:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876988.224030:0:6552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224035:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b0489 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788876988.224046:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0bc69e0 reply state 00000000f5128525 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224054:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224059:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13d27b4300) 00010000:00010000:2.0:1788876988.224061:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876988.224063:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1788876988.224066:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0bc69e0 reply state 00000000f5128525 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224074:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.224079:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13d27b4400) 00010000:00010000:2.0:1788876988.224080:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788876988.224082:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00000080:2.0:1788876988.224099:0:6552:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c3658000 x1875771511309056/t90194313221(0) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 536/456 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/200/0 rc 0/0 job:'mv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876988.224164:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41464:x1875771511309056:12345-192.168.203.11@tcp:36:mv.0 Request processed in 963us (1346us total) trans 90194313221 rc 0/0 00000100:00100000:2.0:1788876988.224171:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1788876988.245397:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876988.245505:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309184 00000100:00100000:3.0:1788876988.245514:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309184 00000100:00100000:3.0:1788876988.245568:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2716 00000100:00100000:3.0:1788876988.245578:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41465:x1875771511309184:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1788876988.245742:0:6540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788876988.245826:0:6540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b04a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a38 expref: -99 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.245887:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.245901:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.245924:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788876988.245969:0:6540:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788876988.245974:0:6540:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788876988.245993:0:6540:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.246015:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca8e00/0xf5bf0f7e313b04a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a38 expref: 10 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.246034:0:6540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a38 expref: 9 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876988.246044:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606700) 00010000:00010000:3.0:1788876988.246047:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788876988.246051:0:6540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9e00, rc 0) 00010000:00000080:3.0:1788876988.246058:0:6540:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f4028380 x1875771511309184/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 576/688 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788876988.246723:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:41465:x1875771511309184:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1141us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876988.246732:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2716 00000100:00100000:1.0:1788876988.258441:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876988.258509:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309312 00000100:00100000:2.0:1788876988.258520:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309312 00000100:00100000:2.0:1788876988.258582:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2717 00000100:00100000:2.0:1788876988.258593:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:41465:x1875771511309312:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788876988.258873:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788876988.258894:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b04b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a3f expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.258962:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.258977:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.258989:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259000:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259007:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259013:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259058:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259065:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259072:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259078:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876988.259082:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259090:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259101:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606700) 00010000:00010000:2.0:1788876988.259104:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876988.259109:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259116:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72400/0xf5bf0f7e313b04ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259125:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259131:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259136:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259143:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788876988.259146:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259152:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259158:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13d27b4400) 00010000:00010000:2.0:1788876988.259161:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876988.259163:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259169:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72a00/0xf5bf0f7e313b04c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259196:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b04b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a3f expref: 10 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259207:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606700) 00010000:00010000:2.0:1788876988.259209:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788876988.259213:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73200/0xf5bf0f7e313b04b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a3f expref: 10 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876988.259221:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73200, rc 0) 00010000:00000080:2.0:1788876988.259229:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13d3034000 x1875771511309312/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:384/0 lens 592/584 e 0 to 0 dl 1788876999 ref 1 fl Interpret:/600/0 rc 301/0 job:'rm.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788876988.259305:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:41465:x1875771511309312:12345-192.168.203.11@tcp:101:rm.0 Request processed in 713us (870us total) trans 0 rc 301/301 00000100:00100000:2.0:1788876988.259315:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2717 00010000:00010000:2.0:1788876988.716089:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876988.912375:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532481408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788876988.912445:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876988.912548:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481408 00000100:00100000:2.0:1788876988.912556:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481408 00000100:00100000:2.0:1788876988.912647:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1788876988.912657:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532481408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788876988.912683:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788876988.912727:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532481408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876988.912734:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:1.0:1788876988.913121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876988.913158:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532481408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788876989.421028:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532481536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876989.421095:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876989.421990:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481536 00000100:00100000:3.0:1788876989.421998:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481536 00000100:00100000:3.0:1788876989.422055:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788876989.422063:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532481536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788876989.422097:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:3.0:1788876989.422153:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532481536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876989.422159:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1788876989.422216:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532481536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788876989.425244:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532482048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425309:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425347:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532482560:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425373:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425395:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532483072:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425416:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425446:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788876989.425451:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532481664:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425477:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425497:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532482176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425517:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425532:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532482688:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.425551:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.425577:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482560 00000100:00100000:2.0:1788876989.425583:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482560 00000100:00100000:1.0:1788876989.425893:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.425934:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.425952:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532482304:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.425973:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.425990:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532482816:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.426010:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.426030:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788876989.426036:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532481920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.426057:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.426074:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532482432:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.426093:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.426109:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.426850:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483072 00000100:00100000:2.0:1788876989.426856:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483072 00000100:00100000:2.0:1788876989.426867:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482176 00000100:00100000:2.0:1788876989.426869:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482176 00000100:00100000:2.0:1788876989.426881:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482688 00000100:00100000:2.0:1788876989.426884:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482688 00000100:00100000:2.0:1788876989.426893:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482304 00000100:00100000:2.0:1788876989.426895:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482304 00000100:00100000:2.0:1788876989.426917:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481920 00000100:00100000:2.0:1788876989.426919:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481920 00000100:00100000:2.0:1788876989.426934:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1788876989.426942:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532482560:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876989.426962:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f40e1f80 x1875771532482560/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:385/0 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876989.427006:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f40e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875771532482560:12345-0@lo:400:kworker.0 Request processed in 65us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.427013:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1788876989.427027:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1788876989.427033:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532483072:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876989.427044:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f452dc00 x1875771532483072/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:385/0 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876989.427069:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875771532483072:12345-0@lo:400:kworker.0 Request processed in 36us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.427075:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1788876989.427085:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788876989.427092:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532482176:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1788876989.427102:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f452d880 x1875771532482176/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:385/0 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788876989.427128:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875771532482176:12345-0@lo:400:kworker.0 Request processed in 36us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.427133:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:2.0:1788876989.427145:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1788876989.427150:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532482688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.427176:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532482688:12345-0@lo:400:kworker.0 Request processed in 26us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.427182:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1788876989.427193:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1788876989.427199:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532482304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.427725:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876989.427837:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532482304:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.427876:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482048 00000100:00100000:1.0:1788876989.427880:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482048 00000100:00100000:1.0:1788876989.427919:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482816 00000100:00100000:1.0:1788876989.427922:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482816 00000100:00100000:1.0:1788876989.427942:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482432 00000100:00100000:1.0:1788876989.427945:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482432 00000100:00100000:1.0:1788876989.427963:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532482944 00000100:00100000:1.0:1788876989.427966:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532482944 00000100:00100000:1.0:1788876989.427988:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1788876989.427995:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.428028:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532482048:12345-0@lo:400:kworker.0 Request processed in 34us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876989.428034:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:1.0:1788876989.428047:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788876989.428053:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532482816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.428083:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532482816:12345-0@lo:400:kworker.0 Request processed in 30us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876989.428089:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788876989.428099:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1788876989.428106:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532482432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.428133:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532482432:12345-0@lo:400:kworker.0 Request processed in 27us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876989.428138:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1788876989.428148:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1788876989.428154:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532482944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.428178:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532482944:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876989.428184:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1788876989.428205:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1788876989.428212:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532481920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876989.428324:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481792 00000100:00100000:0.0:1788876989.428329:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481792 00000100:00100000:0.0:1788876989.428357:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1788876989.428364:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532481792:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1788876989.428378:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13d3035180 x1875771532481792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:385/0 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876989.428407:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532481792:12345-0@lo:400:kworker.0 Request processed in 45us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876989.428413:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1788876989.430711:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532482304:12345-0@lo:400:kworker.0 Request processed in 25us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.430726:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1788876989.430844:0:53037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532481664 00000100:00100000:2.0:1788876989.430852:0:53037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532481664 00000100:00100000:2.0:1788876989.430914:0:53037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788876989.430923:0:53037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532481664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.430992:0:53037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532481664:12345-0@lo:400:kworker.0 Request processed in 70us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876989.430998:0:53037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788876989.431055:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532481664:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.431072:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1875771532482176:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.431084:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532482688:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.431096:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532482048:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.431108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1875771532482560:0@lo:400:kworker.0 00000100:00100000:2.0:1788876989.431120:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875771532483072:0@lo:400:kworker.0 00010000:00000080:1.0:1788876989.431207:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a12c606fb80 x1875771532481920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:385/0 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876989.431246:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532481920:12345-0@lo:400:kworker.0 Request processed in 3035us (5188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876989.431253:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00080000:1.0:1788876989.431276:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788876989.431280:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788876989.431283:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788876989.431285:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788876989.431332:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532481920:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.431343:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532482432:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.431354:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.431364:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788876989.431377:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532482816:0@lo:400:kworker.0 00010000:00010000:2.0:1788876989.739408:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876989.928998:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876989.929022:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532483200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788876989.929090:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876989.929224:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788876989.929234:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532483328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788876989.929264:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876989.929300:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483328 00000100:00100000:3.0:1788876989.929306:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483328 00000100:00100000:3.0:1788876989.929351:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1788876989.929359:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532483328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788876989.929386:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876989.929424:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532483328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876989.929430:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1788876989.929475:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532483328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788876989.929726:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483200 00000100:00100000:0.0:1788876989.929732:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483200 00000100:00100000:0.0:1788876989.929845:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1788876989.929855:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532483200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788876989.929878:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:0.0:1788876989.929892:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fae33b80 x1875771532483200/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:385/0 lens 224/368 e 0 to 0 dl 1788877000 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788876989.929937:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532483200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876989.929943:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1788876989.930090:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788876989.930099:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532483456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788876989.930438:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876989.930489:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532483200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788876989.930706:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483456 00000100:00100000:0.0:1788876989.930712:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483456 00000100:00100000:0.0:1788876989.930747:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1788876989.930754:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532483456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788876989.930766:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788876989.930943:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876989.930985:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532483456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876989.930992:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1788876989.931162:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532483456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788876989.931857:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532483584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788876989.931892:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876989.933446:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483584 00000100:00100000:3.0:1788876989.933455:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483584 00000100:00100000:3.0:1788876989.933552:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1788876989.933561:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532483584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876989.933582:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876989.933662:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532483584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876989.933669:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1788876989.933755:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13d3025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532483584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876990.132805:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876990.132838:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876990.132864:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876990.132882:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876990.132918:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876990.132946:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309824 00000100:00100000:0.0:1788876990.132957:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309824 00000100:00100000:0.0:1788876990.133008:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309952 00000100:00100000:0.0:1788876990.133011:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309952 00000100:00100000:0.0:1788876990.133033:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1491 00000100:00100000:0.0:1788876990.133043:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511309824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876990.133283:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511309824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 239us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876990.133290:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1491 00000100:00100000:0.0:1788876990.133307:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1492 00000100:00100000:0.0:1788876990.133314:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511309952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876990.133340:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511309952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876990.133345:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1492 00000100:00100000:0.0:1788876990.133362:0:53040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309440 00000100:00100000:0.0:1788876990.133365:0:53040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309440 00000100:00100000:0.0:1788876990.133429:0:53040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:0.0:1788876990.133436:0:53040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c35ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511309440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876990.133461:0:53040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c35ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511309440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876990.133466:0:53040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:1.0:1788876990.133648:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309568 00000100:00100000:1.0:1788876990.133653:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309568 00000100:00100000:1.0:1788876990.133722:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309696 00000100:00100000:1.0:1788876990.133726:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309696 00000100:00100000:1.0:1788876990.133759:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1949 00000100:00100000:1.0:1788876990.133766:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511309568:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:1.0:1788876990.133782:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e78e3100 x1875771511309568/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:386/0 lens 224/224 e 0 to 0 dl 1788877001 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876990.133808:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511309568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876990.133815:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1949 00000100:00100000:1.0:1788876990.133828:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1950 00000100:00100000:1.0:1788876990.133834:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511309696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876990.133855:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511309696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876990.133860:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1950 00000100:00080000:2.0:1788876990.134662:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788876990.134667:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788876990.134669:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876990.134671:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1788876990.194086:0:54353:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788876990.194134:0:54353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.194147:0:54353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.194157:0:54353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.194165:0:54353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.195707:0:54353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788876990.195717:0:54353:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788876990.197540:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788876990.197546:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788876990.197552:0:54353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788876990.197573:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13d0608800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788876990.198384:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532483712:0@lo:39:umount.0 00000100:00100000:3.0:1788876990.198457:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876990.201867:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483712 00000100:00100000:1.0:1788876990.201879:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483712 00000100:00100000:1.0:1788876990.202725:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1788876990.202806:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532483712:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788876990.202836:0:6539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b018e 00000100:00080000:1.0:1788876990.202853:0:6539:0:(import.c:65:import_set_state_nolock()) ffff8a12c36e4800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788876990.203131:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876990.203139:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.203149:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d800 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876990.203153:0:6527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.203168:0:6527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876990.203175:0:6527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876990.203181:0:6527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876990.203183:0:6527:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788876990.203186:0:6527:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788876990.203226:0:6527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.203233:0:6527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876990.203264:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.203272:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d800/0xf5bf0f7e313b0076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b007d expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788876990.203291:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876990.203305:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532483840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876990.203360:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876990.203409:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483840 00000100:00100000:2.0:1788876990.203413:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483840 00000100:00100000:2.0:1788876990.203445:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788876990.203452:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3662:x1875771532483840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.203464:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876990.203477:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef41a00/0xf5bf0f7e313b007d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0076 expref: 24 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.203489:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876990.203523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532483840:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876990.203530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788876990.203567:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532483840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.203584:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.203586:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.203588:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:1.0:1788876990.205467:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13d3027b80 x1875771532483712/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:386/0 lens 224/224 e 0 to 0 dl 1788877001 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788876990.205540:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532483712:12345-0@lo:39:umount.0 Request processed in 2806us (7082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876990.205550:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000020:00000080:1.0:1788876990.205560:0:6539:0:(genops.c:885:class_export_put()) final put ffff8a13eefd8800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788876990.205843:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d0608800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788876990.205861:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532483712:0@lo:39:umount.0 00000100:00080000:1.0:1788876990.205983:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788876990.205987:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788876990.205991:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788876990.206705:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13eefd8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788876990.206830:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c36e4800 for lustre-MDT0000 00010000:00010000:1.0:1788876990.207340:0:54353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.207355:0:54353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.207362:0:54353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.207369:0:54353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.209053:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876990.209064:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.209074:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8d600 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876990.209079:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.209089:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876990.209097:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876990.209104:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876990.209107:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788876990.209143:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.209150:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788876990.209182:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.209192:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876990.209318:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532483968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788876990.209380:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876990.209467:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532483968 00000100:00100000:3.0:1788876990.209474:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532483968 00000100:00100000:3.0:1788876990.209528:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788876990.209537:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3664:x1875771532483968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788876990.209550:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788876990.209564:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8ce00/0xf5bf0f7e313affa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aff9d expref: 23 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.209579:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788876990.209722:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3664:x1875771532483968:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876990.209729:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788876990.209874:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532483968:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.210086:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.210090:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876990.213160:0:54353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876990.213174:0:54353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d600/0xf5bf0f7e313aff9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313affa4 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.213207:0:54353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.213217:0:54353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.213225:0:54353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.213233:0:54353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.215468:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788876990.215481:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.215493:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c3221c00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:2.0:1788876990.215498:0:6528:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.215508:0:6528:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788876990.215516:0:6528:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788876990.215522:0:6528:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788876990.215524:0:6528:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788876990.217815:0:6528:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.217829:0:6528:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788876990.217886:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788876990.217921:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.217936:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.217938:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.217941:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876990.219046:0:54353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788876990.219055:0:54353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221c00/0xf5bf0f7e313b00b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b00bc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788876990.219074:0:54353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788876990.219088:0:54353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219097:0:54353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219104:0:54353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219111:0:54353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219138:0:54353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788876990.219144:0:54353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219150:0:54353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219156:0:54353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219163:0:54353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788876990.219173:0:54353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788876990.219176:0:54353:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788876990.219179:0:54353:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788876990.219232:0:54353:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788876990.219236:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1788876990.219240:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1788876990.219245:0:54353:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1788876990.219699:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788876990.219706:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219714:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876990.219718:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219727:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876990.219745:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876990.219753:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788876990.219755:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788876990.219757:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788876990.219788:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219794:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788876990.219814:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219821:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef41200/0xf5bf0f7e313b0068 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b006f expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219833:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788876990.219836:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219842:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7b8dc00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:0.0:1788876990.219846:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219853:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788876990.219861:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788876990.219866:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788876990.219869:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788876990.219871:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788876990.219881:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219887:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788876990.219893:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219910:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8dc00/0xf5bf0f7e313aff8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313aff96 expref: -99 pid: 53032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.219927:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876990.219929:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876990.219931:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788876990.221875:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532484224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876990.222370:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876990.222432:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788876990.222440:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532484352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876990.222465:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876990.222495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484224 00000100:00100000:2.0:1788876990.222504:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484224 00000100:00100000:2.0:1788876990.222553:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484352 00000100:00100000:2.0:1788876990.222556:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484352 00000100:00100000:2.0:1788876990.222580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788876990.222589:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3662:x1875771532484224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.222631:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876990.222652:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b006f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0068 expref: 23 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.222667:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876990.222702:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3662:x1875771532484224:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876990.222710:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788876990.222726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788876990.222733:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3662:x1875771532484352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.222991:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788876990.223001:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c200/0xf5bf0f7e313aff96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313aff8f expref: 21 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.223011:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788876990.223034:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3662:x1875771532484352:12345-0@lo:103:ldlm_bl.0 Request processed in 302us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876990.223044:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788876990.223084:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532484352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788876990.223093:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532484224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788876990.223114:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.223119:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876990.224311:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532484096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788876990.224352:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:1.0:1788876990.224980:0:54353:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788876990.225664:0:53033:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313221 is committed 00010000:00010000:3.0:1788876990.225763:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225775:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225783:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225789:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876990.225794:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225802:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225819:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13d27b4400) 00010000:00010000:3.0:1788876990.225822:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876990.225827:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225834:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0497 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225850:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225857:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225863:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225872:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876990.225876:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225881:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225888:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13d27b4300) 00010000:00010000:3.0:1788876990.225890:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788876990.225893:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225910:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0490 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225928:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225934:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225939:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225944:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788876990.225946:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225952:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225963:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13d27b4c00) 00010000:00010000:3.0:1788876990.225965:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788876990.225968:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788876990.225972:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73000/0xf5bf0f7e313b049e lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788876990.226323:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788876990.226330:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13ff338800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876990.226336:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0e67800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876990.226341:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0e65000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788876990.226347:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c3002800 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 6 (0 0 1) 0 0 0 0: 0000000000000000 90194313221 stale:0 00000020:00080000:1.0:1788876990.226352:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13c3000800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788876990.226356:0:54353:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has exports, disconnecting them 00000020:00080000:1.0:1788876990.226360:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13ff338800), last request at 1788876989 00000020:00000080:1.0:1788876990.226366:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0187 00000100:00080000:1.0:1788876990.226374:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13eefda800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876990.226403:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13ff338800): rc 0 00000020:00000080:1.0:1788876990.226405:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ff338800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788876990.226414:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d0e67800), last request at 1788876989 00000020:00000080:1.0:1788876990.226417:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0180 00000100:00080000:1.0:1788876990.226421:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13ff33b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876990.226428:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d0e67800): rc 0 00000020:00000080:1.0:1788876990.226430:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d0e67800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788876990.226433:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d0e65000), last request at 1788876953 00000020:00000080:1.0:1788876990.226435:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0179 00000100:00080000:1.0:1788876990.226437:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e61800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876990.226443:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d0e65000): rc 0 00000020:00000080:1.0:1788876990.226445:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d0e65000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788876990.226449:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a13c3002800), last request at 1788876990 00000020:00000080:1.0:1788876990.226457:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affea 00000020:00010000:1.0:1788876990.226467:0:54353:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13c3002800: total 3 00000100:00080000:1.0:1788876990.226470:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd62800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876990.226503:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13c3002800): rc 0 00000020:00080000:1.0:1788876990.226506:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13c3000800), last request at 1788876948 00000020:00000080:1.0:1788876990.226509:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affe3 00000100:00080000:1.0:1788876990.226513:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e64800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788876990.226518:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13c3000800): rc 0 00000020:00000080:1.0:1788876990.226520:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c3000800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1788876990.226527:0:54353:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa620879b7ae0 00000100:00080000:1.0:1788876990.226543:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788876990.226547:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1788876990.226779:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13c3002800: total 4 00010000:00010000:2.0:1788876990.226823:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13c3002800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788876990.226851:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efca9e00/0xf5bf0f7e313b04ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a38 expref: 2 pid: 6540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.226868:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13c3002800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788876990.229473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff338800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876990.229531:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e67800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876990.229548:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e65000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876990.229565:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3000800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788876990.229588:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13eefda800 for lustre-MDT0000 00000020:00000080:3.0:1788876990.229593:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff33b000 for lustre-MDT0000 00000020:00000080:3.0:1788876990.229598:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e61800 for lustre-MDT0000 00000020:00000080:3.0:1788876990.229629:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e64800 for lustre-MDT0000 00000100:00100000:0.0:1788876990.230886:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484096 00000100:00100000:0.0:1788876990.230907:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484096 00000100:00080000:1.0:1788876990.231481:0:54353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788876990.231511:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13ef00a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788876990.231823:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788876990.231834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3664:x1875771532484096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788876990.231848:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788876990.231867:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8cc00/0xf5bf0f7e313b00bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00b5 expref: 20 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788876990.231882:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788876990.232024:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3664:x1875771532484096:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (7670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876990.232032:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788876990.232118:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484480:0@lo:39:umount.0 00000100:00100000:3.0:1788876990.232161:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876990.232279:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484480 00000100:00100000:0.0:1788876990.232284:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484480 00000100:00100000:0.0:1788876990.232312:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1788876990.232318:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532484480:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788876990.232341:0:6545:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b001b 00000100:00080000:0.0:1788876990.232348:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a12c49fc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788876990.232365:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967327 00000100:00100000:0.0:1788876990.232485:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532484480:12345-0@lo:39:umount.0 Request processed in 166us (324us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788876990.232492:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:3.0:1788876990.232703:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef00a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788876990.232711:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484480:0@lo:39:umount.0 00000100:00100000:3.0:1788876990.232733:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532484096:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788876990.233881:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788876990.233888:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934861 gen 3 00000004:00080000:1.0:1788876990.234264:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788876990.234319:0:54353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788876990.234343:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13ff364800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788876990.234365:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788876990.234368:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967569 gen 3 00000004:00080000:1.0:1788876990.234380:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788876990.234434:0:54353:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788876990.234445:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788876990.234483:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has no exports 00000100:00100000:0.0:1788876990.235001:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484608:0@lo:9:umount.0 00000100:00100000:0.0:1788876990.235054:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876990.235086:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484736:0@lo:9:umount.0 00000100:00100000:0.0:1788876990.235105:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876990.235161:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484608 00000100:00100000:3.0:1788876990.235168:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484608 00000100:00100000:3.0:1788876990.236019:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484736 00000100:00100000:3.0:1788876990.236025:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484736 00000100:00100000:3.0:1788876990.236052:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1788876990.236060:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532484608:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788876990.236083:0:43953:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0045 00000100:00080000:3.0:1788876990.236090:0:43953:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7ad800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788876990.236122:0:43953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934861 00000100:00100000:3.0:1788876990.236995:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532484608:12345-0@lo:9:umount.0 Request processed in 855us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876990.237005:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1788876990.237024:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1788876990.237031:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532484736:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788876990.237045:0:43953:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0053 00000100:00080000:3.0:1788876990.237052:0:43953:0:(import.c:65:import_set_state_nolock()) ffff8a12c22f1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788876990.237071:0:43953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967569 00000100:00100000:3.0:1788876990.237149:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532484736:12345-0@lo:9:umount.0 Request processed in 119us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876990.237155:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000020:00080000:1.0:1788876990.237416:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a12c25eb380) has no exports 00000100:00080000:3.0:1788876990.237716:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff364800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788876990.239905:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:0.0:1788876990.248219:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788876990.248234:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788876990.254195:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.254211:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f402ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484608:0@lo:9:umount.0 00000100:00080000:3.0:1788876990.254254:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a12c3408000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788876990.254268:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788876990.254270:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.254273:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532484736:0@lo:9:umount.0 00000020:00000080:2.0:1788876990.278459:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13c3002800/f0204769-56bd-4f5c-ab97-74c450c9e072 00010000:00010000:2.0:1788876990.278491:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.278494:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.278497:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788876990.278823:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3002800/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:3.0:1788876990.286325:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13cfd62800 for lustre-MDT0000 00000020:00000080:1.0:1788876990.298463:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affff 00000020:00000080:1.0:1788876990.298480:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13f43d5800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788876990.298539:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788876990.298866:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788876990.298876:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788876990.298882:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a12c3f63380) has no exports 00000020:00000080:3.0:1788876990.299228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f43d5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788876990.299381:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313afff8 00000020:00000080:0.0:1788876990.299387:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d212d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788876990.299436:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788876990.299444:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788876990.299447:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c5ffc800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788876990.299449:0:54353:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c5ffc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788876990.299457:0:54353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788876990.299590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d212d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788876990.299995:0:54353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c4c92b40 - data ffff8a13ee844af8/ffff8a12c5d33000 00000020:01000000:0.0:1788876990.300119:0:54353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13e6fa0ea0 - data ffff8a13f0116d80/ffff8a12c5af7c00 00000100:00080000:3.0:1788876990.364381:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788876990.364389:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788876990.364402:0:54353:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13fad1f800 x1875771532484480/t4294967328(4294967328) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788877000 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788876990.364426:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788876990.366667:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788876990.366672:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934861 gen 4 00000004:00080000:3.0:1788876990.366690:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.366693:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788876990.367377:0:53050:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788876990.367382:0:53050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x54:0x0] index 1 count 1 00000040:00080000:1.0:1788876990.367394:0:53050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 21 count 2 00000100:00080000:3.0:1788876990.368237:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788876990.368240:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967569 gen 4 00000004:00080000:3.0:1788876990.368258:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.368260:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788876990.368541:0:53052:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788876990.368544:0:53052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x56:0x0] index 1 count 1 00000040:00080000:1.0:1788876990.368552:0:53052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 21 count 2 00000020:00000080:3.0:1788876990.370352:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affb9 00000020:00000080:3.0:1788876990.370361:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ff37f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876990.370723:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788876990.371363:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affce 00000020:00000080:3.0:1788876990.371370:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d0e65800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876990.371387:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788876990.371393:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876990.371401:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788876990.371405:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a12c25ecd40) has no exports 00000004:01000000:3.0:1788876990.372095:0:54353:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788876990.372105:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b004c 00000020:00000080:3.0:1788876990.372110:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ff37c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876990.372115:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788876990.372119:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876990.372127:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876990.372130:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a13c79c4d40) has no exports 00000020:00000080:3.0:1788876990.372135:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b003e 00000020:00000080:3.0:1788876990.372138:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a12c340e800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788876990.372440:0:54353:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788876990.372457:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788876990.372461:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967569 gen 5 00000004:00080000:3.0:1788876990.372467:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.372469:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788876990.372498:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876990.372505:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788876990.372510:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0030 00000020:00000080:3.0:1788876990.372514:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c511b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876990.372518:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788876990.372521:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876990.372525:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876990.372527:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c4e30000) has no exports 00000020:00000080:3.0:1788876990.372531:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0029 00000020:00000080:3.0:1788876990.372533:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ff363800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876990.372869:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e65800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788876990.372878:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788876990.372883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876990.372887:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c3408000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788876990.372893:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13c511f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876990.372904:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788876990.372909:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876990.372979:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788876990.372984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff363800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788876990.373433:0:54353:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788876990.373436:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788876990.373439:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934861 gen 5 00000004:00080000:3.0:1788876990.373443:0:54353:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788876990.373445:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788876990.373482:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876990.373488:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788876990.373498:0:54353:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788876990.373502:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0014 00000020:00000080:3.0:1788876990.373507:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c511c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788876990.373511:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788876990.373514:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876990.373518:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788876990.373520:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a12c25e99c0) has no exports 00000020:00000080:3.0:1788876990.373524:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b000d 00000020:00000080:3.0:1788876990.373527:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ef008000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876990.375253:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff364800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788876990.375265:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13c511f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876990.375268:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788876990.375274:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876990.375333:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c511c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788876990.375339:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef008000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788876990.382712:0:54353:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788876990.382720:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788876990.382725:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788876990.382732:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788876990.382791:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876990.382801:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876990.382830:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876990.382832:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876990.382837:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ef00e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876990.382841:0:54353:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef00e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788876990.382847:0:54353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788876990.382954:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affd5 00000020:00000080:2.0:1788876990.382960:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d0e63000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788876990.382964:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788876990.382968:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876990.382972:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788876990.382975:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c25e8000) has no exports 00000020:00000080:2.0:1788876990.382995:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876990.382998:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788876990.383001:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313affdc 00000020:00000080:2.0:1788876990.383004:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13d0e62800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788876990.383010:0:54353:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13f43d5000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788876990.383013:0:54353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13f43d5000 3 00000020:01000004:2.0:1788876990.383015:0:54353:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13f43d5000 from lustre-MDT0000 00000020:00000080:2.0:1788876990.383032:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876990.383035:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788876990.383037:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13ff37e000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788876990.383039:0:54353:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788876990.383045:0:54353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788876990.383069:0:54353:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788876990.383072:0:54353:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788876990.383075:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788876990.383077:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876990.383079:0:54353:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788876990.383085:0:54353:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f43d1800 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876990.383092:0:54353:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13f35a9800 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876990.383097:0:54353:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c3f619c0) has exports, disconnecting them 00000020:00080000:2.0:1788876990.383100:0:54353:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a13f43d1800), last request at 1788876947 00000020:00000080:2.0:1788876990.383118:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aff7a 00000020:00010000:2.0:1788876990.383122:0:54353:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f43d1800: total 2 00000100:00080000:2.0:1788876990.383125:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13f43d2800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876990.383135:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13f43d1800): rc 0 00000020:00080000:2.0:1788876990.383138:0:54353:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13f35a9800), last request at 1788876947 00000020:00000080:2.0:1788876990.383175:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aff73 00000020:00010000:2.0:1788876990.383177:0:54353:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13f35a9800: total 2 00000100:00080000:2.0:1788876990.383180:0:54353:0:(import.c:65:import_set_state_nolock()) ffff8a13c3003000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788876990.383186:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13f35a9800): rc 0 00000020:00080000:2.0:1788876990.383190:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c3f619c0) has no exports 00000020:00000080:1.0:1788876990.383313:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ef00a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788876990.383322:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13c2d03000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876990.383324:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c2d03000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788876990.383328:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788876990.383378:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e63000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788876990.383381:0:36:0:(genops.c:885:class_export_put()) final put ffff8a13ef00c800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788876990.383383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef00c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788876990.383386:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788876990.383407:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e62800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788876990.386110:0:53037:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13cfcd4200:53037] 0 exiting: rc = 1 00000020:00010000:2.0:1788876990.386854:0:6528:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f43d1800: total 0 00010000:00010000:2.0:1788876990.386860:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.386921:0:6528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f43d1800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788876990.386956:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220e00/0xf5bf0f7e313b011e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0117 expref: 14 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.386975:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220800/0xf5bf0f7e313b0110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0109 expref: 13 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.386986:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b013a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0133 expref: 12 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.386998:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221600/0xf5bf0f7e313b012c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0125 expref: 11 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387010:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8de00/0xf5bf0f7e313b00ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00c3 expref: 10 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387021:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3220400/0xf5bf0f7e313b0148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0141 expref: 9 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387035:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8da00/0xf5bf0f7e313b00d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00d1 expref: 8 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387045:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221200/0xf5bf0f7e313b0156 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b014f expref: 7 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387058:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c000/0xf5bf0f7e313b00e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00df expref: 6 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387069:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40000/0xf5bf0f7e313b0164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b015d expref: 5 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387079:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9000/0xf5bf0f7e313b00f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00ed expref: 4 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387089:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221e00/0xf5bf0f7e313b0172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b016b expref: 3 pid: 53038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387100:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a12c3221000/0xf5bf0f7e313b0102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b00fb expref: 2 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387109:0:6528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f43d1800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788876990.387127:0:6528:0:(genops.c:885:class_export_put()) final put ffff8a13f43d1800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00000020:00010000:2.0:1788876990.387140:0:6528:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13f35a9800: total 1 00010000:00010000:2.0:1788876990.387159:0:6528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13f35a9800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1788876990.387176:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40800/0xf5bf0f7e313b00a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489eb expref: 5 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387189:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca8a00/0xf5bf0f7e313b00a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489e4 expref: 4 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387201:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13e7b8c800/0xf5bf0f7e313b00ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489f2 expref: 3 pid: 53037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387213:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef40200/0xf5bf0f7e313b0099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc370489dd expref: 2 pid: 53040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788876990.387224:0:6528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13f35a9800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1788876990.387234:0:6528:0:(genops.c:885:class_export_put()) final put ffff8a13f35a9800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00010000:00010000:2.0:1788876990.387239:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.387241:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788876990.387243:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788876990.387928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f43d1800/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:1.0:1788876990.387961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f35a9800/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:1.0:1788876990.387975:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13f43d2800 for MGS 00000020:00000080:1.0:1788876990.387979:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c3003000 for MGS 00000100:00100000:1.0:1788876990.388812:0:53038:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a13cfcd4c00:53038] 1 exiting: rc = 0 00010000:00010000:1.0:1788876990.388876:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788876990.401818:0:53040:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13c3d02c00:53040] 2 exiting: rc = 0 00000100:00100000:2.0:1788876990.401972:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.401982:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.401988:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.401994:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.401999:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402005:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402011:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402016:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402022:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402029:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402034:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402040:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402047:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402053:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402058:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402064:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402070:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402076:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402084:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402090:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402096:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402101:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402107:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402112:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402117:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402122:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402127:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402133:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402139:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402145:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402150:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402156:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402161:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402166:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402172:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402178:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402185:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402190:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402195:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402200:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402206:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402211:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402217:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402222:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402227:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402232:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402237:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402242:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402247:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402253:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402259:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402264:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402270:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402276:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402282:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402287:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402293:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402299:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402303:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402309:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402314:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402320:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402327:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788876990.402333:0:54353:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788876990.403231:0:54353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13efe541e0 - data ffff8a13f0024ca8/ffff8a13effc2c00 00000020:01000000:2.0:1788876990.403345:0:54353:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c4c92e40 - data ffff8a12c1e50ca8/ffff8a13fac95000 00000020:00000080:2.0:1788876990.404005:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aff6c 00000020:00000080:2.0:1788876990.404013:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13f35ad800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788876990.404030:0:54353:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13f43d5000 from MGS, refs=2 00000020:01000004:2.0:1788876990.404033:0:54353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13f43d5000 2 00000020:01000004:2.0:1788876990.404036:0:54353:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13f43d5000 from MGS 00000020:00000080:2.0:1788876990.404055:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788876990.404061:0:54353:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788876990.404063:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c8695000/MGS 00000020:00000080:2.0:1788876990.404066:0:54353:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c8695000/MGS for MGS 00000020:01000000:2.0:1788876990.404072:0:54353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788876990.404130:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788876990.404133:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788876990.404144:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788876990.404149:0:54353:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a12c340c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788876990.404155:0:54353:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c4e319c0) has exports, disconnecting them 00000020:00080000:2.0:1788876990.404159:0:54353:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a12c340c800), last request at 1788876948 00000020:00000080:2.0:1788876990.404163:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b008b 00000020:00080000:2.0:1788876990.404171:0:54353:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c340c800): rc 0 00000020:00000080:2.0:1788876990.404175:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a12c340c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788876990.404513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f35ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876990.404522:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788876990.452728:0:54353:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788876990.452799:0:54353:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788876990.452804:0:54353:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788876990.452812:0:54353:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788876990.453045:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788876990.453060:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788876990.453067:0:54353:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13f43d5000 1 00000020:00000080:3.0:1788876990.453075:0:54353:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313aff5e 00000020:00000080:3.0:1788876990.453083:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13c8697000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876990.453106:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0608800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788876990.453115:0:8:0:(genops.c:885:class_export_put()) final put ffff8a12c340b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788876990.453117:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c340b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788876990.453129:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1788876990.453389:0:54353:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788876990.453395:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788876990.453400:0:54353:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788876990.453405:0:54353:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c5e3cd40) has no exports 00000020:00000080:1.0:1788876990.456160:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c8697000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788876990.468429:0:54353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788876990.468442:0:54353:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788876990.468448:0:54353:0:(genops.c:885:class_export_put()) final put ffff8a13fa7bf800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788876990.468452:0:54353:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788876990.468458:0:54353:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788876990.468566:0:54353:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13fa7bf000 00000020:02000400:1.0:1788876990.468866:0:54353:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788876990.765924:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876991.789544:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876992.808923:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876993.832898:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876994.024916:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532484864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876994.024997:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788876994.025111:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532484864 00000100:00100000:1.0:1788876994.025119:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532484864 00000100:00100000:1.0:1788876994.025184:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1788876994.025193:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532484864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788876994.025221:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788876994.025571:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788876994.029842:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532484864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4640us (4835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876994.029857:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1788876994.039155:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532484864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876994.540477:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532485120:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540555:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.540598:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532485632:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540649:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.540673:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788876994.540678:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532485248:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540698:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.540714:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540734:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.540760:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485760 00000100:00100000:3.0:1788876994.540768:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485760 00000100:00100000:3.0:1788876994.540804:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1788876994.540814:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532485760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540862:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532485760:12345-0@lo:400:kworker.0 Request processed in 49us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876994.540870:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1788876994.540919:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532485760:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540947:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532485376:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.540970:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.540998:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.541021:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.541036:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788876994.541042:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532484992:0@lo:400:kworker.0 00000400:00000100:3.0:1788876994.541060:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532484992 offset 0 length 224: 4 00000100:00100000:3.0:1788876994.541076:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532485504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.541094:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876994.541106:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532486016:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.541124:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876994.541254:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485376 00000100:00100000:0.0:1788876994.541259:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485376 00000100:00100000:0.0:1788876994.541299:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1788876994.541306:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532485376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788876994.541341:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532485376:12345-0@lo:400:kworker.0 Request processed in 36us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876994.541348:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1788876994.541722:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485120 00000100:00100000:1.0:1788876994.541727:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485120 00000100:00100000:1.0:1788876994.541755:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788876994.541761:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1875771532485120:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876994.541768:0:6544:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876994.541817:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3662:x1875771532485120:12345-0@lo:400:kworker.0 Request processed in 55us (1262us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876994.541824:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788876994.541842:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485632 00000100:00100000:1.0:1788876994.541845:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485632 00000100:00100000:1.0:1788876994.541869:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485248 00000100:00100000:1.0:1788876994.541872:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485248 00000100:00100000:1.0:1788876994.541889:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485888 00000100:00100000:1.0:1788876994.541892:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485888 00000100:00100000:1.0:1788876994.541899:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532485504 00000100:00100000:1.0:1788876994.541900:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532485504 00000100:00100000:1.0:1788876994.541907:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486016 00000100:00100000:1.0:1788876994.541909:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486016 00000100:00100000:1.0:1788876994.541922:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1788876994.541928:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532485632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876994.541960:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532485632:12345-0@lo:400:kworker.0 Request processed in 33us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876994.541967:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1788876994.541989:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1788876994.541996:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532486016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788876994.542023:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532486016:12345-0@lo:400:kworker.0 Request processed in 28us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876994.542029:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:1.0:1788876994.542042:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788876994.542046:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532485248:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876994.542051:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876994.542072:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1875771532485248:12345-0@lo:400:kworker.0 Request processed in 25us (1373us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876994.542078:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1788876994.542088:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788876994.542092:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3664:x1875771532485888:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876994.542096:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876994.542115:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3664:x1875771532485888:12345-0@lo:400:kworker.0 Request processed in 22us (1094us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876994.542121:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1788876994.542131:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1788876994.542135:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3664:x1875771532485504:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788876994.542139:0:8722:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788876994.542156:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3664:x1875771532485504:12345-0@lo:400:kworker.0 Request processed in 20us (1062us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788876994.542162:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00080000:3.0:1788876994.542852:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876994.542859:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876994.542862:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876994.542868:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876994.542872:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1941 00000100:00080000:3.0:1788876994.542886:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876994.542916:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3790380 x1875771532486144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876994.542937:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532485248:0@lo:400:kworker.0 00000100:00080000:3.0:1788876994.542953:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876994.542956:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876994.542959:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876994.542963:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876994.542966:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1941 00000100:00080000:3.0:1788876994.542970:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876994.542994:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb271c00 x1875771532486272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876994.543005:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fae32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532485120:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.543023:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532485632:0@lo:400:kworker.0 00000100:00080000:3.0:1788876994.543052:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788876994.543057:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788876994.543097:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876994.543101:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876994.543104:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876994.543108:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876994.543111:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1941 00000100:00080000:3.0:1788876994.543115:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876994.543130:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb271180 x1875771532486400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876994.543140:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532485504:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.543153:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532486016:0@lo:400:kworker.0 00000100:00100000:3.0:1788876994.543164:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532485376:0@lo:400:kworker.0 00000100:00080000:3.0:1788876994.543174:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788876994.543177:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788876994.543180:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788876994.543183:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788876994.543187:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1941 00000100:00080000:3.0:1788876994.543190:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788876994.543200:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb270000 x1875771532486528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788876994.543210:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532485888:0@lo:400:kworker.0 00000100:00100000:0.0:1788876994.543331:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532486144:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788876994.543376:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876994.543410:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532486272:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788876994.543432:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876994.543454:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532486400:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788876994.543473:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876994.543489:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532486528:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788876994.543508:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876994.543548:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486144 00000100:00100000:0.0:1788876994.543553:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486144 00000100:00100000:0.0:1788876994.543579:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486400 00000100:00100000:0.0:1788876994.543581:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486400 00000100:00100000:0.0:1788876994.543591:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486528 00000100:00100000:0.0:1788876994.543594:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486528 00000100:00100000:0.0:1788876994.543633:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1788876994.543639:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486144:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788876994.543658:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876994.543696:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486144:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (319us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876994.543702:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1788876994.543718:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:0.0:1788876994.543722:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486400:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788876994.543731:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876994.543754:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486400:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876994.543760:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:0.0:1788876994.543770:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1788876994.543774:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486528:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788876994.543783:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876994.543803:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f43c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532486528:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 27us (294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876994.543809:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00080000:0.0:1788876994.543837:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876994.543841:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876994.543844:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532486144:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788876994.543852:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876994.543855:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876994.543858:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532486400:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788876994.543867:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788876994.543870:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788876994.543873:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532486528:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788876994.544507:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486272 00000100:00100000:3.0:1788876994.544512:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486272 00000100:00100000:3.0:1788876994.544551:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788876994.544557:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532486272:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788876994.544570:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876994.544702:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532486272:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 143us (1267us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876994.544709:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:2.0:1788876994.551136:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876994.551149:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876994.551156:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532486272:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788876994.857925:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788876995.049416:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788876995.049437:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532486656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788876995.049501:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876995.049647:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486656 00000100:00100000:3.0:1788876995.049656:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486656 00000100:00100000:3.0:1788876995.049717:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1788876995.049726:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532486656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788876995.049752:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788876995.049805:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532486656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876995.049813:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1788876995.049868:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532486656:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1788876995.247565:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511310080 offset 0 length 224: 4 00000100:00100000:2.0:1788876995.247641:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876995.247678:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876995.247868:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310336 00000100:00100000:0.0:1788876995.247886:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310336 00000100:00100000:1.0:1788876995.247897:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310592 00000100:00100000:1.0:1788876995.247902:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310592 00000100:00100000:1.0:1788876995.247946:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1495 00000100:00100000:0.0:1788876995.247949:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1953 00000100:00100000:0.0:1788876995.247955:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511310336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876995.247955:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511310592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788876995.248025:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511310592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788876995.248032:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1495 00000100:00080000:2.0:1788876995.248094:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788876995.248100:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788876995.255319:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788876995.255592:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310208 00000100:00100000:2.0:1788876995.255621:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310208 00000100:00100000:2.0:1788876995.255662:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2725 00000100:00100000:2.0:1788876995.255670:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875771511310208:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:2.0:1788876995.255679:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:2.0:1788876995.255726:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1875771511310208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 54us (414us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788876995.255733:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2725 00000100:00100000:0.0:1788876995.256303:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511310336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 8344us (8658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876995.256312:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1953 00000100:00100000:3.0:1788876995.257209:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788876995.257493:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310464 00000100:00100000:0.0:1788876995.257500:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310464 00000100:00080000:2.0:1788876995.257647:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876995.257697:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1496 00000100:00100000:0.0:1788876995.257710:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511310464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788876995.257847:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511310464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 140us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876995.257855:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1496 00000100:00100000:2.0:1788876995.274996:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788876995.275649:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310720 00000100:00100000:3.0:1788876995.275661:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310720 00000100:00100000:3.0:1788876995.276697:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2726 00000100:00100000:3.0:1788876995.276709:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511310720:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788876995.276744:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788876995.276949:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511310720:12345-192.168.203.11@tcp:38:ptlrpcd_00_01.0 Request processed in 238us (1959us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788876995.285805:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2726 00010000:00010000:1.0:1788876995.880795:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788876996.076576:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788876996.076593:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13ff363000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788876996.080377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff363000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788876996.080429:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c22f1000 for lustre-OST0001 00000001:00100000:3.0:1788876996.081013:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788876996.081023:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967328 is committed 00000020:00000080:3.0:1788876996.081027:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876996.081106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c49fa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788876996.081160:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c49fc800 for lustre-MDT0001 00000001:00100000:0.0:1788876996.081354:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788876996.081358:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13fa7ac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788876996.081415:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7ac800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788876996.081441:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fa7ad800 for lustre-OST0000 00010000:00010000:1.0:1788876996.905168:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876997.928807:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788876998.953400:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788876999.144969:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788876999.145000:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532486784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788876999.145099:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876999.145454:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532486784 00000100:00100000:0.0:1788876999.145464:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532486784 00000100:00100000:0.0:1788876999.145553:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1788876999.145566:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532486784:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876999.145567:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788876999.145649:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788876999.145734:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532486784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 170us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788876999.145741:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1788876999.145887:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532486784:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788876999.660097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876999.660107:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876999.660112:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876999.660123:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1982 00000100:00080000:2.0:1788876999.660131:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876999.660139:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876999.660168:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad3b480 x1875771532487040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876999.660194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876999.660198:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876999.660200:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876999.660203:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1982 00000100:00080000:2.0:1788876999.660207:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876999.660210:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876999.660224:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad39c00 x1875771532487168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876999.660242:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876999.660246:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876999.660248:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876999.660264:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1982 00000100:00080000:2.0:1788876999.660267:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876999.660271:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876999.660285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7aded80 x1875771532487424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788876999.660316:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788876999.660319:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788876999.660321:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788876999.660324:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1982 00000100:00080000:2.0:1788876999.660327:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788876999.660330:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788876999.660342:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7addf80 x1875771532487680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788876999.660382:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532487808:0@lo:400:kworker.0 00000100:00100000:2.0:1788876999.660473:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876999.660558:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788876999.660565:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532487552:0@lo:400:kworker.0 00000100:00100000:2.0:1788876999.660595:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788876999.660668:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487808 00000100:00100000:2.0:1788876999.660678:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487808 00000100:00100000:2.0:1788876999.660738:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487552 00000100:00100000:2.0:1788876999.660741:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487552 00000100:00100000:2.0:1788876999.660766:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1788876999.660776:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532487808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876999.660834:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532487808:12345-0@lo:400:kworker.0 Request processed in 60us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876999.660841:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1788876999.660870:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:2.0:1788876999.660877:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532487552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788876999.660905:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532487552:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788876999.660911:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00080000:2.0:1788876999.660936:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788876999.660980:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532487552:0@lo:400:kworker.0 00000100:00100000:2.0:1788876999.660998:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532487808:0@lo:400:kworker.0 00000100:00100000:3.0:1788876999.661298:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532487040:0@lo:38:kworker.0 00000100:00100000:3.0:1788876999.661341:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876999.661374:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532487168:0@lo:38:kworker.0 00000100:00100000:3.0:1788876999.661399:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876999.661419:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532487424:0@lo:38:kworker.0 00000100:00100000:3.0:1788876999.661441:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876999.661458:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532487680:0@lo:38:kworker.0 00000100:00100000:3.0:1788876999.661482:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788876999.661521:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487168 00000100:00100000:3.0:1788876999.661527:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487168 00000100:00100000:3.0:1788876999.661553:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487424 00000100:00100000:3.0:1788876999.661556:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487424 00000100:00100000:3.0:1788876999.661568:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487680 00000100:00100000:3.0:1788876999.661571:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487680 00000100:00100000:3.0:1788876999.661581:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:3.0:1788876999.661587:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487168:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876999.661639:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876999.661679:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487168:12345-0@lo:38:kworker.0 Request processed in 91us (278us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876999.661686:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:3.0:1788876999.661704:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1788876999.661708:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487424:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876999.661718:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876999.661742:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487424:12345-0@lo:38:kworker.0 Request processed in 33us (301us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876999.661748:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:3.0:1788876999.661761:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:3.0:1788876999.661765:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487680:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788876999.661773:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788876999.661795:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532487680:12345-0@lo:38:kworker.0 Request processed in 30us (313us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788876999.661801:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00080000:3.0:1788876999.661838:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876999.661844:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876999.661847:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532487168:0@lo:38:kworker.0 00000100:00080000:3.0:1788876999.661868:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876999.661872:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876999.661874:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532487424:0@lo:38:kworker.0 00000100:00080000:3.0:1788876999.661882:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788876999.661886:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788876999.661888:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532487680:0@lo:38:kworker.0 00000100:00100000:0.0:1788876999.666580:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532487296:0@lo:400:kworker.0 00000100:00100000:0.0:1788876999.666744:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788876999.666813:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788876999.666822:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532486912:0@lo:400:kworker.0 00000400:00000100:0.0:1788876999.666845:0:3665:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532486912 offset 0 length 224: 4 00000100:00100000:1.0:1788876999.667167:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487040 00000100:00100000:1.0:1788876999.667180:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487040 00000100:00100000:1.0:1788876999.667236:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1788876999.667245:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532487040:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788876999.667286:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788876999.667357:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532487040:12345-0@lo:38:kworker.0 Request processed in 111us (6014us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788876999.667365:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:2.0:1788876999.667674:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788876999.667682:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788876999.667686:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532487040:0@lo:38:kworker.0 00000100:00100000:3.0:1788876999.667771:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487296 00000100:00100000:3.0:1788876999.667776:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487296 00000100:00100000:3.0:1788876999.667841:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1788876999.667849:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532487296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788876999.667923:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532487296:12345-0@lo:400:kworker.0 Request processed in 75us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788876999.667930:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00080000:2.0:1788876999.668061:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788876999.668129:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532487296:0@lo:400:kworker.0 00010000:00010000:1.0:1788876999.976905:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877000.169000:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788877000.169031:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532487936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877000.169129:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877000.169237:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532487936 00000100:00100000:3.0:1788877000.169248:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532487936 00000100:00100000:3.0:1788877000.169315:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1788877000.169328:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532487936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877000.169366:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877000.169451:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532487936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877000.169458:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1788877000.169561:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532487936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877000.365483:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877000.366136:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511310976 00000100:00100000:3.0:1788877000.366147:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511310976 00000100:00100000:3.0:1788877000.366203:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2730 00000100:00100000:3.0:1788877000.366211:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511310976:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788877000.366233:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877000.366307:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511310976:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 95us (833us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877000.366315:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2730 00000400:00000100:1.0:1788877000.366538:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511310848 offset 0 length 224: 4 00000100:00100000:1.0:1788877000.366643:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877000.366676:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877000.366711:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877000.366768:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311232 00000100:00100000:0.0:1788877000.366772:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311232 00000100:00100000:0.0:1788877000.366821:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311360 00000100:00100000:0.0:1788877000.366824:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311360 00000100:00100000:0.0:1788877000.366859:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1498 00000100:00100000:0.0:1788877000.366867:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877000.366911:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877000.366918:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1498 00000100:00100000:0.0:1788877000.366931:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1499 00000100:00100000:0.0:1788877000.366938:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877000.366961:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877000.366968:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1499 00000100:00080000:1.0:1788877000.367953:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788877000.367958:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877000.368649:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311104 00000100:00100000:3.0:1788877000.368657:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311104 00000100:00100000:3.0:1788877000.368723:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1956 00000100:00100000:3.0:1788877000.368731:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511311104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877000.368790:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511311104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 60us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877000.368798:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1956 00000100:00080000:1.0:1788877000.369140:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788877001.001235:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877002.028507:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877003.049785:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877004.073151:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877004.269139:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532488064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788877004.269213:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877004.269286:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488064 00000100:00100000:3.0:1788877004.269293:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488064 00000100:00100000:3.0:1788877004.269347:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1788877004.269356:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532488064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877004.269383:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877004.269428:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532488064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877004.269435:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:3.0:1788877004.269456:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877004.269563:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532488064:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788877004.778736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877004.778743:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877004.778747:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877004.778756:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1987 00000100:00080000:2.0:1788877004.778762:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877004.778768:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877004.778790:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac98a80 x1875771532488320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877004.778807:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877004.778809:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877004.778811:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877004.778814:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1987 00000100:00080000:2.0:1788877004.778816:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877004.778819:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877004.778839:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99c00 x1875771532488448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877004.778864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877004.778867:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877004.778869:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877004.778872:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1987 00000100:00080000:2.0:1788877004.778874:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877004.778878:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877004.778891:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7addf80 x1875771532488704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877004.778912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877004.778916:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877004.778918:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877004.778922:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1987 00000100:00080000:2.0:1788877004.778924:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877004.778928:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877004.778938:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13e7adfb80 x1875771532488960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877004.778969:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532488320:0@lo:38:kworker.0 00000100:00100000:2.0:1788877004.779031:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877004.779088:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532488448:0@lo:38:kworker.0 00000100:00100000:2.0:1788877004.779114:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877004.779130:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532488704:0@lo:38:kworker.0 00000100:00100000:2.0:1788877004.779149:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877004.779162:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532488960:0@lo:38:kworker.0 00000100:00100000:2.0:1788877004.779184:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877004.779233:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488320 00000100:00100000:2.0:1788877004.779239:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488320 00000100:00100000:2.0:1788877004.779270:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1788877004.779277:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532488320:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877004.779296:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877004.779336:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532488320:12345-0@lo:38:kworker.0 Request processed in 57us (303us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877004.779342:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:2.0:1788877004.779377:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877004.779383:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877004.779386:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532488320:0@lo:38:kworker.0 00000100:00100000:0.0:1788877004.779535:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532488576:0@lo:400:kworker.0 00000100:00100000:0.0:1788877004.779568:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877004.779590:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788877004.779596:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532488192:0@lo:400:kworker.0 00000400:00000100:0.0:1788877004.779636:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532488192 offset 0 length 224: 4 00000100:00100000:0.0:1788877004.779666:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488448 00000100:00100000:0.0:1788877004.779669:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488448 00000100:00100000:0.0:1788877004.779690:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488704 00000100:00100000:0.0:1788877004.779693:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488704 00000100:00100000:0.0:1788877004.779706:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488960 00000100:00100000:0.0:1788877004.779708:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488960 00000100:00100000:0.0:1788877004.779723:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1788877004.779728:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488448:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877004.779738:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877004.779768:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488448:12345-0@lo:38:kworker.0 Request processed in 39us (652us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877004.779773:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1788877004.779785:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:0.0:1788877004.779789:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877004.779797:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877004.779819:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488704:12345-0@lo:38:kworker.0 Request processed in 29us (670us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877004.779825:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:0.0:1788877004.779855:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1788877004.779860:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877004.779869:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877004.779892:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532488960:12345-0@lo:38:kworker.0 Request processed in 30us (707us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877004.779897:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1788877004.779922:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488576 00000100:00100000:0.0:1788877004.779925:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488576 00000100:00100000:0.0:1788877004.779962:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1788877004.779969:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532488576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877004.780010:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532488576:12345-0@lo:400:kworker.0 Request processed in 42us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877004.780015:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00080000:0.0:1788877004.780045:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877004.780049:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877004.780052:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532488448:0@lo:38:kworker.0 00000100:00080000:0.0:1788877004.780060:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877004.780062:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877004.780064:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532488704:0@lo:38:kworker.0 00000100:00080000:0.0:1788877004.780071:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877004.780073:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877004.780076:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532488960:0@lo:38:kworker.0 00000100:00080000:0.0:1788877004.780097:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877004.780118:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780271:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532488832:0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780303:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877004.780330:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788877004.780336:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532489088:0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780356:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877004.780383:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532488832 00000100:00100000:3.0:1788877004.780387:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532488832 00000100:00100000:3.0:1788877004.780413:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489088 00000100:00100000:3.0:1788877004.780416:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489088 00000100:00100000:3.0:1788877004.780431:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1788877004.780437:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532488832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780469:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532488832:12345-0@lo:400:kworker.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877004.780476:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1788877004.780489:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1788877004.780494:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532489088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780518:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532489088:12345-0@lo:400:kworker.0 Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877004.780524:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1788877004.780548:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532489088:0@lo:400:kworker.0 00000100:00100000:3.0:1788877004.780558:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532488832:0@lo:400:kworker.0 00000100:00080000:0.0:1788877004.780629:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788877005.110513:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877005.288958:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532489216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877005.289030:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877005.290280:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489216 00000100:00100000:3.0:1788877005.290350:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489216 00000100:00100000:3.0:1788877005.290421:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788877005.290431:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532489216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877005.290466:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877005.290539:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532489216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877005.290545:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1788877005.290887:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532489216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877005.489558:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877005.490762:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311616 00000100:00100000:1.0:1788877005.490774:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311616 00000100:00100000:1.0:1788877005.490817:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2734 00000100:00100000:1.0:1788877005.490834:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511311616:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788877005.490857:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877005.490921:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511311616:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 94us (1370us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877005.490928:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2734 00000400:00000100:1.0:1788877005.506356:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511311488 offset 0 length 224: 4 00000100:00100000:1.0:1788877005.506405:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877005.506429:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877005.506499:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877005.506527:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311872 00000100:00100000:1.0:1788877005.506536:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311872 00000100:00100000:1.0:1788877005.506590:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312000 00000100:00100000:1.0:1788877005.506593:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312000 00000100:00100000:1.0:1788877005.506639:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1501 00000100:00100000:1.0:1788877005.506649:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877005.506721:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511311872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877005.506728:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1501 00000100:00100000:1.0:1788877005.506744:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1502 00000100:00100000:1.0:1788877005.506750:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511312000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877005.506772:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511312000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877005.506779:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1502 00000100:00080000:1.0:1788877005.506792:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788877005.506796:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877005.507764:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511311744 00000100:00100000:0.0:1788877005.507772:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511311744 00000100:00100000:0.0:1788877005.507871:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1959 00000100:00100000:0.0:1788877005.507880:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511311744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877005.507927:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511311744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 49us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877005.507934:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1959 00000100:00080000:1.0:1788877005.508659:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788877006.122451:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877007.145988:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877008.188371:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877009.196668:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877009.393315:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532489344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788877009.393453:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877009.393716:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489344 00000100:00100000:3.0:1788877009.393726:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489344 00000100:00100000:3.0:1788877009.393791:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1788877009.393801:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532489344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877009.393849:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877009.393903:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532489344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877009.393911:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:3.0:1788877009.393935:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877009.393979:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532489344:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788877009.904587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877009.904596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877009.904620:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877009.904631:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1992 00000100:00080000:2.0:1788877009.904638:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877009.905975:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877009.906018:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99500 x1875771532489600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877009.906050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877009.906055:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877009.906058:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877009.906062:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1992 00000100:00080000:2.0:1788877009.906067:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877009.906071:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877009.906083:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac99c00 x1875771532489728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877009.906106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877009.906109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877009.906111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877009.906114:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1992 00000100:00080000:2.0:1788877009.906117:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877009.906121:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877009.906135:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c362f800 x1875771532489984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877009.906166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877009.906170:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877009.906172:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877009.906176:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1992 00000100:00080000:2.0:1788877009.906179:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877009.906182:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788877009.906309:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532489856:0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.906397:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877009.906466:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788877009.906475:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532489472:0@lo:400:kworker.0 00000400:00000100:3.0:1788877009.906497:0:3665:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532489472 offset 0 length 224: 4 00000100:00100000:3.0:1788877009.906529:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532490112:0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.906559:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877009.906631:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489856 00000100:00100000:3.0:1788877009.906641:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489856 00000100:00100000:3.0:1788877009.906717:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1788877009.906727:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532489856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.906782:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532489856:12345-0@lo:400:kworker.0 Request processed in 57us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877009.906790:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1788877009.906826:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490112 00000100:00100000:3.0:1788877009.906831:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490112 00000100:00100000:3.0:1788877009.906863:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1788877009.906869:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532490112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.906904:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532490112:12345-0@lo:400:kworker.0 Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877009.906910:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00080000:3.0:1788877009.906926:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877009.906930:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877009.906965:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532489856:0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.906999:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532490112:0@lo:400:kworker.0 00000100:00100000:1.0:1788877009.907163:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532489600:0@lo:38:kworker.0 00000100:00100000:2.0:1788877009.907288:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48e680 x1875771532490240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877009.907515:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877009.907548:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532489728:0@lo:38:kworker.0 00000100:00100000:1.0:1788877009.907573:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877009.907591:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532489984:0@lo:38:kworker.0 00000100:00100000:1.0:1788877009.907636:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877009.908375:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532490240:0@lo:38:kworker.0 00000100:00100000:1.0:1788877009.908414:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877009.908456:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489728 00000100:00100000:1.0:1788877009.908463:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489728 00000100:00100000:1.0:1788877009.908507:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489984 00000100:00100000:1.0:1788877009.908510:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489984 00000100:00100000:1.0:1788877009.908526:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490240 00000100:00100000:1.0:1788877009.908530:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490240 00000100:00100000:1.0:1788877009.908547:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788877009.908554:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532489728:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788877009.908578:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877009.908762:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532489600 00000100:00100000:2.0:1788877009.908767:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532489600 00000100:00100000:2.0:1788877009.908792:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788877009.908797:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532489600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877009.908817:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877009.908858:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532489600:12345-0@lo:38:kworker.0 Request processed in 60us (1343us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877009.908866:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788877009.908892:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:2.0:1788877009.908897:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532489984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877009.908906:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877009.908933:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532489984:12345-0@lo:38:kworker.0 Request processed in 35us (1298us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877009.908940:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:2.0:1788877009.908954:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:2.0:1788877009.908958:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532490240:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877009.908968:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877009.908991:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532490240:12345-0@lo:38:kworker.0 Request processed in 31us (577us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877009.908997:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00080000:2.0:1788877009.909036:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877009.909042:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877009.909045:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532490240:0@lo:38:kworker.0 00000100:00080000:2.0:1788877009.909057:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877009.909061:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877009.909064:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532489600:0@lo:38:kworker.0 00000100:00100000:3.0:1788877009.909132:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788877009.909166:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877009.913153:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532489728:12345-0@lo:38:kworker.0 Request processed in 4585us (5565us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877009.913171:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1788877009.913271:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490368 00000100:00100000:1.0:1788877009.913283:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490368 00000100:00100000:1.0:1788877009.913364:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:1.0:1788877009.913373:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532490368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877009.913460:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532490368:12345-0@lo:400:kworker.0 Request processed in 88us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877009.913466:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00080000:1.0:1788877009.913513:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788877009.913657:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532490368:0@lo:400:kworker.0 00000100:00080000:2.0:1788877009.915328:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877009.915342:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877009.915349:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532489728:0@lo:38:kworker.0 00000100:00080000:2.0:1788877009.915366:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877009.915370:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877009.915373:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532489984:0@lo:38:kworker.0 00010000:00010000:2.0:1788877010.217877:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877010.418522:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788877010.418553:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532490496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877010.419483:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877010.419748:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490496 00000100:00100000:0.0:1788877010.419759:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490496 00000100:00100000:0.0:1788877010.419840:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788877010.419851:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532490496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788877010.419890:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788877010.419949:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532490496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877010.419957:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788877010.420015:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532490496:0@lo:13:osp-pre-0-1.0 00000400:00000100:1.0:1788877010.624756:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511312128 offset 0 length 224: 4 00000100:00100000:1.0:1788877010.624818:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877010.624853:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877010.624863:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312512 00000100:00100000:3.0:1788877010.624875:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312512 00000100:00100000:1.0:1788877010.624876:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877010.624900:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877010.624921:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312384 00000100:00100000:1.0:1788877010.624925:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312384 00000100:00100000:1.0:1788877010.624961:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312256 00000100:00100000:1.0:1788877010.624964:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312256 00000100:00100000:1.0:1788877010.624984:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1962 00000100:00100000:3.0:1788877010.624991:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312640 00000100:00100000:3.0:1788877010.624994:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312640 00000100:00100000:1.0:1788877010.624995:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511312384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877010.625022:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1504 00000100:00100000:3.0:1788877010.625028:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511312512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877010.625644:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511312384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 646us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877010.625655:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1962 00000100:00100000:1.0:1788877010.625680:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2738 00000100:00100000:1.0:1788877010.625685:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511312256:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:1.0:1788877010.625710:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877010.632180:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1505 00000100:00100000:0.0:1788877010.632212:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511312640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1788877010.636432:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788877010.636447:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877010.636450:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877010.636535:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511312512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 11494us (11704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877010.636552:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1504 00000100:00100000:1.0:1788877010.641969:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875771511312256:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 16261us (17046us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877010.641990:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2738 00000100:00100000:1.0:1788877010.651324:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511312640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 19112us (26430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877010.651340:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1505 00000100:00000400:2.0:1788877010.908936:0:3664:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788876994/real 1788876994] req@ffff8a13fad1f800 x1875771532484992/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877010 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877010.908979:0:3664:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13fad1f800 x1875771532484992/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877010.908995:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788877010.909000:0:3664:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788877010.909003:0:3664:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788877010.909006:0:3664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788877010.909010:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fad1f800 x1875771532484992/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877010 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877010.909020:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13cff7d880 x1875771532486912/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877015 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877010.909136:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fac99f80 x1875771532488192/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877020 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877010.909156:0:3664:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fa646300 x1875771532489472/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877025 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788877010.909166:0:3664:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788877010.909169:0:3664:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788877010.909170:0:3664:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788877010.909173:0:3664:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788877010.909206:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532484992:0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.909269:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532488192:0@lo:400:kworker.0 00000100:00080000:2.0:1788877010.909290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877010.909295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788877010.909298:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877010.909302:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1935 00000100:00080000:2.0:1788877010.909312:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877010.909350:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48ca80 x1875771532490624/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877010.909371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877010.909375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877010.909377:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877010.909380:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1997 00000100:00080000:2.0:1788877010.909383:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877010.909387:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877010.909403:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532490752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877010.909743:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532489472:0@lo:400:kworker.0 00000100:00100000:1.0:1788877010.909753:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cff7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532486912:0@lo:400:kworker.0 00000100:00100000:1.0:1788877010.909847:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532490624:0@lo:250:kworker.0 00000400:00000100:1.0:1788877010.909906:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532490624 offset 0 length 520: 4 00000100:00100000:1.0:1788877010.909949:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532490752:0@lo:38:kworker.0 00000100:00100000:1.0:1788877010.909982:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877010.910023:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490752 00000100:00100000:1.0:1788877010.910032:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490752 00000100:00100000:1.0:1788877010.910071:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1788877010.910079:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532490752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788877010.910104:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877010.910162:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cff7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532490752:12345-0@lo:38:kworker.0 Request processed in 82us (178us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877010.910171:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00080000:0.0:1788877010.910204:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877010.910210:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877010.910214:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532490752:0@lo:38:kworker.0 00000100:00080000:2.0:1788877010.910366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877010.910370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877010.910373:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877010.910377:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1997 00000100:00080000:2.0:1788877010.910380:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877010.910385:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877010.910481:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48dc00 x1875771532490880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877010.910503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877010.910515:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877010.910517:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877010.910521:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1997 00000100:00080000:2.0:1788877010.910523:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877010.910528:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788877010.910535:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532490880:0@lo:38:kworker.0 00000100:00100000:2.0:1788877010.910541:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa48e680 x1875771532491008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877010.910570:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788877010.910592:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788877010.910594:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532491008:0@lo:38:kworker.0 00000100:00080000:2.0:1788877010.910596:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877010.910598:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877010.910616:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1997 00000100:00080000:2.0:1788877010.910619:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877010.910623:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877010.910635:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1f800 x1875771532491392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877010.910647:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877010.910666:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532491392:0@lo:38:kworker.0 00000100:00100000:2.0:1788877010.910683:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532490880 00000100:00100000:0.0:1788877010.910687:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877010.910688:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532490880 00000100:00100000:2.0:1788877010.910711:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491008 00000100:00100000:2.0:1788877010.910714:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491008 00000100:00100000:2.0:1788877010.910726:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491392 00000100:00100000:2.0:1788877010.910728:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491392 00000100:00100000:2.0:1788877010.910742:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1788877010.910747:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532490880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877010.910759:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877010.910951:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:0.0:1788877010.910957:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532491008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877010.910968:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877010.911034:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:1.0:1788877010.911039:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532491392:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788877010.911050:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877010.911106:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532490880:12345-0@lo:38:kworker.0 Request processed in 358us (535us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877010.911114:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00100000:2.0:1788877010.911140:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911173:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877010.911240:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788877010.911251:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532491520:0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911280:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877010.911325:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491520 00000100:00100000:2.0:1788877010.911332:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491520 00000100:00100000:2.0:1788877010.911374:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1788877010.911386:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911487:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532491520:12345-0@lo:400:kworker.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877010.911517:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:2.0:1788877010.911556:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491264 00000100:00100000:2.0:1788877010.911562:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491264 00000100:00100000:2.0:1788877010.911662:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1788877010.911675:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532491264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911714:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532491264:12345-0@lo:400:kworker.0 Request processed in 45us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877010.911720:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1788877010.911759:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532491520:0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911770:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532491264:0@lo:400:kworker.0 00000100:00080000:2.0:1788877010.911825:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877010.911830:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877010.911834:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532490880:0@lo:38:kworker.0 00000100:00100000:2.0:1788877010.911853:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788877010.911861:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532491136:0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911889:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877010.911919:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491136 00000100:00100000:2.0:1788877010.911923:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491136 00000100:00100000:2.0:1788877010.911943:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788877010.911949:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532491136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877010.911979:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532491136:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877010.911989:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1788877010.912033:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532491136:0@lo:400:kworker.0 00000100:00100000:0.0:1788877010.914677:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532491008:12345-0@lo:38:kworker.0 Request processed in 3705us (4014us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877010.914694:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00080000:2.0:1788877010.915920:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877010.915932:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877010.915938:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532491008:0@lo:38:kworker.0 00000100:00100000:1.0:1788877010.921930:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532491392:12345-0@lo:38:kworker.0 Request processed in 10874us (11226us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877010.921948:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00080000:2.0:1788877010.928793:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877010.928823:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877010.928830:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532491392:0@lo:38:kworker.0 00010000:00010000:0.0:1788877011.240935:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788877011.382524:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511312768 offset 0 length 520: 4 00000100:00100000:2.0:1788877011.382586:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877011.382746:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313152 00000100:00100000:3.0:1788877011.382761:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313152 00000100:00100000:3.0:1788877011.382869:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1507 00000100:00100000:3.0:1788877011.382886:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877011.383006:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 122us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877011.383018:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1507 00000100:00100000:2.0:1788877011.395650:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877011.395701:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877011.395842:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877011.395898:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313280 00000100:00100000:2.0:1788877011.395913:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313280 00000100:00100000:2.0:1788877011.396011:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1508 00000100:00100000:2.0:1788877011.396029:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511313280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877011.396130:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511313280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877011.396139:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1508 00000100:00100000:2.0:1788877011.396163:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313024 00000100:00100000:2.0:1788877011.396167:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313024 00000100:00100000:2.0:1788877011.396196:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511312896 00000100:00100000:2.0:1788877011.396198:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511312896 00000100:00100000:2.0:1788877011.396218:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1965 00000100:00100000:2.0:1788877011.396232:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511313024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877011.396263:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511313024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877011.396270:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1965 00000100:00100000:2.0:1788877011.396283:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2742 00000100:00100000:2.0:1788877011.396288:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511312896:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788877011.396315:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877011.396341:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511312896:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 53us (502us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877011.396347:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2742 00010000:00010000:1.0:1788877012.272465:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877013.289074:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877014.315352:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877014.509859:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788877014.509882:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532491648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788877014.509970:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877014.510030:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491648 00000100:00100000:3.0:1788877014.510037:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491648 00000100:00100000:3.0:1788877014.510087:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1788877014.510096:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532491648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877014.510124:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877014.510167:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532491648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877014.510174:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00080000:3.0:1788877014.510193:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877014.510227:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532491648:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788877015.337411:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877015.528843:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532491776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877015.528909:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877015.529007:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491776 00000100:00100000:2.0:1788877015.529016:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491776 00000100:00100000:2.0:1788877015.529079:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1788877015.529089:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532491776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788877015.529116:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877015.529157:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532491776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877015.529164:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:0.0:1788877015.529215:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877015.529255:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532491776:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1788877015.597286:0:54972:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788877015.597295:0:54972:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788877015.597296:0:54972:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788877015.597406:0:54972:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a13d0608800 00000020:01000004:0.0:1788877015.597421:0:54972:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788877015.597434:0:54972:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788877015.597448:0:54972:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c4e319c0) 00000020:00000080:0.0:1788877015.597464:0:54972:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788877015.808847:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788877015.818482:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788877015.821248:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.823713:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.824329:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.824715:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.824947:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.825183:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.834912:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.839017:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.839423:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788877015.839674:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.839912:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.840152:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.841545:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.845638:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788877015.845952:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788877015.846299:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788877015.847448:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788877015.848216:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.859292:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.859879:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.860152:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.860388:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.860832:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.861094:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.861627:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.862040:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.862218:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.862700:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.865931:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.870298:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.870822:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.871131:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.871321:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.871594:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.871835:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.873093:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.874849:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.875292:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.875552:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.875896:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.876148:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.877222:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788877015.877733:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.877999:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.878303:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788877015.880375:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.881745:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.882061:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.882476:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.884155:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788877015.884367:0:54972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1788877015.888051:0:54972:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788877015.888281:0:54972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788877015.888290:0:54972:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788877015.888301:0:54972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b04cf 00000020:01000004:0.0:1788877015.888309:0:54972:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788877015.888321:0:54972:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788877015.888327:0:54972:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13d0608800 from MGS 00000020:01000004:0.0:1788877015.888330:0:54972:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788877015.888340:0:54972:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c4e30000) 00000020:00000080:0.0:1788877015.888353:0:54972:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788877015.888408:0:54972:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13d0608800 from MGS, refs=2 00080000:01000000:0.0:1788877015.888412:0:54972:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788877015.888416:0:54972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b04dd 00010000:00010000:0.0:1788877015.888680:0:54972:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788877015.893166:0:54972:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788877015.894316:0:54976:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788877015.894363:0:54972:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788877015.894399:0:54972:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788877015.895305:0:54972:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788877015.897124:0:54972:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788877015.897300:0:54972:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788877015.897307:0:54972:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788877015.903545:0:54972:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788877015.903559:0:54972:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788877015.904213:0:54972:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788877015.904221:0:54972:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788877015.904666:0:54972:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788877015.904688:0:54972:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788877015.904689:0:54972:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788877015.904693:0:54972:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788877015.904698:0:54972:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 48, was 0): CONNECTING 00000100:00100000:0.0:1788877015.904704:0:54972:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:1.0:1788877016.042228:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877016.042235:0:24072:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788877016.042238:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877016.042241:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877016.042246:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877016.042255:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1998 00000100:00080000:1.0:1788877016.042260:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877016.042267:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877016.042305:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa646300 x1875771532491904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877016.042320:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877016.042334:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877016.042336:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877016.042339:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1998 00000100:00080000:1.0:1788877016.042341:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877016.042345:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877016.042358:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4675f80 x1875771532492032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877016.042367:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877016.042370:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877016.042371:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877016.042374:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1998 00000100:00080000:1.0:1788877016.042376:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877016.042379:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877016.042388:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4676d80 x1875771532492160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877016.042423:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877016.042426:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877016.042428:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877016.042431:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1998 00000100:00080000:1.0:1788877016.042433:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877016.042436:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877016.042445:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa781880 x1875771532492544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877016.042488:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532492672:0@lo:400:kworker.0 00000100:00100000:1.0:1788877016.042558:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877016.042698:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492672 00000100:00100000:0.0:1788877016.042706:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492672 00000100:00100000:0.0:1788877016.042764:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1788877016.042786:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532492672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877016.042837:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532492672:12345-0@lo:400:kworker.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877016.042844:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00080000:1.0:1788877016.043086:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877016.043118:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532492672:0@lo:400:kworker.0 00000100:00100000:2.0:1788877016.043187:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532492288:0@lo:400:kworker.0 00000100:00100000:2.0:1788877016.043219:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877016.043247:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788877016.043253:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532492416:0@lo:400:kworker.0 00000100:00100000:2.0:1788877016.043279:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877016.043399:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492416 00000100:00100000:1.0:1788877016.043404:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492416 00000100:00100000:1.0:1788877016.043441:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1788877016.043449:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532492416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877016.043492:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532492416:12345-0@lo:400:kworker.0 Request processed in 44us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877016.043498:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00080000:1.0:1788877016.043516:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877016.043574:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788877016.043636:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492288 00000100:00100000:0.0:1788877016.043641:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492288 00000100:00100000:0.0:1788877016.043684:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1788877016.043690:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877016.043723:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532492288:12345-0@lo:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877016.043728:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:3.0:1788877016.043892:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532491904:0@lo:38:kworker.0 00000100:00100000:3.0:1788877016.043925:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877016.043953:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532492032:0@lo:38:kworker.0 00000100:00100000:3.0:1788877016.043988:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877016.044005:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532492160:0@lo:38:kworker.0 00000100:00100000:3.0:1788877016.044022:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877016.044036:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532492544:0@lo:38:kworker.0 00000100:00100000:3.0:1788877016.044052:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877016.044189:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532491904 00000100:00100000:3.0:1788877016.044194:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532491904 00000100:00100000:3.0:1788877016.044214:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1788877016.044219:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532491904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877016.044236:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877016.044269:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532491904:12345-0@lo:38:kworker.0 Request processed in 49us (343us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877016.044275:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1788877016.044294:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492032 00000100:00100000:3.0:1788877016.044297:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492032 00000100:00100000:3.0:1788877016.044314:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492160 00000100:00100000:3.0:1788877016.044330:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492160 00000100:00100000:3.0:1788877016.044344:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492544 00000100:00100000:3.0:1788877016.044346:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492544 00000100:00100000:3.0:1788877016.044358:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788877016.044362:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877016.044373:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877016.044401:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492032:12345-0@lo:38:kworker.0 Request processed in 37us (412us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877016.044407:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00100000:3.0:1788877016.044419:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1788877016.044423:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877016.044432:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877016.044455:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492160:12345-0@lo:38:kworker.0 Request processed in 30us (432us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877016.044460:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1788877016.044471:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:3.0:1788877016.044475:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492544:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877016.044483:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877016.044505:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532492544:12345-0@lo:38:kworker.0 Request processed in 28us (451us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877016.044510:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00080000:3.0:1788877016.044546:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877016.044551:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877016.044555:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532491904:0@lo:38:kworker.0 00000100:00080000:3.0:1788877016.044564:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877016.044567:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877016.044570:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4675f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532492032:0@lo:38:kworker.0 00000100:00080000:3.0:1788877016.044578:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877016.044581:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877016.044584:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532492160:0@lo:38:kworker.0 00000100:00080000:3.0:1788877016.044590:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877016.044593:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877016.044595:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532492544:0@lo:38:kworker.0 00000100:00080000:1.0:1788877016.045053:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877016.045128:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4674a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532492288:0@lo:400:kworker.0 00010000:00010000:3.0:1788877016.360805:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877016.749001:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877016.749157:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313536 00000100:00100000:2.0:1788877016.749166:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313536 00000100:00100000:2.0:1788877016.749244:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1968 00000100:00100000:2.0:1788877016.749254:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511313536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877016.749334:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511313536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877016.749343:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1968 00000100:00080000:1.0:1788877016.749344:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788877016.749400:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877016.749480:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313792 00000100:00100000:1.0:1788877016.749489:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313792 00000100:00100000:1.0:1788877016.749543:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1510 00000100:00100000:1.0:1788877016.749551:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877016.749583:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877016.749590:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1510 00000100:00080000:2.0:1788877016.749806:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877016.754214:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877016.754266:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877016.754416:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313408 00000100:00100000:0.0:1788877016.754426:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313408 00000100:00100000:0.0:1788877016.754471:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2746 00000100:00100000:0.0:1788877016.754480:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511313408:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:0.0:1788877016.754504:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877016.754574:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511313408:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 94us (307us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877016.754582:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2746 00000100:00100000:1.0:1788877016.754765:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313664 00000100:00100000:1.0:1788877016.754769:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313664 00000100:00100000:1.0:1788877016.754833:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1511 00000100:00100000:1.0:1788877016.754842:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877016.754888:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511313664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 48us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877016.754895:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1511 00000100:00080000:2.0:1788877016.755276:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788877017.387262:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877018.408841:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877019.436028:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877019.627479:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788877019.627503:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532492800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788877019.627574:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877019.627864:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532492800 00000100:00100000:3.0:1788877019.627873:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532492800 00000100:00100000:3.0:1788877019.627948:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:3.0:1788877019.627959:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532492800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877019.628007:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877019.628065:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532492800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877019.628073:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788877019.628197:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4676d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532492800:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788877019.628290:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877020.139988:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788877010/real 1788877010] req@ffff8a13fa48ca80 x1875771532490624/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788877020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877020.140029:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a13fa48ca80 x1875771532490624/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788877020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788877020.140048:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877020.140070:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788877020.140097:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532490624:0@lo:250:kworker.0 00000100:00080000:2.0:1788877020.140175:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877020.140180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788877020.140183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877020.140187:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 1998 00000100:00080000:2.0:1788877020.140193:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788877020.140199:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.140233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3357800 x1875771532492928/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877020.140257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877020.140261:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877020.140263:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877020.140266:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2003 00000100:00080000:2.0:1788877020.140268:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877020.140273:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.140289:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3357100 x1875771532493056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877020.140298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877020.140300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877020.140302:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877020.140305:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2003 00000100:00080000:2.0:1788877020.140307:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877020.140311:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.140321:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3356a00 x1875771532493184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877020.140358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877020.140363:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877020.140364:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877020.140367:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2003 00000100:00080000:2.0:1788877020.140370:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877020.140373:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.140383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb01e680 x1875771532493440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877020.140412:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877020.140415:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877020.140417:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877020.140421:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2003 00000100:00080000:2.0:1788877020.140423:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877020.140427:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.140440:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3c90000 x1875771532493824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877020.140480:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532493568:0@lo:400:kworker.0 00000100:00100000:2.0:1788877020.140542:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.140631:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788877020.140634:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532493952:0@lo:400:kworker.0 00000100:00100000:2.0:1788877020.140641:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532493312:0@lo:400:kworker.0 00000100:00100000:1.0:1788877020.140679:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.140685:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.140721:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532493696:0@lo:400:kworker.0 00000100:00100000:2.0:1788877020.140749:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.140807:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493568 00000100:00100000:3.0:1788877020.140814:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493568 00000100:00100000:3.0:1788877020.140862:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493952 00000100:00100000:3.0:1788877020.140865:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493952 00000100:00100000:3.0:1788877020.140888:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1788877020.140897:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532493568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877020.140949:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532493568:12345-0@lo:400:kworker.0 Request processed in 52us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.140956:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1788877020.140973:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1788877020.140979:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532493952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877020.141012:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532493952:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.141017:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00080000:3.0:1788877020.141034:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00020000:3.0:1788877020.141044:0:3661:0:(client.c:1404:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8a12c3357800 x1875771532492928/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877020.144037:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532493568:0@lo:400:kworker.0 10000000:01000000:0.0:1788877020.145980:0:54972:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1788877020.146012:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146025:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146031:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788877020.146056:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146065:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b014f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0156 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146084:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146091:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146097:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146100:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146104:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3220600/0xf5bf0f7e313b00c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b00ca expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146113:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146119:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146124:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146127:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146130:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221800/0xf5bf0f7e313b00d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b00d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146139:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146145:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146150:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146153:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146157:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8d400/0xf5bf0f7e313b00ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b00f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146170:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146176:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146180:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146183:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146187:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8ca00/0xf5bf0f7e313b00fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0102 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146195:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146202:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146207:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146210:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146213:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca9a00/0xf5bf0f7e313b0117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b011e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146222:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146228:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146233:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146237:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146239:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef41600/0xf5bf0f7e313b0133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b013a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146247:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146253:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146258:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146260:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146263:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef41800/0xf5bf0f7e313b016b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0172 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146275:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146281:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146286:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146288:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146292:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8800/0xf5bf0f7e313b0125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b012c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146303:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146309:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146319:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877020.146322:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146325:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef40e00/0xf5bf0f7e313b0141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0148 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146337:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146343:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146348:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877020.146351:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146355:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a12c3221400/0xf5bf0f7e313b00df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b00e6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146364:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146371:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146376:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877020.146379:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146382:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13e7b8c400/0xf5bf0f7e313b0109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0110 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.146391:0:54972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877020.146402:0:54972:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.146408:0:54972:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877020.146412:0:54972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877020.146415:0:54972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8c00/0xf5bf0f7e313b015d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0164 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877020.146571:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532493952:0@lo:400:kworker.0 00000100:00100000:1.0:1788877020.152078:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493312 00000100:00100000:1.0:1788877020.152093:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493312 00000100:00100000:1.0:1788877020.152168:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493696 00000100:00100000:1.0:1788877020.152172:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493696 00000100:00100000:1.0:1788877020.152204:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1788877020.152212:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532493312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877020.152297:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532493312:12345-0@lo:400:kworker.0 Request processed in 86us (11613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.152305:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1788877020.152321:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788877020.152327:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532493696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877020.152360:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532493696:12345-0@lo:400:kworker.0 Request processed in 34us (11610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.152367:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788877020.152406:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532493312:0@lo:400:kworker.0 00000100:00100000:1.0:1788877020.152440:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532493696:0@lo:400:kworker.0 00000100:00080000:2.0:1788877020.152509:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788877020.183813:0:54972:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 49, was 0): CONNECTING 00000100:00080000:0.0:1788877020.183825:0:54972:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1788877020.184802:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877020.184831:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:3.0:1788877020.184836:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:0:1875771532492928:0@lo:250:kworker.0 00000100:00100000:3.0:1788877020.184869:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532493056:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.184937:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.184984:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532493184:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.185010:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.185026:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532493440:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.185049:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.185096:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493184 00000100:00100000:3.0:1788877020.185104:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493184 00000100:00100000:3.0:1788877020.185136:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493440 00000100:00100000:3.0:1788877020.185139:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493440 00000100:00100000:3.0:1788877020.185157:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:3.0:1788877020.185164:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532493184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877020.185184:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877020.185222:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532493184:12345-0@lo:38:kworker.0 Request processed in 56us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877020.185229:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00100000:3.0:1788877020.185246:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:3.0:1788877020.185249:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532493440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877020.185260:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877020.185283:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532493440:12345-0@lo:38:kworker.0 Request processed in 32us (233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877020.185289:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00080000:3.0:1788877020.185323:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877020.185328:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877020.185331:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532493440:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.185337:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532493824:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.185360:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788877020.185401:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877020.185405:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877020.185408:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532493184:0@lo:38:kworker.0 00000100:00100000:3.0:1788877020.185438:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493824 00000100:00100000:3.0:1788877020.185442:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493824 00000100:00100000:3.0:1788877020.185464:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:3.0:1788877020.187029:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532493824:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877020.187047:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877020.187102:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3661:x1875771532493824:12345-0@lo:38:kworker.0 Request processed in 77us (1739us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788877020.187176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877020.187182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788877020.187185:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877020.187189:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 2008 00000100:00080000:1.0:1788877020.187194:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788877020.187199:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877020.187223:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa780380 x1875771532494080/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877020.187293:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532493056 00000100:00100000:1.0:1788877020.187299:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532493056 00000100:00100000:1.0:1788877020.187326:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1788877020.187331:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532493056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788877020.187342:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877020.187375:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532493056:12345-0@lo:38:kworker.0 Request processed in 42us (2438us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877020.187382:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1788877020.189633:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532494080:0@lo:250:kworker.0 00000100:00100000:2.0:1788877020.189697:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788877020.189769:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877020.189775:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877020.189778:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532493056:0@lo:38:kworker.0 00000100:00080000:2.0:1788877020.189791:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877020.189794:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877020.189797:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532493824:0@lo:38:kworker.0 00000100:00100000:1.0:1788877020.190250:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494080 00000100:00100000:1.0:1788877020.190257:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494080 00000100:00100000:1.0:1788877020.190301:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788877020.190307:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532494080:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1788877020.190331:0:54977:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 2008 last 0 00000020:00000080:1.0:1788877020.190359:0:54977:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313b04e4 00000100:00080000:1.0:1788877020.190530:0:54977:0:(import.c:65:import_set_state_nolock()) ffff8a12c5f36800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788877020.190591:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532494080:12345-0@lo:250:kworker.0 Request processed in 281us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.190628:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788877020.190839:0:3661:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 22 00000100:00080000:2.0:1788877020.190847:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1788877020.190855:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788877020.190861:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788877020.190864:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788877020.190866:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788877020.190894:0:3661:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788877020.190902:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532494080:0@lo:250:kworker.0 00000020:01000000:2.0:1788877020.190946:0:36:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:2.0:1788877020.190961:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1788877020.190964:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788877020.190966:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788877020.190967:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.190968:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.190970:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.190971:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.190973:0:36:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788877020.190975:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.190976:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788877020.191008:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788877020.191015:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1788877020.191017:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788877020.191019:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788877020.191020:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.191021:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.191022:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.191023:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.191024:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788877020.191025:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.191026:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788877020.191039:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1788877020.191044:0:36:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1788877020.191045:0:36:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1788877020.191047:0:36:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788877020.191048:0:36:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.191049:0:36:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.191050:0:36:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.191051:0:36:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.191052:0:36:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788877020.191053:0:36:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.191055:0:36:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1788877020.191076:0:36:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1788877020.191103:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532494208:0@lo:253:kworker.0 00000100:00100000:2.0:1788877020.191139:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.191165:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788877020.191171:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532494336:0@lo:253:kworker.0 00000100:00100000:2.0:1788877020.191198:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.191218:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788877020.191226:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532494464:0@lo:253:kworker.0 00000100:00100000:2.0:1788877020.191253:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.191277:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494208 00000100:00100000:2.0:1788877020.191282:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494208 00000100:00100000:2.0:1788877020.191301:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494336 00000100:00100000:2.0:1788877020.191304:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494336 00000100:00100000:2.0:1788877020.191313:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494464 00000100:00100000:2.0:1788877020.191315:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494464 00000100:00100000:2.0:1788877020.191325:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788877020.191330:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532494208:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788877020.191351:0:54977:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1788877020.191384:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788877020.191391:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532494336:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1788877020.191405:0:54979:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:1.0:1788877020.192901:0:54972:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788877020.192914:0:54972:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788877020.192953:0:54972:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788877020.192958:0:54972:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788877020.193058:0:54972:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788877020.193090:0:54972:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788877020.193095:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788877020.193096:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877020.193097:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877020.193099:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877020.193100:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877020.193101:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877020.193103:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877020.193104:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877020.193106:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877020.193107:0:54972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788877020.193109:0:54972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788877020.193111:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788877020.193112:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877020.193114:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877020.193115:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877020.193116:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877020.193117:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877020.193118:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877020.193120:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877020.193120:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877020.193122:0:54972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788877020.193143:0:54972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788877020.193156:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788877020.193232:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.193255:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c1a406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788877020.193273:0:54980:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788877020.193279:0:54980:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1788877020.193573:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 10000000:01000000:1.0:1788877020.193922:0:54982:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788877020.194008:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494592 00000100:00100000:1.0:1788877020.194015:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494592 00000100:00100000:3.0:1788877020.194151:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788877020.194161:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3665:x1875771532494464:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1788877020.194188:0:54983:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788877020.194293:0:54977:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 87 20000000:01000000:2.0:1788877020.204419:0:54984:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788877020.204427:0:54984:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788877020.204429:0:54984:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788877020.204432:0:54984:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788877020.204819:0:54984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788877020.205027:0:54977:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788877020.205052:0:54977:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788877020.207825:0:54977:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788877020.207842:0:54977:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788877020.207952:0:54982:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788877020.207958:0:54982:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788877020.207981:0:54982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.207997:0:54982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788877020.208005:0:54982:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048850s 00010000:00010000:1.0:1788877020.208011:0:54982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208017:0:54982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208024:0:54982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208031:0:54982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208038:0:54982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877020.208043:0:54982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208051:0:54982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208063:0:54982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208071:0:54982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.208080:0:54982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b04eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788877020.208137:0:54979:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788877020.208446:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3662:x1875771532494208:12345-0@lo:253:kworker.0 Request processed in 17111us (17302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.208456:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788877020.208584:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788877020.208730:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:54972:x1875771532494592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788877020.208783:0:54977:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788877020.208786:0:54977:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788877020.208789:0:54977:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1788877020.208795:0:54977:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:0.0:1788877020.208903:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788877020.208906:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788877020.208908:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877020.208909:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877020.208911:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877020.208912:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877020.208914:0:3662:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788877020.208915:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877020.208917:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788877020.208921:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532494208:0@lo:253:kworker.0 20000000:01000000:2.0:1788877020.214272:0:54979:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788877020.214286:0:54979:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788877020.214412:0:54983:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788877020.214798:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3662:x1875771532494336:12345-0@lo:253:kworker.0 Request processed in 23403us (23595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.214808:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788877020.214903:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788877020.214906:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788877020.214907:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877020.214908:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877020.214909:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877020.214911:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877020.214912:0:3662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788877020.214914:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877020.214915:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788877020.214918:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532494336:0@lo:253:kworker.0 20000000:01000000:1.0:1788877020.215003:0:54982:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788877020.215008:0:54982:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788877020.215027:0:54982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215042:0:54982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788877020.215050:0:54982:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048850s 00010000:00010000:1.0:1788877020.215055:0:54982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215062:0:54982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215069:0:54982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215076:0:54982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215082:0:54982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877020.215086:0:54982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215095:0:54982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215112:0:54982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215119:0:54982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215126:0:54982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487a00/0xf5bf0f7e313b04f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877020.215515:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:54972:x1875771532494592:12345-0@lo:253:mount.lustre.0 Request processed in 6922us (22282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.215523:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788877020.215618:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788877020.215629:0:54972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788877020.215631:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788877020.215633:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877020.215634:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877020.215635:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877020.215636:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877020.215637:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877020.215638:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877020.215640:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877020.215641:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877020.215642:0:54972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788877020.215655:0:54972:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13d0608800 from lustre-MDT0000 10000000:01000000:1.0:1788877020.215683:0:54972:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788877020.215686:0:54972:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788877020.215694:0:54972:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a13d0608800 10000000:01000000:1.0:1788877020.215697:0:54972:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788877020.215701:0:54972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a13d0608800 10000000:01000000:1.0:1788877020.215703:0:54972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788877020.215707:0:54972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13d0608800 from 1 10000000:01000000:1.0:1788877020.215710:0:54972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788877020.215736:0:54972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215750:0:54972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.215769:0:54972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.215787:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788877020.215816:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.215844:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4838000 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.215961:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494720 00000100:00100000:2.0:1788877020.215966:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494720 00000100:00100000:2.0:1788877020.216002:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788877020.216010:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:54972:x1875771532494720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877020.216020:0:54980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877020.216033:0:54980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313b0500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b04f9 expref: -99 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.216050:0:54980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313b0500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b04f9 expref: 7 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.216059:0:54980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313b0500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b04f9 expref: 7 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.216067:0:54980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73e00, rc 0) 00000100:00100000:2.0:1788877020.216092:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:54972:x1875771532494720:12345-0@lo:101:mount.lustre.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.216098:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788877020.216159:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877020.216172:0:54972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.216180:0:54972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.216191:0:54972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788877020.216206:0:54972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.216213:0:54972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877020.216219:0:54972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788877020.216223:0:54972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788877020.216227:0:54972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a13d0608800 10000000:01000000:0.0:1788877020.216230:0:54972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788877020.216232:0:54972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788877020.216234:0:54972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788877020.216247:0:54972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.216254:0:54972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.216261:0:54972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877020.216273:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788877020.216301:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.216319:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877020.216394:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494848 00000100:00100000:3.0:1788877020.216398:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494848 00000100:00100000:3.0:1788877020.216429:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788877020.216435:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:54972:x1875771532494848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788877020.216442:0:54979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877020.216452:0:54979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9800/0xf5bf0f7e313b050e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0507 expref: -99 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.216465:0:54979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9800/0xf5bf0f7e313b050e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0507 expref: 8 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.216473:0:54979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9800/0xf5bf0f7e313b050e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0507 expref: 8 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.216480:0:54979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9800, rc 0) 00000100:00100000:3.0:1788877020.216513:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54972:x1875771532494848:12345-0@lo:101:mount.lustre.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.216519:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788877020.216585:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877020.216625:0:54972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.216633:0:54972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877020.216679:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877020.216701:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.216719:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.216830:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532494976 00000100:00100000:2.0:1788877020.216834:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532494976 00000100:00100000:2.0:1788877020.216852:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788877020.216858:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54972:x1875771532494976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877020.216952:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532494976:12345-0@lo:501:mount.lustre.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.216958:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788877020.217153:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532494976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877020.217179:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532495104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877020.217222:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.217250:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d05a7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.217291:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495104 00000100:00100000:2.0:1788877020.217295:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495104 00000100:00100000:2.0:1788877020.217322:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788877020.217329:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532495104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877020.218666:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532495104:12345-0@lo:503:mount.lustre.0 Request processed in 1332us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.218674:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:3.0:1788877020.223579:0:54983:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788877020.223633:0:54983:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788877020.227053:0:54982:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788877020.227064:0:54982:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788877020.227100:0:54982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227119:0:54982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788877020.227129:0:54982:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000066391s 00010000:00010000:1.0:1788877020.227134:0:54982:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227140:0:54982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227147:0:54982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227153:0:54982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227164:0:54982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877020.227169:0:54982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227176:0:54982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227188:0:54982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227196:0:54982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.227202:0:54982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0515 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877020.227486:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3665:x1875771532494464:12345-0@lo:253:kworker.0 Request processed in 33323us (36226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.227498:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1788877020.228270:0:3665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788877020.228274:0:3665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788877020.228276:0:3665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877020.228277:0:3665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877020.228278:0:3665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877020.228280:0:3665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877020.228281:0:3665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788877020.228283:0:3665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877020.228285:0:3665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788877020.228289:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532494464:0@lo:253:kworker.0 00000100:00100000:0.0:1788877020.231272:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfd04e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532495104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788877020.232046:0:54985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54985:1875771532495232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788877020.232120:0:54985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.232162:0:54985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c48386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877020.232260:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495232 00000100:00100000:0.0:1788877020.232267:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495232 00000100:00100000:0.0:1788877020.232317:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788877020.232326:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54985:x1875771532495232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877020.233432:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54985:x1875771532495232:12345-0@lo:502:llog_process_th.0 Request processed in 1103us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877020.233442:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788877020.233586:0:54985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54985:1875771532495232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788877020.233653:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877020.233666:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.233668:0:54985:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788877020.233678:0:54985:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788877020.233681:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788877020.233694:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a13c79c4d40) 00000020:00000080:1.0:1788877020.233714:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788877020.233719:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788877020.233810:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788877020.233816:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0523 00000020:00000080:1.0:1788877020.234036:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788877020.234040:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877020.234044:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.234046:0:54985:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788877020.234048:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877020.234052:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.234053:0:54985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788877020.234056:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788877020.234065:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a13eefc0000) 00000020:00000080:1.0:1788877020.234077:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788877020.234081:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788877020.234084:0:54985:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788877020.234087:0:54985:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788877020.234093:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788877020.234132:0:54985:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13d0608800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788877020.234144:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c45eb380) 00000020:00000080:1.0:1788877020.234154:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788877020.234203:0:54985:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788877020.234208:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0538 00000020:00000080:1.0:1788877020.234293:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788877020.234298:0:54985:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788877020.234302:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313b053f 00080000:01000000:1.0:1788877020.234308:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788877020.234310:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0546 00010000:00010000:3.0:1788877020.415737:0:54985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788877020.415878:0:54985:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 90194313216 lx: 0 gen 1 00000001:00080000:3.0:1788877020.415916:0:54985:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 85899345925 srv lr: 90194313216 lx: 0 gen 4 00000001:00000004:3.0:1788877020.415947:0:54985:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 22, last_transno is 90194313216 00000001:00080000:3.0:1788877020.416044:0:54985:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788877020.416098:0:54985:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c86a69c0: xid 1875771511305856, transno 90194313218, client gen 4, slot idx 0 00000001:00080000:3.0:1788877020.416107:0:54985:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c86a6780: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:3.0:1788877020.416112:0:54985:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c86a6480: xid 1875771511304832, transno 90194313217, client gen 4, slot idx 2 00000001:00080000:3.0:1788877020.416116:0:54985:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a13c86a66c0: xid 1875771510863616, transno 64424509702, client gen 4, slot idx 3 00000020:00000080:3.0:1788877020.416515:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a12c3f60000) 00000020:00000080:3.0:1788877020.416535:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788877020.416643:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788877020.416651:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0562 00000020:00000080:2.0:1788877020.430386:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788877020.433454:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313b0569 00000020:00000080:3.0:1788877020.433924:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788877020.433935:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788877020.433942:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.433944:0:54985:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788877020.433947:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788877020.433950:0:54985:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788877020.433952:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877020.433953:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877020.433955:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788877020.433957:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.433959:0:54985:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788877020.433961:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788877020.433966:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.433967:0:54985:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788877020.433972:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788877020.434017:0:54985:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788877020.434044:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788877020.434048:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.434049:0:54985:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788877020.434052:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788877020.434055:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.434056:0:54985:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788877020.434059:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788877020.434065:0:54985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1788877020.434087:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788877020.434102:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a12c3f64d40) 00000020:00000080:3.0:1788877020.434121:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788877020.434126:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788877020.434273:0:54985:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788877020.434279:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788877020.434286:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0577 00010000:00080000:3.0:1788877020.434322:0:54985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13cfd60000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788877020.437502:0:54985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1788877020.439125:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788877020.439139:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788877020.439240:0:54985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788877020.439261:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b057e 00000100:00080000:2.0:1788877020.439271:0:54985:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788877020.439277:0:54985:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a13cfd60000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877020.439311:0:54985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f4037800 x1875771532495360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877020.439369:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788877020.439433:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.439521:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495360 00000100:00100000:3.0:1788877020.439529:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495360 00000100:00100000:3.0:1788877020.439561:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1788877020.439569:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532495360:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788877020.439591:0:13623:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2008 last 0 00000020:00000080:3.0:1788877020.439644:0:13623:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0585 00000004:00100000:3.0:1788877020.439657:0:13623:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788877020.439740:0:13623:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd61000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788877020.439959:0:54985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788877020.440028:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788877020.440034:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877020.440036:0:54985:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788877020.440038:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788877020.440041:0:54985:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788877020.440043:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788877020.440044:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788877020.440046:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788877020.440049:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877020.440050:0:54985:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788877020.440053:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788877020.440057:0:54985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788877020.440060:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877020.440062:0:54985:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788877020.440065:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788877020.440068:0:54985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1788877020.440091:0:54985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788877020.440094:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788877020.440107:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c5e399c0) 00000020:00000080:2.0:1788877020.440123:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788877020.440128:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788877020.440307:0:54985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788877020.440313:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788877020.440321:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0593 00010000:00080000:2.0:1788877020.440348:0:54985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ef173800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1788877020.440536:0:54985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:1.0:1788877020.441670:0:54985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788877020.441694:0:54985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788877020.442070:0:54985:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 20, last_idx 21 00000040:00080000:1.0:1788877020.445586:0:54985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788877020.445745:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfd04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532495360:12345-0@lo:38:llog_process_th.0 Request processed in 6170us (6306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.445768:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000040:00080000:1.0:1788877020.445907:0:54985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].22, 64 off9600 00000040:00080000:1.0:1788877020.446065:0:54985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].1, 64 off8256 00000100:00100000:0.0:1788877020.446416:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788877020.446427:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788877020.446434:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788877020.446439:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788877020.446443:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd60000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788877020.446460:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788877020.446653:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788877020.446664:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532495488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877020.446720:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.447024:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495488 00000100:00100000:1.0:1788877020.447030:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495488 00000100:00100000:1.0:1788877020.447073:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788877020.447082:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532495488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788877020.447111:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877020.447280:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532495488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 199us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.447287:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1788877020.447451:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c47eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532495488:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788877020.447896:0:54991:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 22 synced_idx: 0 lgh_last_idx: 22 00000040:00080000:0.0:1788877020.447901:0:54991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x54:0x0] at index 21 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788877020.448048:0:54991:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000040:00080000:0.0:1788877020.448066:0:54991:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x54:0x0] at index 21 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788877020.448189:0:54991:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 22 synced_idx: 22 lgh_last_idx: 22 00000040:00080000:0.0:1788877020.448193:0:54991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788877020.449099:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788877020.449111:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788877020.449149:0:54985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788877020.449240:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b059a 00000100:00080000:1.0:1788877020.449250:0:54985:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788877020.449255:0:54985:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13ef173800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877020.449287:0:54985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa781880 x1875771532495616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877020.449338:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495616:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788877020.449396:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.449487:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495616 00000100:00100000:3.0:1788877020.449494:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495616 00000100:00100000:3.0:1788877020.449534:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1788877020.449540:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3661:x1875771532495616:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1788877020.449566:0:43959:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2008 last 0 00000020:00000080:3.0:1788877020.449591:0:43959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b05a1 00002000:00100000:3.0:1788877020.449631:0:43959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13cfd65800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788877020.449635:0:43959:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788877020.449638:0:43959:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788877020.449700:0:43959:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788877020.449724:0:43959:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd63000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788877020.449876:0:54985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788877020.449951:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877020.449956:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.449958:0:54985:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788877020.449962:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788877020.449965:0:54985:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788877020.449967:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788877020.449969:0:54985:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788877020.449970:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788877020.449973:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.449974:0:54985:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788877020.449977:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788877020.449981:0:54985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788877020.449984:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.449985:0:54985:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788877020.449988:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788877020.449991:0:54985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1788877020.450010:0:54985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788877020.450013:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788877020.450024:0:54985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c45e8000) 00000020:00000080:1.0:1788877020.450039:0:54985:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788877020.450043:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788877020.450108:0:54985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788877020.450114:0:54985:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788877020.450119:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b05af 00010000:00080000:1.0:1788877020.450145:0:54985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13c3002800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1788877020.450737:0:54985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1788877020.450811:0:54985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788877020.450825:0:54985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788877020.451243:0:54985:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 20, last_idx 21 00000040:00080000:1.0:1788877020.452040:0:54985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788877020.452066:0:54985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].22, 64 off9600 00000040:00080000:1.0:1788877020.452214:0:54985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5a:0x0].1, 64 off8256 00000100:00100000:3.0:1788877020.452592:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532495616:12345-0@lo:8:llog_process_th.0 Request processed in 3047us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.452623:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1788877020.452905:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788877020.452916:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788877020.452924:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788877020.452928:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788877020.452932:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788877020.453066:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788877020.453073:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495616:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788877020.453123:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532495744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877020.453194:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.453317:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495744 00000100:00100000:2.0:1788877020.453324:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495744 00000100:00100000:2.0:1788877020.453383:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1788877020.453393:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532495744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788877020.453420:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877020.453475:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532495744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.453482:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:0.0:1788877020.453587:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877020.453739:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532495744:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788877020.454134:0:54993:0:(llog.c:805:llog_process_thread()) index: 21, lh_last_idx: 22 synced_idx: 0 lgh_last_idx: 22 00000040:00080000:1.0:1788877020.454140:0:54993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x56:0x0] at index 21 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788877020.454309:0:54993:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000040:00080000:1.0:1788877020.454325:0:54993:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x56:0x0] at index 21 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1788877020.454427:0:54993:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 22 synced_idx: 22 lgh_last_idx: 22 00000040:00080000:1.0:1788877020.454430:0:54993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000004:00080000:3.0:1788877020.454776:0:54991:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788877020.454813:0:54991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2008350210087ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788877020.454818:0:54991:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788877020.456572:0:54973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788877020.456944:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788877020.458251:0:54985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788877020.458267:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788877020.458307:0:54985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788877020.458333:0:54985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b05b6 00000100:00080000:1.0:1788877020.458342:0:54985:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788877020.458348:0:54985:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13c3002800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877020.458381:0:54985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fa783800 x1875771532495872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877020.458443:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495872:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788877020.458523:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.458703:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532495872 00000100:00100000:2.0:1788877020.458712:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532495872 00000100:00100000:2.0:1788877020.458752:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1788877020.458769:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3661:x1875771532495872:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1788877020.458796:0:43956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2008 last 0 00000020:00000080:2.0:1788877020.458819:0:43956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b05bd 00002000:00100000:2.0:1788877020.458832:0:43956:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ef170000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788877020.458839:0:43956:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788877020.458841:0:43956:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788877020.458908:0:43956:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788877020.458933:0:43956:0:(import.c:65:import_set_state_nolock()) ffff8a12c1af4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788877020.460340:0:54985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788877020.460434:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877020.460441:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.460443:0:54985:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788877020.460447:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877020.460451:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.460452:0:54985:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788877020.460455:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788877020.460457:0:54985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788877020.460459:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877020.460461:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.461361:0:54985:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788877020.461370:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877020.461376:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.461378:0:54985:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788877020.461382:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788877020.461426:0:54985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54985:1875771532496000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788877020.461574:0:54985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.461682:0:54985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877020.462012:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496000 00000100:00100000:3.0:1788877020.462020:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496000 00000100:00100000:3.0:1788877020.462063:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788877020.462072:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54985:x1875771532496000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877020.462213:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54985:x1875771532496000:12345-0@lo:502:llog_process_th.0 Request processed in 142us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.462221:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788877020.462370:0:54985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54985:1875771532496000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788877020.462395:0:54985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877020.462400:0:54985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877020.462402:0:54985:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788877020.462406:0:54985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788877020.462720:0:54972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788877020.462744:0:54972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788877020.462771:0:54972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.462782:0:54972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877020.462791:0:54972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13d0608800 from 1 10000000:01000000:1.0:1788877020.462794:0:54972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788877020.462826:0:54972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.462835:0:54972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.462845:0:54972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.462861:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788877020.462898:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.462914:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877020.462979:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496128 00000100:00100000:3.0:1788877020.462985:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496128 00000100:00100000:3.0:1788877020.463020:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788877020.463027:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:54972:x1875771532496128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788877020.463037:0:54979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877020.463052:0:54979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b05c4 expref: -99 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.463075:0:54979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 9 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.463086:0:54979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 9 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.463097:0:54979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9200, rc 0) 00000100:00100000:3.0:1788877020.463129:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532496128:12345-0@lo:101:mount.lustre.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.463136:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788877020.463252:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788877020.463265:0:54972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.463279:0:54972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.463933:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496256:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788877020.463973:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.464000:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788877020.464017:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496256 00000100:00100000:1.0:1788877020.464021:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496256 00000100:00100000:1.0:1788877020.464050:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788877020.464057:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532496256:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788877020.464072:0:54980:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788877020.464090:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788877020.464094:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788877020.464097:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788877020.464100:0:54980:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 90 00000100:00100000:2.0:1788877020.464269:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532495872:12345-0@lo:8:llog_process_th.0 Request processed in 5498us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.464278:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1788877020.465132:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532496256:12345-0@lo:256:mount.lustre.0 Request processed in 1073us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.465141:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788877020.465267:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496256:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788877020.467417:0:54972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788877020.467440:0:54972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.467453:0:54972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877020.467477:0:54972:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13d0608800 from 1 10000000:01000000:1.0:1788877020.467481:0:54972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788877020.467520:0:54972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.467528:0:54972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.467537:0:54972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.467557:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788877020.468090:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788877020.468106:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788877020.468114:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788877020.468120:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788877020.468124:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c3002800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788877020.468143:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788877020.468159:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532495872:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788877020.468451:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.468562:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532496512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788877020.468629:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.468677:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496512 00000100:00100000:0.0:1788877020.468683:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496512 00000100:00100000:0.0:1788877020.468729:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1788877020.468739:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532496512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788877020.468769:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788877020.468810:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532496512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877020.468817:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00080000:0.0:1788877020.468837:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788877020.468865:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532496512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877020.468995:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1788877020.469013:0:54993:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788877020.469105:0:54993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2008364502803ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788877020.469112:0:54993:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788877020.469562:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496384 00000100:00100000:3.0:1788877020.469567:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496384 00000100:00100000:3.0:1788877020.469962:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788877020.469971:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:54972:x1875771532496384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788877020.469983:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877020.469999:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca8200/0xf5bf0f7e313b05d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b05d2 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.470020:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca8200/0xf5bf0f7e313b05d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05d2 expref: 10 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.470030:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca8200/0xf5bf0f7e313b05d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05d2 expref: 10 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877020.470039:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8200, rc 0) 00000100:00100000:3.0:1788877020.470082:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532496384:12345-0@lo:101:mount.lustre.0 Request processed in 112us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.470088:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788877020.470240:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877020.470257:0:54972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877020.470267:0:54972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877020.470329:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877020.470358:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788877020.473517:0:54973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788877020.475139:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59600 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.480035:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496640 00000100:00100000:2.0:1788877020.480051:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496640 00000100:00100000:2.0:1788877020.480133:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788877020.480144:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532496640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877020.480363:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532496640:12345-0@lo:501:mount.lustre.0 Request processed in 221us (10003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.480370:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788877020.480730:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877020.480795:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877020.480849:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.480886:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59600 going to sleep for 11 seconds 00000100:00100000:3.0:1788877020.481062:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496768 00000100:00100000:3.0:1788877020.481067:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496768 00000100:00100000:3.0:1788877020.481202:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788877020.481209:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532496768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788877020.481304:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532496768:12345-0@lo:503:mount.lustre.0 Request processed in 94us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.481311:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788877020.481477:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532496768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788877020.482010:0:54995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54995:1875771532496896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877020.482051:0:54995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.482085:0:54995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d55d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.482134:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532496896 00000100:00100000:2.0:1788877020.482139:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532496896 00000100:00100000:2.0:1788877020.482179:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788877020.482185:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f424a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54995:x1875771532496896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.482992:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f424a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54995:x1875771532496896:12345-0@lo:502:llog_process_th.0 Request processed in 803us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.483001:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788877020.489429:0:54995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54995:1875771532496896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788877020.489488:0:54995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788877020.489500:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.489503:0:54995:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788877020.489513:0:54995:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13d0608800 00000020:00000080:3.0:1788877020.489516:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788877020.489523:0:54995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788877020.489526:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.489527:0:54995:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788877020.489529:0:54995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788877020.489532:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877020.489533:0:54995:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788877020.489536:0:54995:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13d0608800 00000020:00000080:3.0:1788877020.489538:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788877020.489805:0:54995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54995:1875771532497024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877020.489872:0:54995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.489907:0:54995:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d55d8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.494748:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497024 00000100:00100000:2.0:1788877020.494772:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497024 00000100:00100000:2.0:1788877020.494827:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788877020.494837:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54995:x1875771532497024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.494987:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54995:x1875771532497024:12345-0@lo:502:llog_process_th.0 Request processed in 151us (5114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.494996:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788877020.495060:0:54995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54995:1875771532497024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788877020.495093:0:54995:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788877020.495101:0:54995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877020.495103:0:54995:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788877020.495108:0:54995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788877020.496335:0:54972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1788877020.496365:0:54972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788877020.496381:0:54972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496392:0:54972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877020.496440:0:54972:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788877020.496443:0:54972:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a13d0608800 10000000:01000000:2.0:1788877020.496446:0:54972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a13d0608800 10000000:01000000:2.0:1788877020.496450:0:54972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788877020.496455:0:54972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13d0608800 from 1 10000000:01000000:2.0:1788877020.496458:0:54972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788877020.496499:0:54972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496508:0:54972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496517:0:54972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877020.496535:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788877020.496579:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.496638:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.496664:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497152 00000100:00100000:2.0:1788877020.496668:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497152 00000100:00100000:2.0:1788877020.496698:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788877020.496705:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:54972:x1875771532497152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877020.496714:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877020.496726:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313b05e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b05e0 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496746:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313b05e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05e0 expref: 11 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496768:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313b05e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05e0 expref: 11 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496777:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72e00, rc 0) 00000100:00100000:2.0:1788877020.496810:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532497152:12345-0@lo:101:mount.lustre.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.496817:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788877020.496854:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877020.496866:0:54972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.496876:0:54972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877020.496927:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877020.496952:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.496965:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.496980:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497280 00000100:00100000:2.0:1788877020.496983:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497280 00000100:00100000:2.0:1788877020.497004:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788877020.497010:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532497280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877020.497114:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532497280:12345-0@lo:501:mount.lustre.0 Request processed in 104us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.497121:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788877020.497162:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877020.497197:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877020.497232:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.497245:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.497258:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497408 00000100:00100000:2.0:1788877020.497261:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497408 00000100:00100000:2.0:1788877020.497277:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788877020.497283:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532497408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877020.497356:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532497408:12345-0@lo:503:mount.lustre.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.497364:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788877020.497402:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4037b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532497408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877020.501964:0:54997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877020.502042:0:54997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.502082:0:54997:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f360c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.502132:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497536 00000100:00100000:2.0:1788877020.502138:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497536 00000100:00100000:2.0:1788877020.502195:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788877020.502203:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.502502:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497536:12345-0@lo:502:llog_process_th.0 Request processed in 299us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.502509:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788877020.502629:0:54997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497536:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788877020.502684:0:54997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788877020.502698:0:54997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c4e34d40) 00000020:00000080:0.0:1788877020.502720:0:54997:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788877020.502812:0:54997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13d0608800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788877020.502816:0:54997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13d0608800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788877020.502819:0:54997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608800 4 00010000:00080000:0.0:1788877020.502847:0:54997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ff363000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788877020.504441:0:54997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1788877020.504657:0:54997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788877020.504698:0:54997:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788877020.504710:0:54997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313b05f5 00000100:00080000:0.0:1788877020.504717:0:54997:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788877020.504722:0:54997:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13ff363000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1788877020.504769:0:54997:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13cfccd180 x1875771532497664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788877020.504796:0:54997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788877020.513407:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532497664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788877020.513500:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.517734:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497664 00000100:00100000:3.0:1788877020.517748:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497664 00000100:00100000:3.0:1788877020.517810:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:3.0:1788877020.517818:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532497664:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788877020.517923:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532497664:12345-0@lo:38:llog_process_th.0 Request processed in 105us (4423us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788877020.517931:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:0.0:1788877020.518143:0:54997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.518315:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788877020.518324:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877020.518328:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788877020.518332:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532497664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788877020.518808:0:54997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.518879:0:54997:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f360c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.540298:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497792 00000100:00100000:2.0:1788877020.540312:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497792 00000100:00100000:2.0:1788877020.540376:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788877020.540386:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.540563:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497792:12345-0@lo:502:llog_process_th.0 Request processed in 178us (21754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.540571:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788877020.542374:0:54997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877020.542476:0:54997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877020.542534:0:54997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877020.542578:0:54997:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f360c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.542772:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532497920 00000100:00100000:2.0:1788877020.542779:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532497920 00000100:00100000:2.0:1788877020.542826:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788877020.542834:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877020.542942:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54997:x1875771532497920:12345-0@lo:502:llog_process_th.0 Request processed in 108us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.542949:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788877020.543023:0:54997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54997:1875771532497920:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788877020.543047:0:54997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788877020.543330:0:54972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788877020.543355:0:54972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788877020.543372:0:54972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.543382:0:54972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788877020.543431:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788877020.543433:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788877020.543435:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.543436:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.543437:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.543438:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.543440:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788877020.543441:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788877020.543443:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.543444:0:54972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788877020.543448:0:54972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788877020.543451:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788877020.543452:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788877020.543453:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.543454:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.543456:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.543457:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.543458:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788877020.543459:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788877020.543459:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.543473:0:54972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788877020.543488:0:54972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788877020.543498:0:54972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532498048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788877020.543534:0:54972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.543554:0:54972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7296f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.543574:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498048 00000100:00100000:2.0:1788877020.543578:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498048 00000100:00100000:2.0:1788877020.543632:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788877020.543640:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532498048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788877020.543662:0:54977:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788877020.543675:0:54977:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788877020.553027:0:54977:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788877020.553047:0:54977:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788877020.553327:0:54982:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788877020.553333:0:54982:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788877020.553354:0:54982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.553371:0:54982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.553379:0:54982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.553419:0:54982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.553434:0:54982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 2108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.553448:0:54982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:54982:1875771532498176:0@lo:104: 00000100:00100000:1.0:1788877020.553528:0:54982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.553568:0:54982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d2721900 going to sleep for 11 seconds 00000100:00100000:2.0:1788877020.553791:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498176 00000100:00100000:2.0:1788877020.553799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498176 00000100:00100000:2.0:1788877020.553847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788877020.553855:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:54982:x1875771532498176:12345-0@lo:104: 00010000:00010000:2.0:1788877020.553868:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877020.553916:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788877020.553923:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:54982:x1875771532498176:12345-0@lo:104: Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.553929:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788877020.554029:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:54972:x1875771532498048:12345-0@lo:253:mount.lustre.0 Request processed in 10388us (10493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877020.554039:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788877020.554134:0:54972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:54972:1875771532498048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788877020.554146:0:54972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788877020.554149:0:54972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788877020.554162:0:54972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788877020.554163:0:54972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877020.554164:0:54972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877020.554166:0:54972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877020.554167:0:54972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877020.554168:0:54972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788877020.554169:0:54972:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788877020.554171:0:54972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877020.554173:0:54972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788877020.554186:0:54972:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788877020.555178:0:54982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:54982:1875771532498176:0@lo:104: 00010000:00010000:1.0:1788877020.555197:0:54982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.555217:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788877020.555223:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.555230:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877020.555234:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.555242:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877020.555249:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877020.555255:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788877020.555287:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.555293:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877020.573679:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.573692:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1486a00/0xf5bf0f7e313b05c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b05cb expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.573710:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877020.573712:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877020.573714:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877020.573728:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788877020.573746:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532498304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877020.573819:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877020.573870:0:9553:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498304 00000100:00100000:1.0:1788877020.573876:0:9553:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498304 00010000:00010000:1.0:1788877020.573905:0:9553:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 2108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.573931:0:9553:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788877020.573938:0:9553:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3665:x1875771532498304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877020.573951:0:9553:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877020.573956:0:9553:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 2108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.573967:0:9553:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 2108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.573981:0:9553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b05cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313b05c4 expref: 11 pid: 54979 timeout: 2108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.573996:0:9553:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574005:0:9553:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788877020.574020:0:9553:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020688225s 00010000:00010000:1.0:1788877020.574024:0:9553:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574031:0:9553:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574037:0:9553:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574044:0:9553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574050:0:9553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877020.574054:0:9553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574062:0:9553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574074:0:9553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574084:0:9553:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877020.574117:0:9553:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3665:x1875771532498304:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.574124:0:9553:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:1.0:1788877020.574188:0:54982:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574197:0:54982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877020.574202:0:54982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487e00/0xf5bf0f7e313b05fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 54982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877020.574232:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532498304:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788877020.603297:0:54972:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:2.0:1788877020.603596:0:54972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788877020.603833:0:55003:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:3.0:1788877020.603836:0:55003:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:1.0:1788877020.604239:0:55004:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788877020.604362:0:54972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788877020.606022:0:55005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.606106:0:55005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.606141:0:55005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3c76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788877020.607369:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498432 00000100:00100000:1.0:1788877020.607380:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498432 00000100:00100000:1.0:1788877020.607429:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1788877020.607436:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788877020.607538:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.607544:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1788877020.607805:0:55005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498432:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788877020.607846:0:55005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788877020.607882:0:55005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.607919:0:55005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.607944:0:55005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d9eed3c0 going to sleep for 11 seconds 00000040:01000000:3.0:1788877020.608479:0:54972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788877020.608514:0:54972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788877020.608993:0:54972:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788877020.609002:0:54972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788877020.609040:0:54972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788877020.609635:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498560 00000100:00100000:1.0:1788877020.609644:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498560 00000100:00100000:1.0:1788877020.609717:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1788877020.609727:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498560:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788877020.609892:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498560:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 166us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.609900:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1788877020.610020:0:55005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498560:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.610102:0:55005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.610134:0:55005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.610641:0:55005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d9eed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877020.610748:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498688 00000100:00100000:0.0:1788877020.610765:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498688 00000100:00100000:0.0:1788877020.610799:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1788877020.610806:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877020.610875:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877020.610885:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1788877020.611244:0:55005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4036d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.611324:0:55005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877020.611386:0:55005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877020.611403:0:55005:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d9eed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788877020.611457:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498816 00000100:00100000:0.0:1788877020.611462:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498816 00000100:00100000:0.0:1788877020.611505:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1788877020.611512:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877020.611709:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:55005:x1875771532498816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 197us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877020.611716:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1788877020.612342:0:55005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:55005:1875771532498816:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788877020.618294:0:54972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788877020.626378:0:55005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788877020.626476:0:55005:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788877020.626892:0:54972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788877020.627026:0:54972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788877020.627495:0:54972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788877020.630426:0:55004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788877020.630776:0:55004:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788877020.630782:0:55004:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1788877020.633242:0:54972:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x49:0x0] (8/32) registered 00010000:00080000:2.0:1788877020.635870:0:54972:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 90194313218 00010000:00080000:0.0:1788877020.640732:0:55006:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 55006 00010000:02000000:0.0:1788877020.640748:0:55006:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1788877020.640910:0:54972:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788877020.640928:0:54972:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788877020.640947:0:54972:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788877020.640966:0:54972:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788877020.641847:0:54972:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788877020.642085:0:54972:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:1.0:1788877020.652488:0:55006:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1788877020.652497:0:55006:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1788877020.657082:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532498944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877020.657151:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877020.695656:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532498944 00000100:00100000:3.0:1788877020.695668:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532498944 00000100:00100000:3.0:1788877020.695720:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788877020.695730:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532498944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877020.695766:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877020.695844:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532498944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (38692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877020.695851:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1788877020.695903:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532498944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877020.853190:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877020.857175:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877020.857209:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877020.857235:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877020.857264:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877020.857304:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314048 00000100:00100000:1.0:1788877020.857312:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314048 00000100:00100000:1.0:1788877020.857341:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314176 00000100:00100000:1.0:1788877020.857344:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314176 00000100:00100000:1.0:1788877020.857385:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1971 00000100:00100000:1.0:1788877020.857394:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511314176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877020.857476:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511314176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.857483:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1971 00000100:00100000:1.0:1788877020.857501:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2751 00000100:00100000:1.0:1788877020.857506:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511314048:12345-192.168.203.11@tcp:38:kworker.0 00010000:00080000:1.0:1788877020.857527:0:8722:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a12c6617000, cookie 0xf5bf0f7e313b0554 00010000:00080000:1.0:1788877020.857532:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t90194313219 exp ffff8a12c6617000 cur 2008 last 1788877020 00010000:02000400:1.0:1788877020.857541:0:8722:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1788877020.857546:0:8722:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1788877020.857562:0:8722:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788877020.857729:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13c486a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788877020.857772:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511314048:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 263us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.857783:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2751 00000100:00100000:1.0:1788877020.857804:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314432 00000100:00100000:1.0:1788877020.857808:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314432 00000100:00100000:1.0:1788877020.857833:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314304 00000100:00100000:1.0:1788877020.857836:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314304 00000100:00100000:1.0:1788877020.857855:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1514 00000100:00100000:1.0:1788877020.857862:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511314432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877020.857887:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fae32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511314432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.857893:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1514 00000100:00100000:1.0:1788877020.857904:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1515 00000100:00100000:1.0:1788877020.857910:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511314304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877020.857931:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511314304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877020.857938:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1515 00000100:00080000:1.0:1788877020.857955:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788877020.857959:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788877020.857961:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877020.860714:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511313920 00000100:00100000:2.0:1788877020.860726:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511313920 00000100:00100000:2.0:1788877020.860784:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1788877020.860792:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1875771511313920:12345-192.168.203.11@tcp:250:kworker.0 00010000:00080000:2.0:1788877020.860815:0:54979:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 2008 last 0 00000020:00000080:2.0:1788877020.860842:0:54979:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313b0603 00000100:00080000:2.0:1788877020.860967:0:54979:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e65800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877020.861020:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511313920:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 227us (7839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877020.861027:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:1.0:1788877020.865759:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877020.872062:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307264 00000100:00100000:2.0:1788877020.872074:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307264 00000100:00100000:2.0:1788877020.872131:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2752 00000100:00100000:2.0:1788877020.872142:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511307264:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:2.0:1788877020.872162:0:51736:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 90194313219, current: 90194313219, replaying 00000100:00100000:2.0:1788877020.872179:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511307264:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 41us (6438us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788877020.872185:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2752 00010000:00080000:1.0:1788877020.873916:0:55006:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:2.0:1788877021.288798:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788877021.288806:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13d0608800 from 91 10000000:01000000:2.0:1788877021.288811:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788877021.288863:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.288876:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.288889:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.288915:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.288998:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.289043:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db240 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.289126:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499072 00000100:00100000:0.0:1788877021.289134:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499072 00000100:00100000:0.0:1788877021.289196:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788877021.289206:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532499072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877021.289218:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877021.289234:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b060a expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.289258:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b060a expref: 11 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.289269:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b060a expref: 11 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.289278:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe600, rc 0) 00000100:00100000:0.0:1788877021.289333:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532499072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.289340:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788877021.289499:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.289517:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.289526:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.289585:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.289659:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.289676:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.289893:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499200 00000100:00100000:0.0:1788877021.289898:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499200 00000100:00100000:0.0:1788877021.289924:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788877021.289931:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532499200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788877021.289956:0:54979:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788877021.289972:0:54979:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788877021.289975:0:54979:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 91 00000100:00100000:0.0:1788877021.290056:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532499200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.290064:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788877021.290184:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788877021.290228:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788877021.290235:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.290243:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.290252:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788877021.290254:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:3.0:1788877021.290256:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788877021.290275:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.290282:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.290290:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.290308:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.290334:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.290360:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.290552:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499328 00000100:00100000:1.0:1788877021.290557:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499328 00000100:00100000:1.0:1788877021.290595:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788877021.290627:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532499328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877021.290635:0:54980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877021.290645:0:54980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b061f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0618 expref: -99 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.290662:0:54980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b061f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0618 expref: 12 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.290672:0:54980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b061f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0618 expref: 12 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.290679:0:54980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487800, rc 0) 00000100:00100000:1.0:1788877021.290710:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.290716:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788877021.290979:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.290990:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.290999:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.291050:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.291075:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.291110:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.291239:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499456 00000100:00100000:1.0:1788877021.291244:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499456 00000100:00100000:1.0:1788877021.291274:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788877021.291281:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.291400:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.291407:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788877021.292500:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.292536:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.292583:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.292645:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.292870:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499584 00000100:00100000:0.0:1788877021.292876:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499584 00000100:00100000:0.0:1788877021.292915:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788877021.292924:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.293032:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.293039:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788877021.293320:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877021.294348:0:55036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1788877021.294836:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1788877021.294858:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788877021.294868:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.294879:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877021.294892:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788877021.294894:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1788877021.294897:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788877021.294926:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.294934:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.294954:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877021.294972:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.295021:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.295059:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123840 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.295233:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499712 00000100:00100000:2.0:1788877021.295240:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499712 00000100:00100000:2.0:1788877021.295285:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788877021.295294:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532499712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877021.295305:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877021.295317:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72200/0xf5bf0f7e313b062d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0626 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.295339:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72200/0xf5bf0f7e313b062d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0626 expref: 13 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.295350:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72200/0xf5bf0f7e313b062d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0626 expref: 13 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.295358:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72200, rc 0) 00000100:00100000:2.0:1788877021.295408:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532499712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.295415:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788877021.296013:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.296029:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.296038:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.296225:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.296258:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.296330:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234240 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.298458:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499840 00000100:00100000:2.0:1788877021.298471:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499840 00000100:00100000:3.0:1788877021.298697:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788877021.298708:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532499840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.298900:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532499840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.298908:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788877021.299138:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.299255:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.299307:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.299385:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123840 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.299534:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532499968 00000100:00100000:2.0:1788877021.299539:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532499968 00000100:00100000:2.0:1788877021.299727:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788877021.299736:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532499968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.301638:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5556c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532499968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1898us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.301650:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788877021.301858:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532499968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788877021.304529:0:55037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788877021.307583:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788877021.307741:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788877021.307762:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.307775:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.307785:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788877021.307788:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:3.0:1788877021.307791:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788877021.307836:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.307844:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.307860:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.307883:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.307945:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.308044:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e00e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.312101:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500096 00000100:00100000:1.0:1788877021.312116:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500096 00000100:00100000:1.0:1788877021.312355:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788877021.312366:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532500096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877021.312392:0:54979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877021.312411:0:54979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313b063b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0634 expref: -99 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.312438:0:54979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313b063b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0634 expref: 14 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.312450:0:54979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313b063b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0634 expref: 14 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.312460:0:54979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487000, rc 0) 00000100:00100000:1.0:1788877021.312819:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f5554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.312826:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788877021.312917:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.312944:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.312954:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.313025:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.313058:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.313106:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e00e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.313352:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500224 00000100:00100000:1.0:1788877021.313357:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500224 00000100:00100000:1.0:1788877021.313397:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788877021.313405:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ace450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.313770:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ace450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.313777:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788877021.313840:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.313873:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.313917:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.313952:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13e00e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.314043:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500352 00000100:00100000:2.0:1788877021.314048:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500352 00000100:00100000:2.0:1788877021.314086:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788877021.314093:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.314181:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.314187:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788877021.314315:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877021.317295:0:55038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788877021.321715:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788877021.321764:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788877021.321777:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.321789:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877021.321800:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788877021.321803:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:2.0:1788877021.321805:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788877021.321847:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.321855:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.321871:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.321896:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.321961:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.322017:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.323051:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500480 00000100:00100000:1.0:1788877021.323061:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500480 00000100:00100000:1.0:1788877021.323122:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788877021.323132:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532500480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877021.323145:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877021.323168:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313b0649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0642 expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.323194:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313b0649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0642 expref: 15 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.323205:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313b0649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0642 expref: 15 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.323220:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486e00, rc 0) 00000100:00100000:1.0:1788877021.323271:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.323277:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788877021.323569:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877021.323586:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.323646:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.323710:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.323740:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.323773:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.323788:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500608 00000100:00100000:2.0:1788877021.323792:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500608 00000100:00100000:2.0:1788877021.323816:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788877021.323823:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ace850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.323929:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ace850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.323936:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788877021.323966:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.323993:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.324036:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.324048:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.324690:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500736 00000100:00100000:3.0:1788877021.324695:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500736 00000100:00100000:3.0:1788877021.324723:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788877021.324729:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.324827:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.324834:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788877021.324876:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877021.327343:0:55039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788877021.328167:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788877021.328190:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788877021.328200:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.328211:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877021.328221:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788877021.328224:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1788877021.328227:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788877021.328259:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.328268:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.328278:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.328299:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.328354:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.328402:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.329197:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500864 00000100:00100000:3.0:1788877021.329204:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500864 00000100:00100000:3.0:1788877021.329245:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788877021.329254:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7accc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532500864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.329267:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.329280:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b0657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0650 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.329304:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b0657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0650 expref: 16 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.329314:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b0657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0650 expref: 16 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.329324:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9200, rc 0) 00000100:00100000:0.0:1788877021.329572:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877021.329588:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.329624:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877021.329692:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.330704:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7accc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532500864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1447us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.330713:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788877021.333793:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.333878:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.335994:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532500992 00000100:00100000:2.0:1788877021.336008:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532500992 00000100:00100000:3.0:1788877021.336667:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788877021.336678:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532500992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.336877:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532500992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.336884:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788877021.337002:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532500992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.337057:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.337115:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.337158:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13ca123240 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.337315:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501120 00000100:00100000:1.0:1788877021.337321:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501120 00000100:00100000:1.0:1788877021.337358:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788877021.337366:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532501120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.338300:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532501120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 931us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.338308:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788877021.339386:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877021.340963:0:55041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1788877021.341294:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1788877021.341315:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788877021.341326:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.341337:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877021.341347:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788877021.341349:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:1.0:1788877021.341352:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788877021.341398:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.341406:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.341419:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877021.341439:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.341503:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877021.341543:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d55d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.341825:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501248 00000100:00100000:3.0:1788877021.341832:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501248 00000100:00100000:3.0:1788877021.341868:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788877021.341877:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532501248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.341888:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.341900:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca8c00/0xf5bf0f7e313b0665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b065e expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.341921:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca8c00/0xf5bf0f7e313b0665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b065e expref: 17 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.341932:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca8c00/0xf5bf0f7e313b0665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b065e expref: 17 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.341949:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8c00, rc 0) 00000100:00100000:3.0:1788877021.342027:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.342034:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788877021.345029:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877021.345054:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.345067:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877021.345172:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.345219:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877021.345299:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d55d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.345532:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501376 00000100:00100000:0.0:1788877021.345538:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501376 00000100:00100000:0.0:1788877021.345660:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788877021.345671:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.345804:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.345813:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788877021.346243:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.346275:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.346312:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.350438:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501504 00000100:00100000:2.0:1788877021.350450:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501504 00000100:00100000:1.0:1788877021.351218:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d55d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.351773:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788877021.351784:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7acec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.351923:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7acec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.351931:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788877021.352020:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788877021.354091:0:55043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788877021.354395:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788877021.354433:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788877021.354445:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.354458:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877021.354579:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788877021.354582:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:2.0:1788877021.354585:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788877021.354650:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.354659:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.354670:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.354693:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.354764:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.354800:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.354904:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501632 00000100:00100000:1.0:1788877021.354911:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501632 00000100:00100000:1.0:1788877021.354956:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788877021.354964:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532501632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877021.354975:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877021.354988:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b066c expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.355011:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b066c expref: 18 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.355021:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b066c expref: 18 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877021.355029:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486a00, rc 0) 00000100:00100000:1.0:1788877021.355082:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532501632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.355088:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788877021.355302:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877021.355317:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.355326:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.355394:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.355419:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.355445:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.355644:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501760 00000100:00100000:1.0:1788877021.355650:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501760 00000100:00100000:1.0:1788877021.355673:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788877021.355679:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532501760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.355796:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532501760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.355803:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788877021.356000:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.356028:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.356084:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.356106:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.356269:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532501888 00000100:00100000:1.0:1788877021.356273:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532501888 00000100:00100000:1.0:1788877021.356304:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788877021.356311:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532501888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877021.356552:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532501888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877021.356559:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788877021.356724:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532501888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788877021.359323:0:55044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788877021.369973:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788877021.370011:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788877021.370024:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.370036:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877021.370046:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788877021.370048:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 88 10000000:01000000:2.0:1788877021.370051:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788877021.370100:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.370109:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.370119:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.370143:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.371360:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.373078:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db900 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.380195:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502016 00000100:00100000:3.0:1788877021.380209:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502016 00000100:00100000:3.0:1788877021.380266:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788877021.380276:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532502016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.380292:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.380309:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9a00/0xf5bf0f7e313b0681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b067a expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.380335:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9a00/0xf5bf0f7e313b0681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b067a expref: 19 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.380346:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9a00/0xf5bf0f7e313b0681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b067a expref: 19 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.380356:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9a00, rc 0) 00000100:00100000:3.0:1788877021.380440:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532502016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (9080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.380447:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788877021.382853:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.382878:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.382890:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.382956:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.383017:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.383054:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4852300 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.383235:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502144 00000100:00100000:0.0:1788877021.383242:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502144 00000100:00100000:0.0:1788877021.383287:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788877021.383295:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532502144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788877021.383312:0:54980:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788877021.383327:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788877021.383330:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788877021.383333:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788877021.383336:0:54980:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788877021.383338:0:54980:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 91 00000100:00100000:0.0:1788877021.384702:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532502144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1402us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.384714:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788877021.384895:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788877021.384980:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788877021.384989:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.385000:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.385009:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788877021.385012:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1788877021.385015:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788877021.385042:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.385049:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.385057:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.385085:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.385117:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.385267:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f36523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877021.385312:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502272 00000100:00100000:0.0:1788877021.385318:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502272 00000100:00100000:0.0:1788877021.385357:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788877021.385365:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532502272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877021.385436:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877021.385450:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeff200/0xf5bf0f7e313b068f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0688 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.385536:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeff200/0xf5bf0f7e313b068f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0688 expref: 20 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.385547:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeff200/0xf5bf0f7e313b068f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0688 expref: 20 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.385555:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff200, rc 0) 00000100:00100000:0.0:1788877021.385876:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877021.385884:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788877021.385917:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877021.385929:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877021.385937:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877021.385995:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.386022:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.386085:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.392973:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502400 00000100:00100000:3.0:1788877021.392987:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502400 00000100:00100000:3.0:1788877021.394177:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788877021.394190:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.394360:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (8336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.394368:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788877021.394996:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.395052:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877021.395111:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877021.397329:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c469b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788877021.400395:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502528 00000100:00100000:1.0:1788877021.400409:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502528 00000100:00100000:1.0:1788877021.400480:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788877021.400491:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.404068:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3570us (8947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.404092:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788877021.404249:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788877021.406708:0:55049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1788877021.407322:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1788877021.407345:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788877021.407356:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407367:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.407387:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1788877021.407390:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:3.0:1788877021.407393:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788877021.407431:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407439:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407449:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.407484:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.407550:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.407598:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7d3a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.407690:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502656 00000100:00100000:3.0:1788877021.407697:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502656 00000100:00100000:3.0:1788877021.407741:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788877021.407759:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532502656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.407772:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.407784:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca8800/0xf5bf0f7e313b069d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0696 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407978:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca8800/0xf5bf0f7e313b069d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0696 expref: 21 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407990:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca8800/0xf5bf0f7e313b069d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0696 expref: 21 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.407999:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca8800, rc 0) 00000100:00100000:3.0:1788877021.408039:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa5f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532502656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.408045:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788877021.408101:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.408115:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408124:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.408138:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788877021.408142:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408275:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.408282:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788877021.408284:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788877021.408286:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788877021.408306:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408313:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408320:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.408332:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.408357:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.408446:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7d3a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.408654:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502784 00000100:00100000:3.0:1788877021.408660:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502784 00000100:00100000:3.0:1788877021.408688:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788877021.408695:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532502784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.408702:0:54980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.408712:0:54980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b06ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b06a4 expref: -99 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408726:0:54980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b06ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06a4 expref: 22 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408739:0:54980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b06ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06a4 expref: 22 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408745:0:54980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9600, rc 0) 00000100:00100000:3.0:1788877021.408785:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532502784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.408791:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788877021.408888:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.408899:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408908:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.408920:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788877021.408924:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408930:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.408937:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788877021.408938:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:3.0:1788877021.408941:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788877021.408954:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408961:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.408968:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.408980:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.409005:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.409025:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7d3a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.409035:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532502912 00000100:00100000:3.0:1788877021.409038:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532502912 00000100:00100000:3.0:1788877021.409060:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788877021.409066:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532502912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.409435:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877021.409447:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b06b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b06b2 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.409529:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b06b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06b2 expref: 23 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.409539:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b06b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06b2 expref: 23 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.409546:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efca9c00, rc 0) 00000100:00100000:3.0:1788877021.409586:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532502912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 520us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.409793:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788877021.409925:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532502912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877021.409937:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.409945:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877021.409998:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.410025:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.410052:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.410144:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503040 00000100:00100000:3.0:1788877021.410207:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503040 00000100:00100000:3.0:1788877021.410238:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788877021.410245:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532503040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.410342:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532503040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877021.410349:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788877021.410455:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.410548:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.410702:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.410718:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.410731:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503168 00000100:00100000:2.0:1788877021.410735:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503168 00000100:00100000:2.0:1788877021.410773:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788877021.410781:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532503168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.412404:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532503168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1618us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.412414:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788877021.419667:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788877021.421524:0:55051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788877021.423082:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788877021.423113:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788877021.423124:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.423137:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877021.423239:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788877021.423242:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788877021.423245:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788877021.423281:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.423290:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.423299:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.423323:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.423440:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877021.423540:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503296 00000100:00100000:2.0:1788877021.423546:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503296 00000100:00100000:2.0:1788877021.423587:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788877021.423622:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532503296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877021.423633:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877021.423645:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313b06c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b06c0 expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.423666:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313b06c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06c0 expref: 24 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.423676:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313b06c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b06c0 expref: 24 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.423685:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72600, rc 0) 00000100:00100000:2.0:1788877021.425576:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532503296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1950us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877021.425586:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788877021.425729:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f46e93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877021.425764:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877021.425784:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.425796:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877021.426344:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877021.426451:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877021.426564:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f46e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877021.433971:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503424 00000100:00100000:2.0:1788877021.433985:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503424 00000100:00100000:2.0:1788877021.434141:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788877021.434162:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532503424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877021.434281:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532503424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (7830us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788877021.434289:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788877021.434961:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532503424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788877021.435008:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788877021.435018:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877021.435034:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877021.480771:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877022.504819:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877022.703187:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877022.703293:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314560 00000100:00100000:2.0:1788877022.703303:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314560 00000100:00100000:2.0:1788877022.703365:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1788877022.703375:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511314560:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877022.703392:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877022.703408:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313b06ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a46 expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.703436:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313b06ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a46 expref: 6 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.703447:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313b06ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a46 expref: 6 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.703462:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef73000, rc 0) 00000100:00100000:2.0:1788877022.703521:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511314560:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 147us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877022.703527:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1788877022.705972:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877022.706057:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314688 00000100:00100000:2.0:1788877022.706065:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314688 00000100:00100000:2.0:1788877022.706112:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1788877022.706122:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511314688:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788877022.706145:0:54979:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1788877022.706168:0:54979:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788877022.706172:0:54979:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1788877022.706176:0:54979:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1788877022.706179:0:54979:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1788877022.706181:0:54979:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 91 00000100:00100000:2.0:1788877022.707856:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511314688:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 1729us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877022.707868:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1788877022.721473:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877022.722107:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314816 00000100:00100000:2.0:1788877022.722118:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314816 00000100:00100000:2.0:1788877022.722172:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1788877022.722183:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511314816:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877022.722199:0:54983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877022.722216:0:54983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313b06d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a4d expref: -99 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.722246:0:54983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313b06d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a4d expref: 7 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.722258:0:54983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313b06d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a4d expref: 7 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877022.722267:0:54983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef72c00, rc 0) 00000100:00100000:2.0:1788877022.722321:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511314816:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 140us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877022.722329:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1788877022.733815:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877022.733853:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511314944 00000100:00100000:1.0:1788877022.733863:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511314944 00000100:00100000:1.0:1788877022.733912:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1788877022.733922:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511314944:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877022.734075:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511314944:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 153us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877022.734083:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1788877022.737572:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877022.737715:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315072 00000100:00100000:2.0:1788877022.737724:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315072 00000100:00100000:2.0:1788877022.737788:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1788877022.737799:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511315072:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877022.737933:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbd70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511315072:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877022.737940:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1788877022.742139:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877022.742207:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315200 00000100:00100000:1.0:1788877022.742216:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315200 00000100:00100000:1.0:1788877022.742268:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:1.0:1788877022.742277:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511315200:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877022.742293:0:54977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877022.742310:0:54977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487200/0xf5bf0f7e313b06dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a54 expref: -99 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877022.742338:0:54977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487200/0xf5bf0f7e313b06dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a54 expref: 9 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877022.742350:0:54977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487200/0xf5bf0f7e313b06dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a54 expref: 9 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877022.742359:0:54977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487200, rc 0) 00000100:00100000:1.0:1788877022.742417:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315200:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 140us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877022.742424:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1788877022.744426:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877022.744496:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315328 00000100:00100000:3.0:1788877022.744504:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315328 00000100:00100000:3.0:1788877022.744552:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1788877022.744561:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315328:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877022.744974:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315328:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 412us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877022.744983:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1788877022.755871:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877022.755933:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315456 00000100:00100000:3.0:1788877022.755942:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315456 00000100:00100000:3.0:1788877022.755991:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1788877022.756000:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315456:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877022.756116:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315456:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877022.756123:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1788877022.766767:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877022.767391:0:54980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315584 00000100:00100000:0.0:1788877022.767401:0:54980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315584 00000100:00100000:0.0:1788877022.767448:0:54980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1788877022.767470:0:54980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511315584:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877022.767485:0:54980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877022.767501:0:54980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313b06e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a5b expref: -99 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877022.767528:0:54980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313b06e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a5b expref: 10 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877022.767540:0:54980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313b06e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a5b expref: 10 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877022.767549:0:54980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeffe00, rc 0) 00000100:00100000:0.0:1788877022.767829:0:54980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511315584:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 371us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877022.767840:0:54980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1788877022.769486:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877022.769552:0:54977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315712 00000100:00100000:3.0:1788877022.769559:0:54977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315712 00000100:00100000:3.0:1788877022.769761:0:54977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1788877022.769771:0:54977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511315712:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877022.769867:0:54977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511315712:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 96us (385us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788877022.769875:0:54977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:3.0:1788877023.529850:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877024.560827:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877024.744961:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788877024.744982:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532503552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788877024.745047:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877024.745112:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503552 00000100:00100000:3.0:1788877024.745119:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503552 00000100:00100000:3.0:1788877024.745172:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1788877024.745181:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532503552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877024.745206:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877024.745248:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c47eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532503552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877024.745255:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:3.0:1788877024.745274:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877024.745309:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532503552:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788877025.403552:0:55256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788877025.576985:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877025.780689:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532503680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877025.780771:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788877025.782778:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877025.782785:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877025.782789:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877025.782796:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2008 00000100:00080000:2.0:1788877025.782800:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877025.782806:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877025.782828:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13f408bb80 x1875771532504064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877025.782845:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877025.782848:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877025.782850:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877025.782853:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2008 00000100:00080000:2.0:1788877025.782855:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877025.782858:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877025.782873:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb106680 x1875771532504192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877025.782897:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877025.782900:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877025.782902:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877025.782905:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2008 00000100:00080000:2.0:1788877025.782907:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877025.782911:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877025.782921:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb105c00 x1875771532504448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877025.782941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877025.782944:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877025.782945:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877025.782948:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2008 00000100:00080000:2.0:1788877025.782950:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788877025.782953:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877025.782962:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb107480 x1875771532504832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877025.782982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788877025.782984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877025.782986:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877025.782989:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13ff363000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877025.782998:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13eb106d80 x1875771532505344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877025.783038:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532503808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877025.783087:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503680 00000100:00100000:2.0:1788877025.783094:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783096:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503680 00000100:00100000:2.0:1788877025.783132:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532504704:0@lo:400:kworker.0 00000100:00100000:3.0:1788877025.783140:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1788877025.783148:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532503680:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788877025.783153:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788877025.783179:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788877025.783181:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788877025.783185:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532503936:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783210:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783217:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532503680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877025.783223:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788877025.783228:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532504960:0@lo:400:kworker.0 00000100:00100000:3.0:1788877025.783245:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503808 00000100:00100000:3.0:1788877025.783249:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503808 00000100:00100000:2.0:1788877025.783250:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783278:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1788877025.783283:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f408bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532504064:0@lo:38:kworker.0 00000100:00100000:3.0:1788877025.783284:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532503808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877025.783303:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877025.783306:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877025.783323:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532504192:0@lo:38:kworker.0 00000100:00100000:3.0:1788877025.783333:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532503808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877025.783339:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1788877025.783341:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783354:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504064 00000100:00100000:2.0:1788877025.783357:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532504448:0@lo:38:kworker.0 00000100:00100000:3.0:1788877025.783357:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504064 00000100:00100000:3.0:1788877025.783373:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1788877025.783375:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783377:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532504064:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788877025.783389:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532504832:0@lo:38:kworker.0 00010000:00080000:3.0:1788877025.783395:0:6545:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8a12c6614000, cookie 0xf5bf0f7e313b054d 00010000:00080000:3.0:1788877025.783401:0:6545:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8a12c6614000 cur 2013 last 1788877020 00000100:00100000:2.0:1788877025.783406:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:3.0:1788877025.783417:0:6545:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788877025.783419:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532505344:0@lo:38:kworker.0 00000100:00100000:2.0:1788877025.783436:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877025.783477:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532504320:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783498:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877025.783514:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532505088:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783535:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788877025.783536:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a13eefde800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877025.783551:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788877025.783556:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532504576:0@lo:400:kworker.0 00000100:00100000:3.0:1788877025.783573:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532504064:12345-0@lo:38:kworker.0 Request processed in 194us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.783575:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783580:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1788877025.783590:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532505216:0@lo:400:kworker.0 00000100:00100000:3.0:1788877025.783597:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532503936 00000100:00100000:3.0:1788877025.783618:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532503936 00000100:00100000:2.0:1788877025.783631:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.783642:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788877025.783648:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532503936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783672:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532503680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877025.783674:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532503936:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877025.783680:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788877025.783694:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504960 00000100:00100000:2.0:1788877025.783697:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504960 00000100:00080000:3.0:1788877025.783702:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788877025.783712:0:55006:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788877025.783717:0:55006:0:(ldlm_lib.c:2709:replay_request_or_update()) Waiting for transno 90194313219 00000020:00080000:3.0:1788877025.783722:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.783726:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 90194313219, next_transno: 90194313219 00010000:00080000:3.0:1788877025.783741:0:55006:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (90194313219) 00000020:00080000:3.0:1788877025.783744:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:2.0:1788877025.783745:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504192 00000100:00100000:2.0:1788877025.783747:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504192 00010000:00080000:3.0:1788877025.783753:0:55006:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511307264 t90194313219 from 192.168.203.11@tcp req@ffff8a13eb01e680 x1875771511307264/t0(90194313219) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:416/0 lens 528/0 e 0 to 0 dl 1788877031 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877025.783755:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504448 00000100:00100000:2.0:1788877025.783757:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504448 00000100:00100000:2.0:1788877025.783764:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504832 00000100:00100000:2.0:1788877025.783766:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504832 00000100:00100000:2.0:1788877025.783772:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505344 00000100:00100000:2.0:1788877025.783774:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505344 00000100:00100000:2.0:1788877025.783780:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504576 00000100:00100000:2.0:1788877025.783782:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504576 00000100:00100000:2.0:1788877025.783798:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1788877025.783804:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532504960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783835:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532504960:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.783841:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1788877025.783855:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1788877025.783861:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532504576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.783894:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532504576:12345-0@lo:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.783899:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1788877025.783910:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:2.0:1788877025.783914:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532504192:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.783927:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2013 last 0 00000020:00000080:2.0:1788877025.783954:0:8722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf5bf0f7e313b06ea 00000004:00100000:2.0:1788877025.783961:0:8722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788877025.783977:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877025.784002:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875771532504192:12345-0@lo:38:kworker.0 Request processed in 87us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784009:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:2.0:1788877025.784021:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1788877025.784025:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532504448:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.784035:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2013 last 0 00000020:00000080:2.0:1788877025.784054:0:8722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5bf0f7e313b06f1 00000004:00100000:2.0:1788877025.784060:0:8722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788877025.784074:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13fbfcb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877025.784100:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875771532504448:12345-0@lo:38:kworker.0 Request processed in 73us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784106:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1788877025.784120:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:2.0:1788877025.784123:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532504832:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.784134:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2013 last 0 00000020:00000080:2.0:1788877025.784155:0:8722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5bf0f7e313b06f8 00000004:00100000:2.0:1788877025.784161:0:8722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788877025.784175:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e64800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877025.784202:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875771532504832:12345-0@lo:38:kworker.0 Request processed in 76us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784208:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:2.0:1788877025.784220:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1788877025.784224:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532505344:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.784237:0:8722:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2013 last 0 00000020:00000080:2.0:1788877025.784256:0:8722:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5bf0f7e313b06ff 00000004:00100000:2.0:1788877025.784261:0:8722:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788877025.784274:0:8722:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e67800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877025.784300:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532505344:12345-0@lo:38:kworker.0 Request processed in 74us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784306:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:2.0:1788877025.784345:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504704 00000100:00100000:2.0:1788877025.784349:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504704 00000100:00100000:2.0:1788877025.784374:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532504320 00000100:00100000:2.0:1788877025.784377:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532504320 00000100:00100000:2.0:1788877025.784391:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505088 00000100:00100000:2.0:1788877025.784394:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505088 00000100:00100000:2.0:1788877025.784409:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505216 00000100:00100000:2.0:1788877025.784412:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505216 00000100:00100000:2.0:1788877025.784429:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1788877025.784436:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532504704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784466:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532504704:12345-0@lo:400:kworker.0 Request processed in 31us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784472:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1788877025.784483:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1788877025.784488:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532504320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784513:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532504320:12345-0@lo:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784518:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1788877025.784530:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:2.0:1788877025.784536:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532505088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784563:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532505088:12345-0@lo:400:kworker.0 Request processed in 27us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784568:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:2.0:1788877025.784579:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:2.0:1788877025.784585:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532505216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784636:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d3035500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532505216:12345-0@lo:400:kworker.0 Request processed in 51us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877025.784642:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00080000:3.0:1788877025.784677:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788877025.784682:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877025.784683:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877025.784772:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532504576:0@lo:400:kworker.0 00000100:00080000:3.0:1788877025.784782:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 22 00000100:00100000:2.0:1788877025.784783:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532505216:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784791:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532504320:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784800:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532505088:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784830:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532503936:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784841:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532504960:0@lo:400:kworker.0 00000100:00100000:2.0:1788877025.784854:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532503808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877025.784864:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532504704:0@lo:400:kworker.0 00000100:00080000:3.0:1788877025.785286:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1788877025.785292:0:3661:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1788877025.785295:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:3.0:1788877025.785298:0:3661:0:(recover.c:53:ptlrpc_replay_next()) import ffff8a13d1512800 from lustre-MDT0000_UUID committed 4294967298 last 0 00000100:00080000:3.0:1788877025.785301:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1788877025.794574:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f408bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532504064:0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.794635:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb106680 x1875771532504192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.794660:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 22 00000100:00080000:2.0:1788877025.796541:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8a13eb106680 x1875771532504192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.796555:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788877025.796560:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788877025.796564:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000004:00080000:3.0:1788877025.817547:0:55006:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32885us 00000100:00100000:2.0:1788877025.826621:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532504192:0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.826668:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb105c00 x1875771532504448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.826687:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 22 00000100:00080000:2.0:1788877025.827474:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8a13eb105c00 x1875771532504448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.827483:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788877025.827488:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788877025.827491:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788877025.827496:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532504448:0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.827513:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb107480 x1875771532504832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.827523:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 22 00000100:00080000:2.0:1788877025.828295:0:3661:0:(import.c:1372:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8a13eb107480 x1875771532504832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877050 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.828303:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1788877025.828307:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1788877025.828311:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1788877025.828315:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532504832:0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.828333:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a13eb106d80 x1875771532505344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788877035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877025.828342:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 22 00000100:00080000:2.0:1788877025.828347:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788877025.828350:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788877025.828352:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788877025.828356:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532505344:0@lo:38:kworker.0 00010000:00080000:2.0:1788877025.828407:0:55277:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1788877025.828411:0:55277:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1788877025.828416:0:55277:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1788877025.830880:0:55277:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1788877025.830984:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532505472:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1788877025.831045:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877025.831117:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505472 00000100:00100000:3.0:1788877025.831124:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505472 00000100:00100000:3.0:1788877025.831176:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1788877025.831185:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532505472:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1788877025.831203:0:6545:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13f408bb80 x1875771532505472/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:421/0 lens 224/0 e 0 to 0 dl 1788877036 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877025.831215:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3661:x1875771532505472:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (170us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788877025.831222:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00010000:00010000:3.0:1788877025.833765:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.833946:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.833965:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.833980:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.833989:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.833996:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837890:0:55006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837905:0:55006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837917:0:55006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837924:0:55006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877025.837929:0:55006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837937:0:55006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837953:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d5606200) 00010000:00010000:3.0:1788877025.837956:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877025.837960:0:55006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837968:0:55006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7961000/0xf5bf0f7e313b0706 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877025.837986:0:55006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e146751d reply state 00000000f5130c67 transno 90194313219 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.837998:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.838006:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d5606300) 00010000:00010000:3.0:1788877025.838009:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877025.838012:0:55006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788877025.838127:0:55006:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1788877025.838145:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.838149:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313220 00000020:00080000:3.0:1788877025.838154:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.838156:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313220 00000001:00080000:3.0:1788877025.840046:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313219 is committed 00010000:00010000:3.0:1788877025.840080:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840092:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840100:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840107:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877025.840111:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840119:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840134:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13d5606300) 00010000:00010000:3.0:1788877025.840137:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877025.840141:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.840148:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960000/0xf5bf0f7e313b070d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877025.846053:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877025.846305:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511307776 00000100:00100000:2.0:1788877025.846316:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511307776 00000100:00100000:2.0:1788877025.846376:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2757 00000100:00100000:2.0:1788877025.846386:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511307776:12345-192.168.203.11@tcp:36:rm.0 00010000:00080000:2.0:1788877025.846404:0:8722:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 90194313220, current: 90194313220, replaying 00000100:00100000:2.0:1788877025.846424:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511307776:12345-192.168.203.11@tcp:36:rm.0 Request processed in 39us (379us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788877025.846431:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2757 00000020:00080000:3.0:1788877025.846507:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.846512:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 90194313220, next_transno: 90194313220 00010000:00080000:3.0:1788877025.846516:0:55006:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (90194313220) 00000020:00080000:3.0:1788877025.846519:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.846529:0:55006:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511307776 t90194313220 from 192.168.203.11@tcp req@ffff8a13efecca80 x1875771511307776/t0(90194313220) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:421/0 lens 512/0 e 0 to 0 dl 1788877036 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788877025.846648:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846663:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846674:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846687:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846694:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846700:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846808:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846818:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.846825:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847040:0:55006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847053:0:55006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847060:0:55006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847066:0:55006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877025.847070:0:55006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847078:0:55006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847091:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x114:0x0].0x0 (ffff8a13e7965100) 00010000:00010000:3.0:1788877025.847094:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788877025.847099:0:55006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847106:0:55006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960600/0xf5bf0f7e313b0722 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x114:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847123:0:55006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847129:0:55006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847135:0:55006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847140:0:55006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877025.847144:0:55006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847151:0:55006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847157:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7965b00) 00010000:00010000:3.0:1788877025.847160:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877025.847162:0:55006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847168:0:55006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960800/0xf5bf0f7e313b0714 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877025.847178:0:55006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002972919 reply state 000000002a047eba transno 90194313220 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847188:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.847195:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7965500) 00010000:00010000:3.0:1788877025.847197:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877025.847200:0:55006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1788877025.847265:0:55006:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1788877025.847279:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.847282:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313221 00000020:00080000:3.0:1788877025.847286:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.847288:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313221 00000100:00100000:0.0:1788877025.849352:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877025.856595:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511309056 00000100:00100000:2.0:1788877025.856642:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511309056 00000100:00100000:2.0:1788877025.856709:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1788877025.856720:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511309056:12345-192.168.203.11@tcp:36:mv.0 00010000:00080000:2.0:1788877025.856748:0:6552:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 90194313221, current: 90194313221, replaying 00000100:00100000:2.0:1788877025.856763:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2394:x1875771511309056:12345-192.168.203.11@tcp:36:mv.0 Request processed in 46us (7417us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788877025.856770:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000020:00080000:2.0:1788877025.856788:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788877025.856791:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 90194313221, next_transno: 90194313221 00010000:00080000:2.0:1788877025.856795:0:55006:0:(ldlm_lib.c:2272:check_for_next_transno()) waking for next (90194313221) 00000020:00080000:2.0:1788877025.856798:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788877025.856806:0:55006:0:(ldlm_lib.c:2773:replay_request_or_update()) @@@ processing x1875771511309056 t90194313221 from 192.168.203.11@tcp req@ffff8a13e7979f80 x1875771511309056/t0(90194313221) o36->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:421/0 lens 536/0 e 0 to 0 dl 1788877036 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mv.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788877025.856892:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856908:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856920:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856931:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856937:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856943:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856953:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856960:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.856965:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.859934:0:55006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.859953:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.859964:0:55006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788877025.860214:0:55006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b22cf5c reply state 0000000098070636 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860228:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860236:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13c86a1b00) 00010000:00010000:2.0:1788877025.860239:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:2.0:1788877025.860242:0:55006:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788877025.860264:0:55006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860273:0:55006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860281:0:55006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860287:0:55006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877025.860292:0:55006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860300:0:55006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860310:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1d00) 00010000:00010000:2.0:1788877025.860313:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877025.860316:0:55006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860323:0:55006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73800/0xf5bf0f7e313b0729 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788877025.860338:0:55006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b22cf5c reply state 0000000098070636 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860347:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860353:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13c86a1c00) 00010000:00010000:2.0:1788877025.860356:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788877025.860358:0:55006:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1788877025.860362:0:55006:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b22cf5c reply state 0000000098070636 transno 90194313221 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860369:0:55006:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877025.860376:0:55006:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13c86a1700) 00010000:00010000:2.0:1788877025.860379:0:55006:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788877025.860381:0:55006:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00080000:2.0:1788877025.860467:0:55006:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1788877025.860487:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788877025.860490:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313222 00000020:00080000:2.0:1788877025.860494:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1788877025.860496:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 90194313222 00000100:00100000:3.0:1788877025.876329:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877025.876905:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315840 00000100:00100000:2.0:1788877025.876916:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315840 00000100:00100000:2.0:1788877025.876965:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1974 00000100:00100000:2.0:1788877025.876974:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511315840:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1788877025.876997:0:15659:0:(ldlm_lib.c:3165:target_queue_recovery_request()) @@@ queue final req req@ffff8a13efecf800 x1875771511315840/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:421/0 lens 224/0 e 0 to 0 dl 1788877036 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877025.877021:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2394:x1875771511315840:12345-192.168.203.11@tcp:400:ldlm_lock_repla.0 Request processed in 49us (702us total) trans 0 rc 0/-999 00000100:00100000:2.0:1788877025.877029:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1974 00000020:00080000:3.0:1788877025.877123:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.877127:0:55006:0:(ldlm_lib.c:2254:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 90194313222 00010000:00080000:3.0:1788877025.877131:0:55006:0:(ldlm_lib.c:2288:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1788877025.877134:0:55006:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1788877025.877139:0:55006:0:(ldlm_lib.c:2478:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1788877025.877142:0:55006:0:(ldlm_lib.c:2311:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1788877025.877240:0:55006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 22, last_transno is 94489280512 00000001:00100000:2.0:1788877025.894113:0:54973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f0204769-56bd-4f5c-ab97-74c450c9e072 00000001:00100000:2.0:1788877025.894124:0:54973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788877025.894160:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 90194313221 is committed 00000001:00080000:2.0:1788877025.894203:0:55006:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1788877025.894243:0:55006:0:(ldlm_lib.c:2022:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1788877025.894267:0:55006:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8a13f408bb80 x1875771532505472/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:421/0 lens 224/0 e 0 to 0 dl 1788877036 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788877025.894377:0:55006:0:(ldlm_lib.c:2966:target_recovery_thread()) @@@ processing final ping from 192.168.203.11@tcp: req@ffff8a13efecf800 x1875771511315840/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:421/0 lens 224/0 e 0 to 0 dl 1788877036 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1788877025.894424:0:55006:0:(ldlm_lib.c:1894:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:0.0:1788877025.894475:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894486:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894494:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894500:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877025.894505:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894513:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894532:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7965500) 00010000:00010000:0.0:1788877025.894535:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877025.894540:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.894546:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7960a00/0xf5bf0f7e313b071b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895173:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895183:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895190:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895196:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877025.895199:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895206:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895218:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13c86a1700) 00010000:00010000:1.0:1788877025.895221:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788877025.895224:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895231:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef73600/0xf5bf0f7e313b0737 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895260:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895268:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895274:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895280:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877025.895283:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895289:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895296:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13c86a1c00) 00010000:00010000:1.0:1788877025.895299:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788877025.895301:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895308:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef72000/0xf5bf0f7e313b0730 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895319:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895325:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895331:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895338:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877025.895341:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895346:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895352:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13c86a1b00) 00010000:00010000:1.0:1788877025.895355:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788877025.895357:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.895363:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40e00/0xf5bf0f7e313b073e lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x113:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 55006 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788877025.897725:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1788877025.897749:0:3661:0:(client.c:3248:ptlrpc_resend_req()) @@@ going to resend req@ffff8a12c3c91500 x1875771532505472/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788877041 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788877025.897767:0:3661:0:(client.c:3257:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8a12c3c91500 x1875771532505472/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788877041 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788877025.897774:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1788877025.897790:0:3661:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1788877025.897795:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532505472:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1788877025.897927:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532505600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788877025.897988:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877025.898028:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505600 00000100:00100000:1.0:1788877025.898035:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505600 00000100:00100000:1.0:1788877025.898086:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1788877025.898095:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532505600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788877025.898128:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788877025.898176:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532505600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877025.898183:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1788877025.898213:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532505600:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1788877025.948376:0:55006:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa620882f7e10 00100000:10000000:3.0:1788877025.948392:0:55006:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1788877025.949431:0:54994:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788877025.949484:0:54994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54994:1875771532505728:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788877025.949551:0:54994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877025.949580:0:54994:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c1a40240 going to sleep for 11 seconds 00000100:00100000:1.0:1788877025.949628:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505728 00000100:00100000:1.0:1788877025.949634:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505728 00000100:00100000:1.0:1788877025.949677:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1788877025.949685:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f521b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:54994:x1875771532505728:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788877025.949712:0:43952:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -210 00002000:02000040:1.0:1788877025.949716:0:43952:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:560 to 0x2c0000401:769) 00000004:00080000:2.0:1788877025.949970:0:54992:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22f:0x0] 00000100:00100000:2.0:1788877025.949991:0:54992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54992:1875771532505856:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788877025.950020:0:54992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877025.950037:0:54992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7da180 going to sleep for 11 seconds 00000100:00100000:2.0:1788877025.950053:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505856 00000100:00100000:2.0:1788877025.950056:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505856 00000100:00100000:2.0:1788877025.950082:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1788877025.950089:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:54992:x1875771532505856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788877025.950103:0:17045:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -210 00002000:02000040:2.0:1788877025.950106:0:17045:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:560 to 0x280000401:769) 00002000:00010000:1.0:1788877025.963490:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788877025.963502:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.963519:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:1.0:1788877025.963523:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788877025.963530:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.963543:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.963553:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.963560:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877025.963576:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.964502:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.964510:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.964520:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.964525:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.964534:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.964553:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.964561:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3b72717/0xf5bf0f7e313b0745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.964584:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.964586:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.964588:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788877025.969972:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877025.969983:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.970000:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877025.970005:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877025.970011:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.970026:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.970035:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.970042:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.970074:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.970345:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.970353:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970362:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefea00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.970367:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970377:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970395:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970404:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002953d37b/0xf5bf0f7e313b074c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970423:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.970424:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.970425:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877025.970596:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877025.970662:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877025.970688:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877025.970712:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877025.970722:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511315968 00000100:00100000:0.0:1788877025.970740:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511315968 00000100:00100000:1.0:1788877025.970742:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316224 00000100:00100000:1.0:1788877025.970744:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316224 00000100:00100000:1.0:1788877025.970777:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316352 00000100:00100000:1.0:1788877025.970779:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316352 00000100:00100000:0.0:1788877025.970781:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1788877025.970799:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1520 00000100:00100000:0.0:1788877025.970801:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c27f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511315968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877025.970805:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511316224:12345-192.168.203.11@tcp:400:kworker.0 00002000:00010000:3.0:1788877025.970923:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.970929:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970939:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.970942:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.970947:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970963:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970972:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970980:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.970994:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971000:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971005:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971012:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971015:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971023:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971034:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971041:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d21cb8e/0xf5bf0f7e313b0753 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971053:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971055:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971057:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971096:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971101:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971109:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971112:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971117:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971126:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971134:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971142:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971153:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971159:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971163:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971176:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971179:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971187:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971196:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971203:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e44f7e1e/0xf5bf0f7e313b075a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971214:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971216:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971217:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971246:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971252:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971260:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971263:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971267:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971276:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971285:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971293:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971303:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971309:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971313:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971319:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971323:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971330:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971340:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971347:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fa5635/0xf5bf0f7e313b0761 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971357:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971359:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971361:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971389:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971394:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971402:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971405:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971409:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971418:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971426:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971434:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971456:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971461:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971465:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971471:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971475:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971488:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971498:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971505:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b1aa75/0xf5bf0f7e313b0768 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971516:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971518:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971519:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971550:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971555:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971563:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971566:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971570:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971579:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971588:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971596:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971623:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971629:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971633:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971640:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971643:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971651:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971661:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971669:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a99c6fa2/0xf5bf0f7e313b076f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971680:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971681:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971683:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971718:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971723:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971742:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971745:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971750:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971758:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971767:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971775:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971787:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971793:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971796:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971801:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971804:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971811:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971821:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971829:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f1ff1df/0xf5bf0f7e313b0776 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971841:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971843:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.971845:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.971882:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.971888:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971895:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.971898:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.971903:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971912:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971921:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971929:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971946:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.971952:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.971955:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971962:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.971966:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971974:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971984:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.971990:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea919f3a/0xf5bf0f7e313b077d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972002:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972003:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972005:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972037:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972043:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972050:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972054:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972058:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972067:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972075:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972083:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972093:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972098:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972102:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972108:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972111:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972118:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972126:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972139:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f81a41/0xf5bf0f7e313b0784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972150:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972151:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972153:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972182:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972186:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972194:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972197:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972201:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972209:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972215:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972221:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972231:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972237:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972240:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972246:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972248:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972255:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972263:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972269:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c96f01b4/0xf5bf0f7e313b078b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972280:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972281:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972283:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972318:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972323:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972330:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972333:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972337:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972349:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972355:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972362:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972373:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972379:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972382:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972388:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972391:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972397:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972406:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972413:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d815dddf/0xf5bf0f7e313b0792 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972426:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972428:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972430:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972468:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972472:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972479:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972482:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972486:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972494:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972501:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972508:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972520:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972526:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972532:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972542:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972545:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972552:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972562:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972569:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd0fd2b5/0xf5bf0f7e313b0799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972581:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972582:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972584:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972640:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972645:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972652:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972655:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972658:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972666:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972673:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972680:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972693:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972699:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972702:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972708:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972711:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972718:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972741:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972749:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc1fefc4/0xf5bf0f7e313b07a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972762:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972764:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972766:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972802:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972807:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972814:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972817:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972821:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972830:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972838:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972845:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972857:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.972864:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.972867:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972874:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.972877:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972889:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972900:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972907:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003d3e9e7/0xf5bf0f7e313b07a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972920:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972922:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.972923:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.972965:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.972971:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972978:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.972981:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.972985:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.972993:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973001:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973008:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973020:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.973026:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.973029:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973036:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.973040:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973047:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973058:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973065:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002638d7ba/0xf5bf0f7e313b07ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973078:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973080:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973082:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.973118:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.973124:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973132:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.973135:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.973140:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973149:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973158:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973166:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973178:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.973184:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.973187:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973194:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7960a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.973198:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973206:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973217:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973225:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c801ac35/0xf5bf0f7e313b07b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973237:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973238:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973240:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.973273:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.973278:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973285:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.973288:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.973292:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973301:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973310:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973318:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973336:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.973342:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.973346:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973353:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.973356:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973364:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973375:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973382:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfb2f05/0xf5bf0f7e313b07bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973395:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973397:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973399:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.973430:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.973435:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973443:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.973447:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.973451:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973460:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973469:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973477:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973487:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.973493:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.973496:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973502:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.973505:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973512:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973521:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973533:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9e5f93/0xf5bf0f7e313b07c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973545:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973546:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973548:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.973582:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.973587:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973594:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.973597:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.973621:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973631:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973638:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973646:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973658:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.973665:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.973669:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973675:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.973679:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973686:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973696:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973704:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e46d49/0xf5bf0f7e313b07ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.973717:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973718:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.973720:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877025.974053:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13d12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511316224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3240us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877025.974063:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1520 00000100:00100000:1.0:1788877025.974092:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1521 00000100:00100000:1.0:1788877025.974103:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511316352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877025.974349:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c27f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511315968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3547us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877025.974358:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000001:00100000:0.0:1788877025.975509:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788877025.980183:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.980196:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980213:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.980218:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.980224:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980243:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980263:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980270:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980288:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.980299:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.980304:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980311:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.980315:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980324:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980338:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980345:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a70bdb81/0xf5bf0f7e313b07d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980366:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980368:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980369:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.980413:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.980418:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980425:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.980428:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.980431:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980439:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980447:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980454:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980465:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.980471:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.980475:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980486:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.980488:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980496:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980506:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980514:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3619330/0xf5bf0f7e313b07d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980526:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980527:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980528:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.980565:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.980571:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980578:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.980581:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.980584:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980592:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980614:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980621:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980632:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.980639:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.980643:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980650:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0031a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.980653:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980660:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980669:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980676:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff25c6a0/0xf5bf0f7e313b07df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980687:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980689:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.980691:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.980746:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.980751:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980759:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.980763:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.980767:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980776:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980783:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980791:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980803:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.980809:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.980812:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980818:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c0030a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.980821:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980834:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980844:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.980852:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541e1f58/0xf5bf0f7e313b07e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877025.982026:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511316352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7919us (11304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877025.982037:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1521 00000100:00100000:1.0:1788877025.982086:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316096 00000100:00100000:1.0:1788877025.982094:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316096 00000100:00100000:1.0:1788877025.982145:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1975 00000100:00100000:1.0:1788877025.982154:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511316096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877025.982204:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511316096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (11514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877025.982211:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1975 00000100:00080000:1.0:1788877025.982231:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788877025.982235:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788877025.982239:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788877025.982955:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.982958:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.982960:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.984097:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.984107:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984123:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.984128:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.984134:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984149:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984159:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984167:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984193:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788877025.984220:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788877025.984226:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.984234:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7961c00 already unused, calling callback (ffffffffc0cf24f0) 00002000:00010000:3.0:1788877025.984234:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877025.984240:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.984240:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.984249:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.984265:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.984273:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b72cde2/0xf5bf0f7e313b07ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.984292:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.984293:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.984295:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.986038:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.986048:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.986056:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986072:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986084:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986092:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986125:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788877025.986207:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.986214:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986223:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.986227:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.986231:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.986241:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.987963:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.987982:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988006:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788877025.988023:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788877025.988029:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988037:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.988042:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988053:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988077:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988085:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000824508f8/0xf5bf0f7e313b07f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988109:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.988112:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988118:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.988122:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988131:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988140:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988146:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c600b149/0xf5bf0f7e313b07fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988159:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988161:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988163:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.988249:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.988255:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988265:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.988269:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.988274:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988285:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988292:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988298:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988309:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788877025.988343:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.988349:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988357:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.988360:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.988364:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988378:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988386:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988392:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988406:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788877025.988412:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788877025.988416:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988421:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.988425:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988432:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988441:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988449:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b252041e/0xf5bf0f7e313b0802 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988462:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.988464:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988470:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87c00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.988473:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988480:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988489:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988497:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4e39b90/0xf5bf0f7e313b0809 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988507:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988509:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988511:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.988549:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.988555:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988562:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.988566:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.988570:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988579:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988586:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988592:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988619:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.988625:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.988629:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988635:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.988638:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988645:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988656:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988668:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1be23b0/0xf5bf0f7e313b0810 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.988681:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988682:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.988684:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.988720:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.988725:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.990988:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.990998:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.993992:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.993997:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994006:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994023:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994035:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994043:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788877025.994268:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994277:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994287:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994290:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x301:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994295:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994305:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994314:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994322:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994342:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788877025.994440:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994445:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994453:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994455:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x300:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994459:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994468:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994475:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994482:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994494:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788877025.994531:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994536:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994545:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994548:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994552:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994561:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994569:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994576:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994592:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788877025.994652:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994657:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994665:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994668:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994672:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994681:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994689:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994697:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994706:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788877025.994749:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994754:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994762:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994766:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994770:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994780:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994787:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994795:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994803:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788877025.994835:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.994840:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994847:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.994850:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.994854:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.994862:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995141:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788877025.995149:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995158:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877025.995163:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995173:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995191:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995199:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4135e8/0xf5bf0f7e313b081e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995218:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788877025.995222:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995234:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877025.995237:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995245:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995255:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995262:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030e5d04f/0xf5bf0f7e313b0825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995273:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788877025.995276:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995283:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877025.995286:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995294:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995303:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995312:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070249a0f/0xf5bf0f7e313b082c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995324:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788877025.995328:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995334:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877025.995337:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995345:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995354:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995362:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000696d1141/0xf5bf0f7e313b0833 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995371:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788877025.995375:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995381:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877025.995385:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995394:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995402:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995409:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050df992d/0xf5bf0f7e313b083a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877025.995419:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.995421:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.995422:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877025.995428:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877025.997806:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788877025.998157:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788877025.999002:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999013:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999031:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788877025.999133:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.999140:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999151:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.999155:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.999161:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999174:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999182:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999188:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999201:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788877025.999238:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.999243:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999251:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.999254:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.999258:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999266:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999273:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999281:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999295:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788877025.999304:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788877025.999309:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999317:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.999321:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999330:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999351:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999359:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6ddf40/0xf5bf0f7e313b0841 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999375:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788877025.999379:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999386:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.999389:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999396:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999407:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999414:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048bcbf3d/0xf5bf0f7e313b0848 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999427:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.999430:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999437:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.999439:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999447:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999456:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999463:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000708f1fe4/0xf5bf0f7e313b084f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999475:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999476:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999478:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.999518:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.999524:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999531:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.999534:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.999539:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999548:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999556:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999563:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999575:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.999581:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.999585:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999591:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a86600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.999595:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999621:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999632:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999639:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbf5f7cc/0xf5bf0f7e313b0856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999652:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999654:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999656:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877025.999694:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877025.999700:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999708:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877025.999711:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877025.999715:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999724:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999746:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999753:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999766:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877025.999772:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877025.999776:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999782:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877025.999786:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999798:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999808:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999816:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9657044/0xf5bf0f7e313b085d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877025.999828:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999830:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877025.999831:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877025.999969:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877026.000341:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.000722:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788877026.000811:0:43952:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788877026.000818:0:43952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000828:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:2.0:1788877026.000831:0:43952:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788877026.000836:0:43952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000847:0:43952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000861:0:43952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000880:0:43952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000893:0:43952:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788877026.000900:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788877026.000905:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000912:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a12c4a87e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877026.000915:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000924:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000936:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000943:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040c66a05/0xf5bf0f7e313b0817 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000959:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788877026.000962:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000968:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877026.000971:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000979:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000988:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.000995:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9fcfb4f/0xf5bf0f7e313b0864 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 43952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.001006:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.001008:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.001009:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788877026.002050:0:43952:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:559 00000100:00100000:2.0:1788877026.002139:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f521b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:54994:x1875771532505728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 52451us (52584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877026.002148:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00002000:00010000:3.0:1788877026.002983:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.002993:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003007:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.003011:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.003016:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003030:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003040:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003047:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003064:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788877026.003137:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.003143:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003152:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.003155:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.003160:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003169:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003178:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003186:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003202:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788877026.003211:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788877026.003217:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003225:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.003229:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003239:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003253:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003261:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3b72717/0xf5bf0f7e313b086b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003276:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.003279:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003286:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.003290:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003297:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003306:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003315:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0872 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003325:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003326:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003328:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.003363:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.003368:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003376:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.003379:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.003383:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003392:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003401:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003409:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003420:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877026.003426:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.003430:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003437:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.003440:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003447:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003457:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003463:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098b94984/0xf5bf0f7e313b0879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003474:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003476:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003477:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.003515:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.003520:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003527:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.003530:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.003534:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003546:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003554:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003560:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003572:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877026.003578:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.003581:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003587:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.003590:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003597:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003627:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003635:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014a8b607/0xf5bf0f7e313b0880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003648:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003649:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003651:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.003689:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.003694:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003701:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.003704:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.003708:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003716:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003723:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003741:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003754:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877026.003761:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.003765:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003778:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872e00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.003781:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003788:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003798:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003804:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1d68eea/0xf5bf0f7e313b0887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.003815:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003817:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.003819:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.003862:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788877026.003964:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877026.004736:0:54994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb01ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54994:1875771532505728:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788877026.004754:0:54994:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x22f:0x0] 00000100:00100000:1.0:1788877026.004886:0:54994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54994:1875771532506112:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788877026.004936:0:54994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877026.004963:0:54994:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f62d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788877026.004978:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532505984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877026.005004:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877026.005049:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506112 00000100:00100000:1.0:1788877026.005055:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506112 00000100:00100000:1.0:1788877026.005092:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1788877026.005099:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:54994:x1875771532506112:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788877026.005134:0:43955:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00010000:00010000:3.0:1788877026.008176:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008194:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.008198:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.008204:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008221:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008233:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008241:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877026.008262:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532505984 00000100:00100000:3.0:1788877026.008270:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532505984 00000100:00100000:3.0:1788877026.008373:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1788877026.008382:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532505984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788877026.008402:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491900480 pending 896 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877026.008475:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532505984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (3470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877026.008482:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1788877026.008539:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532505984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788877026.008569:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877026.008580:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.008585:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008593:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.008597:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008631:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008646:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008654:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022702758/0xf5bf0f7e313b088e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008673:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.008675:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.008676:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.008764:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.008770:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008777:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.008780:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.008784:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008793:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008800:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008808:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008822:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877026.008828:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.008833:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008839:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.008843:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008850:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.008860:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009073:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afc4c290/0xf5bf0f7e313b0895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009086:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.009088:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.009090:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788877026.009130:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877026.009136:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009143:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.009146:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.009151:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009161:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009169:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009176:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877026.009310:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb01ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:54994:x1875771532506112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4211us (4373us total) trans 4294967570 rc 0/0 00000100:00100000:1.0:1788877026.009318:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00010000:00010000:3.0:1788877026.009322:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788877026.009354:0:54994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:54994:1875771532506112:0@lo:5:osp-pre-1-0.0 00002000:00010000:3.0:1788877026.009363:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1788877026.009367:0:54994:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00010000:00010000:3.0:1788877026.009367:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009375:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:3.0:1788877026.009378:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.009382:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009390:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009397:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.009403:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010058:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788877026.010066:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010081:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873a00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877026.010085:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010094:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010108:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010116:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6f6823e/0xf5bf0f7e313b089c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010131:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788877026.010135:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010141:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877026.010144:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010152:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010161:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.010169:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.010171:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.010172:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.015748:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788877026.015761:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022590aea/0xf5bf0f7e313b08a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.015998:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877026.017736:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788877026.018231:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788877026.018240:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018256:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:1.0:1788877026.018261:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788877026.018269:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018283:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018292:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018300:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018363:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788877026.018408:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788877026.018414:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018422:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:1.0:1788877026.018425:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788877026.018429:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018438:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018446:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018457:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018507:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788877026.018547:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788877026.018557:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018576:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:1.0:1788877026.018579:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788877026.018583:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018592:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018620:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.018629:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018827:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788877026.018834:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018843:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877026.018848:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018858:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018880:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018888:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539d46cc/0xf5bf0f7e313b08aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018905:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788877026.018909:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018916:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877026.018919:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018926:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018936:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018943:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137f9bd3/0xf5bf0f7e313b08b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018955:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788877026.018958:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018965:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae34000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877026.018968:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018976:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018985:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.018993:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877026.018994:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877026.018996:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877026.019954:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788877026.019965:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbb46f2/0xf5bf0f7e313b08b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.020074:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.020111:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788877026.020165:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.020171:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020181:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.020185:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.020189:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020200:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020214:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020221:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020288:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788877026.020330:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.020335:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020343:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.020346:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.020350:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020358:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020366:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020372:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020425:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788877026.020463:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.020468:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020476:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.020479:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.020483:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020492:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020500:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020506:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.020529:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788877026.020530:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788877026.020536:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020536:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.020544:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffc00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.020544:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877026.020549:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020549:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.020559:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020559:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020572:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020585:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037362ec8/0xf5bf0f7e313b08c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020626:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.020630:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020637:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefea00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.020639:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020646:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020656:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.020665:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.020666:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.020668:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.020781:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877026.020798:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057130b97/0xf5bf0f7e313b08bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.020929:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788877026.020934:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002953d37b/0xf5bf0f7e313b08cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788877026.020991:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.020996:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021004:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021008:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021012:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021020:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021028:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021034:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021088:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788877026.021127:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.021132:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021140:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021142:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021147:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021155:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021167:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021174:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021204:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788877026.021208:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021219:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877026.021223:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021231:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021244:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021251:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076dd6f93/0xf5bf0f7e313b08d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021266:0:6528:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788877026.021270:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021276:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877026.021280:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021294:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021304:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877026.021310:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877026.021312:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.021339:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877026.021396:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788877026.021401:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095be3c15/0xf5bf0f7e313b08db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788877026.021452:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.021458:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021466:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021469:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021473:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021481:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021489:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021501:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021509:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788877026.021540:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.021545:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021552:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021555:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021559:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021581:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021589:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021596:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021619:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788877026.021709:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.021715:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021723:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021735:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021740:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021749:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021757:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021765:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021774:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788877026.021922:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.021928:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021936:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.021939:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788877026.021943:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021952:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021965:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021972:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.021980:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788877026.022019:0:17045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788877026.022024:0:17045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.022031:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=2013s v=(0 0) 00010000:00010000:0.0:1788877026.022034:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877026.022036:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788877026.022037:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022041:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.022046:0:17045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022050:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.022054:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.022055:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.022063:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022064:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022075:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877026.022077:0:17045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788877026.022081:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000465f6f45/0xf5bf0f7e313b08e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022094:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788877026.022098:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022104:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe200 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.022106:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022113:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022122:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022129:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef491c6/0xf5bf0f7e313b08e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022140:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788877026.022143:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022149:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe400 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.022152:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022160:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022179:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022186:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071958b6b/0xf5bf0f7e313b08f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022197:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788877026.022200:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022207:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.022210:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022223:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022231:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022238:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae321ff4/0xf5bf0f7e313b08f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022259:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788877026.022263:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022270:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:3.0:1788877026.022273:0:10419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022281:0:10419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022292:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022299:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac19bab4/0xf5bf0f7e313b08fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877026.022316:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.022318:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877026.022320:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877026.023054:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877026.023163:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788877026.023430:0:17045:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:559 00000100:00100000:0.0:1788877026.023525:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:54992:x1875771532505856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73432us (73500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877026.023534:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1788877026.023724:0:54992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f4089180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54992:1875771532505856:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788877026.023752:0:54992:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0x22f:0x0] 00000100:00100000:0.0:1788877026.024013:0:54992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54992:1875771532506368:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788877026.024049:0:54992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877026.024105:0:54992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c3234a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788877026.024119:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532506240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877026.024144:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877026.024197:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506368 00000100:00100000:2.0:1788877026.024205:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506368 00000100:00100000:2.0:1788877026.024288:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1788877026.024298:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:54992:x1875771532506368:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788877026.024331:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506240 00002000:00080000:2.0:1788877026.024331:0:8456:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00000100:00100000:1.0:1788877026.024335:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506240 00000100:00100000:1.0:1788877026.025225:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1788877026.025234:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532506240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788877026.025248:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491645120 pending 896 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877026.025303:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532506240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877026.025310:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1788877026.025883:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532506240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788877026.026488:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:54992:x1875771532506368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2191us (2438us total) trans 8589934862 rc 0/0 00000100:00100000:2.0:1788877026.026496:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1788877026.026864:0:54992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:54992:1875771532506368:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788877026.026874:0:54992:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00000001:00100000:3.0:1788877026.282159:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000004:1.0:1788877026.471489:0:55312:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788877026.471765:0:55312:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788877026.603672:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788877027.541950:0:55362:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788877027.542190:0:55362:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788877027.625117:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877028.649341:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877029.678563:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877029.683016:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877029.683120:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316480 00000100:00100000:2.0:1788877029.683130:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316480 00000100:00100000:2.0:1788877029.683217:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2758 00000100:00100000:2.0:1788877029.683228:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41790:x1875771511316480:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1788877029.683246:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877029.683268:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b0905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a62 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683326:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683339:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683353:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877029.683400:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788877029.683404:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877029.683439:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683460:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b0905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a62 expref: 8 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683478:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a62 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877029.683486:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1500) 00010000:00010000:2.0:1788877029.683489:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788877029.683492:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40800, rc 0) 00000100:00100000:2.0:1788877029.684295:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41790:x1875771511316480:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1066us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877029.684304:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2758 00000100:00080000:1.0:1788877029.684364:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788877029.700560:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877029.701330:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316608 00000100:00100000:2.0:1788877029.701347:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316608 00000100:00100000:2.0:1788877029.701425:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2759 00000100:00100000:2.0:1788877029.701436:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41790:x1875771511316608:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788877029.701473:0:15659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788877029.701554:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13efecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:41790:x1875771511316608:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 120us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877029.701561:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2759 00000100:00100000:0.0:1788877029.715787:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877029.716760:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316736 00000100:00100000:1.0:1788877029.716780:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316736 00000100:00100000:1.0:1788877029.716860:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2760 00000100:00100000:1.0:1788877029.716871:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41790:x1875771511316736:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1788877029.716910:0:51736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877029.716984:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:41790:x1875771511316736:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 114us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877029.716993:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2760 00000100:00080000:3.0:1788877029.717005:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877029.732545:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877029.734674:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316864 00000100:00100000:3.0:1788877029.734699:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316864 00000100:00100000:3.0:1788877029.734866:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1194 00000100:00100000:3.0:1788877029.734887:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41790:x1875771511316864:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788877029.734935:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877029.735059:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41790:x1875771511316864:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 177us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877029.735072:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1194 00000100:00080000:1.0:1788877029.735577:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877029.738806:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877029.739161:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511316992 00000100:00100000:1.0:1788877029.739174:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511316992 00000100:00100000:1.0:1788877029.739261:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1195 00000100:00100000:1.0:1788877029.739273:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41790:x1875771511316992:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:1.0:1788877029.739303:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788877029.739398:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:41790:x1875771511316992:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 127us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877029.739406:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1195 00000100:00080000:3.0:1788877029.739576:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877029.865000:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532506496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788877029.865078:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877029.865256:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506496 00000100:00100000:3.0:1788877029.865264:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506496 00000100:00100000:3.0:1788877029.865360:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1788877029.865370:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532506496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877029.865390:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877029.865437:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532506496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877029.865444:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1788877029.865485:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532506496:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788877029.865740:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788877030.696958:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877030.889075:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532506880:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889180:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889237:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532507392:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889268:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889311:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889339:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889367:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788877030.889374:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532507008:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889422:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889443:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532507520:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889465:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889480:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532508032:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889500:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877030.889528:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506880 00000100:00100000:0.0:1788877030.889535:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506880 00000100:00100000:0.0:1788877030.889578:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507904 00000100:00100000:0.0:1788877030.889581:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507904 00000100:00100000:0.0:1788877030.889596:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788877030.889663:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532506880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889744:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532506880:12345-0@lo:400:kworker.0 Request processed in 84us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.889754:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788877030.889776:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788877030.889785:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889822:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532507904:12345-0@lo:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.889829:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788877030.889891:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532506880:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889901:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.889931:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507392 00000100:00100000:0.0:1788877030.889935:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507392 00000100:00100000:0.0:1788877030.889977:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507008 00000100:00100000:0.0:1788877030.889981:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507008 00000100:00100000:0.0:1788877030.890006:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1788877030.890012:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532507392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.890047:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532507392:12345-0@lo:400:kworker.0 Request processed in 35us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.890053:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1788877030.890065:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1788877030.890072:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532507008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.890108:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875771532507008:12345-0@lo:400:kworker.0 Request processed in 37us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.890115:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1788877030.890150:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875771532507008:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.890164:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532507392:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890404:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532506624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877030.890439:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890469:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532507136:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890490:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890507:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532507648:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890536:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890556:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532508160:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890575:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890593:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788877030.890631:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532506752:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890660:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890681:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532507264:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890701:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890732:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532507776:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890753:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890770:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532508288:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890800:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877030.890845:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507648 00000100:00100000:1.0:1788877030.890849:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507648 00000100:00100000:1.0:1788877030.890870:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507264 00000100:00100000:1.0:1788877030.890873:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507264 00000100:00100000:1.0:1788877030.890890:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507776 00000100:00100000:1.0:1788877030.890893:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507776 00000100:00100000:1.0:1788877030.890908:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508288 00000100:00100000:1.0:1788877030.890911:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508288 00000100:00100000:1.0:1788877030.890928:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788877030.890936:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532507648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.890985:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532507648:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877030.890993:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788877030.891008:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788877030.891014:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532507264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891039:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532507264:12345-0@lo:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877030.891044:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1788877030.891056:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788877030.891062:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532507776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891086:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532507776:12345-0@lo:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877030.891092:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788877030.891102:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1788877030.891109:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532508288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891144:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532508288:12345-0@lo:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877030.891151:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00080000:1.0:1788877030.891170:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788877030.891175:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877030.891223:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532507264:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891236:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532507776:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891249:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532508288:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.891258:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532507648:0@lo:400:kworker.0 00000100:00100000:3.0:1788877030.891573:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506752 00000100:00100000:3.0:1788877030.891577:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506752 00000100:00100000:3.0:1788877030.891646:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788877030.891653:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532506752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877030.891714:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532506752:12345-0@lo:400:kworker.0 Request processed in 50us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877030.891722:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788877030.891774:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788877030.891789:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532508416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877030.891831:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877030.891878:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892068:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507520 00000100:00100000:2.0:1788877030.892074:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507520 00000100:00100000:2.0:1788877030.892122:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508032 00000100:00100000:2.0:1788877030.892127:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508032 00000100:00100000:2.0:1788877030.892160:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532507136 00000100:00100000:2.0:1788877030.892165:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532507136 00000100:00100000:2.0:1788877030.892187:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508160 00000100:00100000:2.0:1788877030.892191:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508160 00000100:00100000:2.0:1788877030.892214:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:2.0:1788877030.892224:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892273:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532507520:12345-0@lo:400:kworker.0 Request processed in 51us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877030.892280:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:2.0:1788877030.892297:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1788877030.892305:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532508032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892341:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532508032:12345-0@lo:400:kworker.0 Request processed in 37us (2839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877030.892348:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1788877030.892362:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:2.0:1788877030.892369:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532507136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892410:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f41cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532507136:12345-0@lo:400:kworker.0 Request processed in 42us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877030.892417:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:2.0:1788877030.892431:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1788877030.892439:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532508160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892463:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532508160:12345-0@lo:400:kworker.0 Request processed in 26us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877030.892468:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00080000:2.0:1788877030.892498:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788877030.892501:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788877030.892529:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532507136:0@lo:400:kworker.0 00000100:00100000:2.0:1788877030.892539:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532508160:0@lo:400:kworker.0 00000100:00100000:0.0:1788877030.892635:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508416 00000100:00100000:0.0:1788877030.892639:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508416 00000100:00100000:0.0:1788877030.892675:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788877030.892683:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532508416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788877030.892723:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788877030.892915:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532508416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 233us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.892921:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1788877030.892944:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532506624 00000100:00100000:0.0:1788877030.892949:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532506624 00000100:00100000:0.0:1788877030.892977:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1788877030.892985:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532506624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788877030.893002:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788877030.893034:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7ae6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532506624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877030.893039:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1788877030.893070:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532508416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788877030.893398:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532506624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877030.893492:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532507520:0@lo:400:kworker.0 00000100:00100000:1.0:1788877030.893511:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532508032:0@lo:400:kworker.0 00000100:00100000:2.0:1788877031.089669:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877031.091592:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317248 00000100:00100000:1.0:1788877031.091617:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317248 00000100:00100000:1.0:1788877031.091762:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1982 00000100:00100000:1.0:1788877031.091781:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511317248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877031.091859:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511317248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877031.091870:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1982 00000100:00080000:3.0:1788877031.092029:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788877031.092397:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877031.092503:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877031.092548:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877031.092580:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877031.092636:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317504 00000100:00100000:0.0:1788877031.092637:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317632 00000100:00100000:2.0:1788877031.092642:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317504 00000100:00100000:3.0:1788877031.092650:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317120 00000100:00100000:0.0:1788877031.092655:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317632 00000100:00100000:3.0:1788877031.092664:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317120 00000100:00100000:2.0:1788877031.092719:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1526 00000100:00100000:2.0:1788877031.092732:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511317504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877031.092752:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:3.0:1788877031.092765:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511317120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877031.092780:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317376 00000100:00100000:2.0:1788877031.092780:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511317504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877031.092786:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317376 00000100:00100000:1.0:1788877031.092833:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1983 00000100:00100000:3.0:1788877031.092838:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511317120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877031.092849:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511317376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877031.092854:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1788877031.092914:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511317376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877031.092921:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1983 00000100:00080000:3.0:1788877031.092937:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877031.092944:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788877031.092948:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877031.093117:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1527 00000100:00100000:0.0:1788877031.093128:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511317632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877031.093165:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511317632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877031.093172:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1527 00000100:00100000:2.0:1788877031.093237:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1526 00000100:00100000:0.0:1788877031.402109:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532508544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877031.402207:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877031.402268:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508544 00000100:00100000:0.0:1788877031.402275:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508544 00000100:00100000:0.0:1788877031.402329:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1788877031.402337:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532508544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788877031.402364:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788877031.402404:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1875771532508544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877031.402422:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1788877031.402461:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532508544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788877031.405206:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788877031.405225:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532508672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788877031.405276:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877031.405316:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508672 00000100:00100000:2.0:1788877031.405321:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508672 00000100:00100000:2.0:1788877031.405358:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788877031.405365:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532508672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788877031.405393:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788877031.405443:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532508672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877031.405450:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1788877031.405487:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532508672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788877031.408830:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532508800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788877031.408888:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877031.408982:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508800 00000100:00100000:0.0:1788877031.408990:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508800 00000100:00100000:0.0:1788877031.409042:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1788877031.409051:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532508800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788877031.409077:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788877031.414466:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532508800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5407us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877031.414481:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788877031.420638:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532508800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788877031.724305:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788877031.916269:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934862 is committed 00000001:00080000:2.0:1788877031.916353:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967570 is committed 00010000:00010000:2.0:1788877032.749560:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877033.769628:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877034.792939:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877034.986643:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788877034.986667:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532508928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877034.986744:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877034.987116:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532508928 00000100:00100000:3.0:1788877034.987123:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532508928 00000100:00100000:3.0:1788877034.987183:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1788877034.987191:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532508928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877034.987222:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877034.987275:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532508928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877034.987282:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1788877034.987404:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532508928:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788877034.987552:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877035.816882:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877036.009727:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532509056:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.009791:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.009831:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532509568:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.009856:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.009874:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532510080:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.009906:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.009922:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532510592:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.009946:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.009966:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788877036.009972:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532509440:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.009995:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.010011:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532509952:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.010029:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.010044:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532510464:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.010942:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509056 00000100:00100000:2.0:1788877036.010953:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509056 00000100:00100000:2.0:1788877036.011005:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788877036.011016:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532509056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.011040:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.011080:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532509056:12345-0@lo:400:kworker.0 Request processed in 66us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011088:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788877036.011121:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532509312:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011150:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.011180:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532509184:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011207:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.011233:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532509056:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011244:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532509696:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.011267:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509568 00000100:00100000:0.0:1788877036.011272:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509568 00000100:00100000:2.0:1788877036.011282:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.011305:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510080 00000100:00100000:2.0:1788877036.011309:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532510208:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.011311:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510080 00000100:00100000:0.0:1788877036.011328:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510592 00000100:00100000:0.0:1788877036.011331:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510592 00000100:00100000:2.0:1788877036.011342:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.011347:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509952 00000100:00100000:0.0:1788877036.011350:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509952 00000100:00100000:0.0:1788877036.011366:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509312 00000100:00100000:2.0:1788877036.011367:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532510720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877036.011370:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509312 00000100:00100000:0.0:1788877036.011385:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509696 00000100:00100000:0.0:1788877036.011388:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509696 00000100:00100000:2.0:1788877036.011396:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.011407:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1788877036.011416:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532509568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011421:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788877036.011429:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532510848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788877036.011462:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532509568:12345-0@lo:400:kworker.0 Request processed in 47us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011463:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877036.011472:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1788877036.011489:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:0.0:1788877036.011497:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532510080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011509:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509440 00000100:00100000:2.0:1788877036.011514:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509440 00000100:00100000:0.0:1788877036.011528:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532510080:12345-0@lo:400:kworker.0 Request processed in 32us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.011535:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1788877036.011545:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510464 00000100:00100000:0.0:1788877036.011550:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:2.0:1788877036.011550:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510464 00000100:00100000:0.0:1788877036.011559:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532510592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011581:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788877036.011587:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532510592:12345-0@lo:400:kworker.0 Request processed in 29us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011592:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f402a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532509440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.011597:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1788877036.011633:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1788877036.011640:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532509952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011653:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f402a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532509440:12345-0@lo:400:kworker.0 Request processed in 63us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011661:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788877036.011676:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532509952:12345-0@lo:400:kworker.0 Request processed in 36us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011690:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1788877036.011699:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532510464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011730:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532510464:12345-0@lo:400:kworker.0 Request processed in 33us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011735:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1788877036.011756:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1788877036.011762:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011787:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532509312:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011793:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1788877036.011805:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1788877036.011811:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.011972:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532509696:12345-0@lo:400:kworker.0 Request processed in 161us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.011978:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1788877036.012007:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532509312:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012014:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532509824:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012035:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.012053:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532510336:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012071:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.012105:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509184 00000100:00100000:2.0:1788877036.012109:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509184 00000100:00100000:2.0:1788877036.012128:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510208 00000100:00100000:2.0:1788877036.012130:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510208 00000100:00100000:2.0:1788877036.012142:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510848 00000100:00100000:2.0:1788877036.012145:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510848 00000100:00100000:2.0:1788877036.012157:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1788877036.012162:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532509184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877036.012176:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1788877036.012188:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012195:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532509184:12345-0@lo:400:kworker.0 Request processed in 31us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.012202:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1788877036.012218:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1788877036.012225:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532510848:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788877036.012234:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532510208:12345-0@lo:400:kworker.0 Request processed in 48us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877036.012241:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1788877036.012263:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532509824 00000100:00100000:1.0:1788877036.012266:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532509824 00000100:00100000:1.0:1788877036.012290:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510336 00000004:00000024:2.0:1788877036.012291:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877036.012292:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510336 00000100:00100000:1.0:1788877036.012315:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1788877036.012323:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012334:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532510848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.012342:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1788877036.012364:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532509824:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.012367:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510720 00000100:00100000:2.0:1788877036.012373:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510720 00000100:00100000:1.0:1788877036.012375:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1788877036.012392:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:1.0:1788877036.012401:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532510336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012406:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1788877036.012415:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532510720:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877036.012430:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532510336:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00002000:00000024:2.0:1788877036.012434:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877036.012450:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1788877036.012470:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eef62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532510720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.012476:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1788877036.012512:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13ff5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532510848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788877036.012523:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532509184:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012532:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532509696:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012540:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532510208:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012551:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532510720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877036.012587:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532509824:0@lo:400:kworker.0 00000100:00100000:2.0:1788877036.012595:0:3665:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934862 gen 2 00000100:00100000:2.0:1788877036.012621:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532510336:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013671:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00080000:0.0:1788877036.013732:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788877036.013736:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788877036.013739:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788877036.013741:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788877036.013782:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532509440:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013806:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532509952:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013815:0:3663:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967570 gen 2 00000100:00100000:0.0:1788877036.013827:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532510464:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013838:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532509568:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013849:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532510080:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.013860:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532510592:0@lo:400:kworker.0 00000100:00100000:0.0:1788877036.218014:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877036.218050:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877036.218071:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877036.218092:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877036.218115:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877036.218139:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317760 00000100:00100000:0.0:1788877036.218147:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317760 00000100:00100000:0.0:1788877036.218192:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1788877036.218201:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511317760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877036.218918:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511317760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 715us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.218931:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1788877036.218971:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318016 00000100:00100000:0.0:1788877036.218975:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318016 00000100:00100000:0.0:1788877036.219012:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511317888 00000100:00100000:0.0:1788877036.219015:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511317888 00000100:00100000:0.0:1788877036.219038:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1990 00000100:00100000:0.0:1788877036.219046:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511318016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877036.219080:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511318016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.219086:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1990 00000100:00100000:0.0:1788877036.219097:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1991 00000100:00100000:0.0:1788877036.219102:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511317888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877036.219123:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+7:2398:x1875771511317888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.219129:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1991 00000100:00100000:0.0:1788877036.219147:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318272 00000100:00100000:0.0:1788877036.219151:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318272 00000100:00100000:0.0:1788877036.219175:0:43953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318144 00000100:00100000:0.0:1788877036.219178:0:43953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318144 00000100:00100000:0.0:1788877036.219198:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1532 00000100:00100000:0.0:1788877036.219204:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511318272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877036.219226:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511318272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.219232:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1532 00000100:00100000:0.0:1788877036.219242:0:43953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1533 00000100:00100000:0.0:1788877036.219248:0:43953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511318144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1788877036.220486:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877036.220492:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788877036.220494:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788877036.220496:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788877036.221000:0:43953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2398:x1875771511318144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1747us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877036.221008:0:43953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1533 00000001:02000400:2.0:1788877036.332505:0:55555:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1788877036.525137:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532510976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788877036.525215:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.525398:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532510976 00000100:00100000:2.0:1788877036.525405:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532510976 00000100:00100000:2.0:1788877036.525451:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1788877036.525460:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532510976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788877036.525484:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877036.525522:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532510976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.525528:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1788877036.525570:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532510976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788877036.525588:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788877036.525593:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532511104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788877036.525644:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.525668:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788877036.525706:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877036.525738:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511104 00000100:00100000:2.0:1788877036.525741:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511104 00000100:00100000:2.0:1788877036.525771:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788877036.525778:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532511104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788877036.525795:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788877036.525830:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532511104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.525836:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788877036.525856:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511232 00000100:00100000:2.0:1788877036.525860:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511232 00000100:00100000:2.0:1788877036.525885:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1788877036.525892:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532511232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788877036.525915:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788877036.525950:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532511232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877036.525955:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1788877036.525984:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532511104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788877036.526013:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788877036.840846:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877037.866792:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788877038.088214:0:55604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1788877038.889509:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877039.915182:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877039.986632:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877039.986897:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318400 00000100:00100000:2.0:1788877039.986906:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318400 00000100:00100000:2.0:1788877039.986974:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2761 00000100:00100000:2.0:1788877039.986986:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42258:x1875771511318400:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788877039.987021:0:51736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788877039.987088:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42258:x1875771511318400:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 106us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877039.987096:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2761 00000100:00080000:3.0:1788877039.990077:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788877039.993306:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877039.993411:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318528 00000100:00100000:2.0:1788877039.993420:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318528 00000100:00100000:2.0:1788877039.993491:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2762 00000100:00100000:2.0:1788877039.993505:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:42258:x1875771511318528:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788877039.993543:0:6540:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788877039.993645:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+6:42258:x1875771511318528:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877039.993654:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2762 00000100:00080000:3.0:1788877039.994129:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877039.996203:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877039.996467:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318656 00000100:00100000:2.0:1788877039.996476:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318656 00000100:00100000:2.0:1788877039.996579:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1204 00000100:00100000:2.0:1788877039.996589:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42258:x1875771511318656:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788877039.996638:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877039.996714:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42258:x1875771511318656:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 127us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877039.996722:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1204 00000100:00080000:3.0:1788877040.005748:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877040.010637:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877040.010764:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318784 00000100:00100000:2.0:1788877040.010774:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318784 00000100:00100000:2.0:1788877040.010900:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1205 00000100:00100000:2.0:1788877040.010912:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42258:x1875771511318784:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788877040.010945:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788877040.011010:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42258:x1875771511318784:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 101us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877040.011017:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1205 00000100:00080000:3.0:1788877040.014570:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788877040.092774:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877040.092858:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511318912 00000100:00100000:3.0:1788877040.092867:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511318912 00000100:00100000:3.0:1788877040.092938:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2763 00000100:00100000:3.0:1788877040.092947:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42276:x1875771511318912:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:3.0:1788877040.092965:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877040.092987:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a69 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093059:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093074:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093085:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093099:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093110:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093116:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093168:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093176:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093182:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093187:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877040.093191:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093199:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093209:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1500) 00010000:00010000:3.0:1788877040.093212:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877040.093217:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093222:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b091a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093235:0:15659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093242:0:15659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093248:0:15659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093253:0:15659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877040.093256:0:15659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093261:0:15659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093267:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xface03d5 (ffff8a13fae0b200) 00010000:00010000:3.0:1788877040.093269:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877040.093272:0:15659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093278:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b0921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xface03d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093306:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0913 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a69 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093315:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1500) 00010000:00010000:3.0:1788877040.093317:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877040.093321:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a69 expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877040.093334:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873800, rc 0) 00000100:00100000:3.0:1788877040.093597:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42276:x1875771511318912:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 650us (832us total) trans 0 rc 301/301 00000100:00100000:3.0:1788877040.093645:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2763 00000100:00100000:0.0:1788877040.106180:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788877040.106203:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788877040.106271:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877040.107940:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877040.108068:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319040 00000100:00100000:2.0:1788877040.108088:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319040 00000100:00100000:1.0:1788877040.108146:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511360 00000100:00100000:1.0:1788877040.108152:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511360 00000100:00100000:2.0:1788877040.108160:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2764 00000100:00100000:2.0:1788877040.108172:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42278:x1875771511319040:12345-192.168.203.11@tcp:101:checkstat.0 00010000:00010000:2.0:1788877040.108190:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788877040.108211:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00010000:00010000:2.0:1788877040.108211:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0928 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a70 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877040.108224:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532511360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788877040.108243:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00010000:00010000:2.0:1788877040.108279:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108294:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877040.108300:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532511360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877040.108310:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00010000:00010000:2.0:1788877040.108312:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108331:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108339:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108347:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788877040.108400:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877040.108454:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108463:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108470:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877040.108511:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x113:0x0]: returning size 0 00000004:00200000:2.0:1788877040.108514:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877040.108552:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108564:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108573:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108579:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108586:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108596:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877040.108643:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108653:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108674:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1500) 00010000:00010000:2.0:1788877040.108677:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877040.108683:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108689:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b092f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108702:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108709:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108715:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108720:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877040.108723:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108729:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108741:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13fa4adb00) 00010000:00010000:2.0:1788877040.108744:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877040.108747:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108753:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108784:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0928 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a70 expref: 9 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108799:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a70 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.108806:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13fa4adf00) 00010000:00010000:2.0:1788877040.108809:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788877040.108811:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40200, rc 0) 00000100:00100000:2.0:1788877040.108851:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42278:x1875771511319040:12345-192.168.203.11@tcp:101:checkstat.0 Request processed in 681us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877040.108858:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2764 00000100:00100000:0.0:1788877040.108972:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13cfcdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877040.128056:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877040.128275:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319296 00000100:00100000:2.0:1788877040.128284:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319296 00000100:00100000:2.0:1788877040.128346:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2765 00000100:00100000:2.0:1788877040.128366:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42280:x1875771511319296:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:2.0:1788877040.128421:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788877040.128447:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40200/0xf5bf0f7e313b093d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x113:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a70 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128473:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13fa4adf00) 00010000:00010000:2.0:1788877040.128491:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40800/0xf5bf0f7e313b090c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a62 expref: 7 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128500:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13c86a1500) 00010000:00010000:2.0:1788877040.128506:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788877040.128526:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128538:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128548:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128560:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128567:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128574:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128728:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128737:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128750:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128964:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128974:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128982:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128990:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.128996:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129004:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129023:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788877040.129043:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129049:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129056:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129062:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877040.129067:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129086:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129096:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:2.0:1788877040.129099:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788877040.129365:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788877040.129372:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129478:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129486:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41200/0xf5bf0f7e313b0952 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x113:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129502:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129509:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129516:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129522:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877040.129524:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129531:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129539:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adb00) 00010000:00010000:2.0:1788877040.129542:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877040.129545:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129551:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0944 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788877040.129563:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000300103bf reply state 000000009a6469d1 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129574:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877040.129581:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13fa4ad700) 00010000:00010000:2.0:1788877040.129583:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788877040.129586:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788877040.129689:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42280:x1875771511319296:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1325us (1651us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1788877040.129697:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2765 00010000:00010000:1.0:1788877040.133515:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:1.0:1788877040.133527:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877040.133546:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877040.133563:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x113:0x0].0x0 (ffff8a13fa4ad800) 00010000:00010000:1.0:1788877040.133566:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788877040.133571:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877040.133578:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0959 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x113:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877040.133731:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877040.133735:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877040.133737:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877040.936842:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877041.128828:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532511616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877041.129055:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877041.129117:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532511488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877041.129144:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.129324:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511616 00000100:00100000:2.0:1788877041.129332:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511616 00000100:00100000:2.0:1788877041.129400:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788877041.129411:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532511616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788877041.129440:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877041.129489:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532511616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.129496:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788877041.129521:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511488 00000100:00100000:2.0:1788877041.129524:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511488 00000100:00100000:2.0:1788877041.129550:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1788877041.129556:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532511488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788877041.129581:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788877041.129632:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532511488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.129639:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1788877041.129698:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532511616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877041.129711:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532511488:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788877041.129867:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788877041.130099:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511872:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130129:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130154:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532512384:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130188:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130220:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532512896:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130242:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130259:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788877041.130265:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130288:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130307:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532512512:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130327:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130341:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130359:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877041.130394:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511872 00000100:00100000:2.0:1788877041.130399:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511872 00000100:00100000:2.0:1788877041.130423:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1788877041.130430:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532511872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130465:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f45d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532511872:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.130472:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1788877041.130487:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512000 00000100:00100000:2.0:1788877041.130491:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512000 00000100:00100000:2.0:1788877041.130512:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512512 00000100:00100000:2.0:1788877041.130515:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512512 00000100:00100000:2.0:1788877041.130533:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513024 00000100:00100000:2.0:1788877041.130536:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513024 00000100:00100000:2.0:1788877041.130550:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1788877041.130556:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532512000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130583:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1875771532512000:12345-0@lo:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.130589:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:2.0:1788877041.130617:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1788877041.130624:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532512512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130650:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1875771532512512:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.130669:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1788877041.130680:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1788877041.130686:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532513024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130711:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1875771532513024:12345-0@lo:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.130716:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1788877041.130757:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532512000:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130767:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532512512:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130775:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1875771532513024:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.130783:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532511872:0@lo:400:kworker.0 00000100:00100000:1.0:1788877041.130959:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512384 00000100:00100000:1.0:1788877041.130964:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512384 00000100:00100000:1.0:1788877041.130995:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512896 00000100:00100000:1.0:1788877041.130999:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512896 00000100:00100000:1.0:1788877041.131020:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:1.0:1788877041.131026:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532512384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877041.131085:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532512384:12345-0@lo:400:kworker.0 Request processed in 58us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877041.131092:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:2.0:1788877041.131140:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532512384:0@lo:400:kworker.0 00000100:00100000:3.0:1788877041.131182:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877041.131229:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532512896:12345-0@lo:400:kworker.0 Request processed in 130us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.131278:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532512896:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131340:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532511744:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131384:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.131414:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532512256:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131437:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.131451:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532512768:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131477:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.131495:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788877041.131513:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532512128:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131533:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.131547:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532512640:0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.131564:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.131586:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512768 00000100:00100000:0.0:1788877041.131590:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512768 00000100:00100000:2.0:1788877041.132464:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532511744 00000100:00100000:2.0:1788877041.132470:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532511744 00000100:00100000:2.0:1788877041.132514:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788877041.132521:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132565:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532511744:12345-0@lo:400:kworker.0 Request processed in 45us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.132573:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788877041.132621:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512256 00000100:00100000:2.0:1788877041.132624:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512256 00000100:00100000:2.0:1788877041.132646:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512128 00000100:00100000:2.0:1788877041.132648:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512128 00000100:00100000:2.0:1788877041.132678:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532512640 00000100:00100000:2.0:1788877041.132681:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532512640 00000100:00100000:2.0:1788877041.132696:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1788877041.132702:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132732:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13cfcdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532512256:12345-0@lo:400:kworker.0 Request processed in 30us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.132739:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1788877041.132750:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1788877041.132755:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532512128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132780:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532512128:12345-0@lo:400:kworker.0 Request processed in 25us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.132789:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1788877041.132799:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1788877041.132805:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532512640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132841:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532512640:12345-0@lo:400:kworker.0 Request processed in 36us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.132848:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1788877041.132888:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532512128:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132899:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532512640:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132907:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532511744:0@lo:400:kworker.0 00000100:00100000:2.0:1788877041.132917:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532512256:0@lo:400:kworker.0 00000100:00100000:1.0:1788877041.135169:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1788877041.138118:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00080000:3.0:1788877041.138163:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877041.138169:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877041.138172:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788877041.138175:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788877041.141533:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1788877041.141555:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532512768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877041.141681:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532512768:12345-0@lo:400:kworker.0 Request processed in 138us (10201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877041.141689:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:3.0:1788877041.142632:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fa48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532512768:0@lo:400:kworker.0 00000100:00100000:1.0:1788877041.338675:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877041.338714:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877041.338737:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877041.338774:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877041.338800:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877041.338877:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319936 00000100:00100000:3.0:1788877041.338887:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319936 00000100:00100000:3.0:1788877041.338940:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319808 00000100:00100000:3.0:1788877041.338943:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319808 00000100:00100000:3.0:1788877041.338978:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1537 00000100:00100000:3.0:1788877041.338988:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877041.339055:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877041.339063:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1537 00000100:00100000:3.0:1788877041.339081:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1538 00000100:00100000:3.0:1788877041.339088:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319808:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877041.339112:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319808:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877041.339119:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1538 00000100:00080000:3.0:1788877041.339136:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788877041.341122:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319424 00000100:00100000:2.0:1788877041.341135:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319424 00000100:00100000:2.0:1788877041.341192:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1788877041.341201:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511319424:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877041.341260:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2395:x1875771511319424:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 61us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.341268:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1788877041.341302:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319680 00000100:00100000:2.0:1788877041.341306:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319680 00000100:00100000:2.0:1788877041.341340:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511319552 00000100:00100000:2.0:1788877041.341343:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511319552 00000100:00100000:2.0:1788877041.341363:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1998 00000100:00100000:2.0:1788877041.341370:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511319680:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877041.341401:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511319680:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.341408:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1998 00000100:00100000:2.0:1788877041.341421:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1999 00000100:00100000:2.0:1788877041.341427:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319552:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877041.341452:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2395:x1875771511319552:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877041.341458:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1999 00000100:00080000:2.0:1788877041.341570:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788877041.341574:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788877041.641716:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532513152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788877041.641784:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.641816:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788877041.641840:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.641862:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788877041.641868:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877041.641888:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877041.641919:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513152 00000100:00100000:0.0:1788877041.641925:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513152 00000100:00100000:0.0:1788877041.641969:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1788877041.641977:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532513152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788877041.642007:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788877041.642053:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532513152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877041.642060:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1788877041.642117:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532513152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788877041.643288:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513280 00000100:00100000:1.0:1788877041.643298:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513280 00000100:00100000:1.0:1788877041.643347:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513408 00000100:00100000:1.0:1788877041.643360:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513408 00000100:00100000:1.0:1788877041.643394:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1788877041.643402:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532513280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788877041.643426:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788877041.643458:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1788877041.643467:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788877041.643479:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877041.643481:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532513280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877041.643486:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1788877041.643531:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532513280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788877041.643598:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877041.643773:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877041.643826:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00010000:00010000:1.0:1788877041.965112:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877042.990001:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877044.011729:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877045.040001:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877045.227895:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788877045.227920:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532513536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877045.227989:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877045.228101:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513536 00000100:00100000:3.0:1788877045.228109:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513536 00000100:00100000:3.0:1788877045.228170:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788877045.228179:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532513536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877045.228206:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877045.228251:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532513536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877045.228258:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00080000:1.0:1788877045.228490:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788877045.228529:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532513536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788877046.057723:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877046.248800:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788877046.248824:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532513664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877046.248893:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.249072:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513664 00000100:00100000:1.0:1788877046.249079:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513664 00000100:00100000:1.0:1788877046.249133:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1788877046.249143:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532513664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788877046.249172:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877046.249226:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532513664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.249232:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00080000:1.0:1788877046.249252:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877046.249290:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532513664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877046.249369:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788877046.249380:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532513792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788877046.249430:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249563:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532513920:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249592:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249656:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532514432:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249715:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249736:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532514944:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249759:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249775:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788877046.249781:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249801:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249820:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532514816:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249841:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.249874:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514432 00000100:00100000:0.0:1788877046.249878:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514432 00000100:00100000:0.0:1788877046.249913:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514304 00000100:00100000:0.0:1788877046.249916:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514304 00000100:00100000:0.0:1788877046.249932:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514816 00000100:00100000:0.0:1788877046.249935:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514816 00000100:00100000:0.0:1788877046.249952:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1788877046.249958:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532514432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.249997:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532514432:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877046.250004:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:0.0:1788877046.250016:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1788877046.250022:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532514304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.250047:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532514304:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877046.250053:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1788877046.250064:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1788877046.250070:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532514816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.250096:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532514816:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877046.250102:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:0.0:1788877046.250128:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.250138:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532514816:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.250147:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532514432:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250298:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513792 00000100:00100000:1.0:1788877046.250303:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513792 00000100:00100000:1.0:1788877046.250335:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788877046.250343:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532513792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788877046.250364:0:6544:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877046.250402:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532513792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.250408:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788877046.250426:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532514176:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250451:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.250480:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532514688:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250502:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.250513:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532515200:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250533:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.250548:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788877046.250554:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532514048:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250576:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.250594:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532514560:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250659:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.250676:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532515072:0@lo:400:kworker.0 00000100:00080000:3.0:1788877046.250694:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788877046.250699:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788877046.250700:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877046.250734:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514048 00000100:00100000:3.0:1788877046.250736:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532513792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788877046.250739:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514048 00000100:00100000:1.0:1788877046.250771:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788877046.250773:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514176 00000100:00100000:1.0:1788877046.250778:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532514048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877046.250779:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514176 00000100:00100000:3.0:1788877046.250804:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514688 00000100:00100000:3.0:1788877046.250809:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514688 00000100:00100000:1.0:1788877046.250825:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532514048:12345-0@lo:400:kworker.0 Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877046.250833:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515200 00000100:00100000:1.0:1788877046.250834:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788877046.250839:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515200 00000100:00100000:3.0:1788877046.250861:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:3.0:1788877046.250869:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532514176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250870:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532514048:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.250929:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1875771532514176:0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.251556:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514944 00000100:00100000:0.0:1788877046.251561:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514944 00000100:00100000:2.0:1788877046.251676:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532513920 00000100:00100000:2.0:1788877046.251681:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532513920 00000100:00100000:2.0:1788877046.251712:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788877046.251719:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532513920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877046.253489:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1875771532514176:12345-0@lo:400:kworker.0 Request processed in 2617us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877046.253501:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:3.0:1788877046.253529:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:3.0:1788877046.253540:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532514688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.253576:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532514560 00000100:00100000:0.0:1788877046.253588:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532514560 00000100:00100000:1.0:1788877046.259607:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515072 00000100:00100000:1.0:1788877046.259621:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515072 00000100:00100000:1.0:1788877046.259703:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788877046.259714:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532514944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877046.259836:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788877046.259847:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532514560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877046.260489:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532513920:12345-0@lo:400:kworker.0 Request processed in 8767us (10893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877046.260500:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788877046.260543:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1788877046.260554:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532515200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877046.260593:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1875771532515200:12345-0@lo:400:kworker.0 Request processed in 43us (10059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877046.260618:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1788877046.260654:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1788877046.260662:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877046.260694:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532515072:12345-0@lo:400:kworker.0 Request processed in 34us (9995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877046.260701:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1788877046.260764:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532513920:0@lo:400:kworker.0 00000100:00080000:2.0:1788877046.260812:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788877046.260817:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788877046.260819:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788877046.261279:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1875771532514688:12345-0@lo:400:kworker.0 Request processed in 7741us (10774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877046.261288:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788877046.264068:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532514944:12345-0@lo:400:kworker.0 Request processed in 4348us (14299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.264081:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788877046.264140:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532515072:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.264153:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1875771532514688:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.264164:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1875771532515200:0@lo:400:kworker.0 00000100:00100000:2.0:1788877046.266213:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532514944:0@lo:400:kworker.0 00000001:00080000:2.0:1788877046.266791:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000100:00100000:0.0:1788877046.267329:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532514560:12345-0@lo:400:kworker.0 Request processed in 7481us (16666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877046.267343:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00010000:00010000:3.0:1788877046.267448:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267460:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267467:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267473:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877046.267478:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267486:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267504:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x47b8889d (ffff8a13fa4ad700) 00010000:00010000:3.0:1788877046.267507:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877046.267512:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877046.267518:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b094b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x47b8889d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877046.267856:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532514560:0@lo:400:kworker.0 00000100:00100000:1.0:1788877046.447017:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877046.447058:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877046.447091:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877046.447119:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877046.447143:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877046.447167:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320320 00000100:00100000:1.0:1788877046.447176:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320320 00000100:00100000:1.0:1788877046.447227:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320192 00000100:00100000:1.0:1788877046.447230:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320192 00000100:00100000:1.0:1788877046.447251:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2006 00000100:00100000:1.0:1788877046.447261:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511320320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877046.447324:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511320320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.447332:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2006 00000100:00100000:1.0:1788877046.447348:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2007 00000100:00100000:1.0:1788877046.447368:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511320192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877046.447391:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511320192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.447397:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2007 00000100:00100000:0.0:1788877046.447577:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320576 00000100:00100000:0.0:1788877046.447583:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320576 00000100:00100000:0.0:1788877046.447672:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320448 00000100:00100000:0.0:1788877046.447676:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320448 00000100:00100000:0.0:1788877046.447703:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1542 00000100:00100000:0.0:1788877046.447712:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511320576:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877046.447744:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1543 00000100:00100000:0.0:1788877046.447752:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511320576:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877046.447759:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511320448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877046.447766:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1542 00000100:00100000:3.0:1788877046.447807:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2397:x1875771511320448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 53us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877046.447815:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1543 00000100:00100000:2.0:1788877046.448163:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320064 00000100:00100000:2.0:1788877046.448168:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320064 00000100:00100000:2.0:1788877046.448205:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1788877046.448212:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f424a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511320064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877046.448267:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f424a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2397:x1875771511320064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 55us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877046.448275:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00080000:2.0:1788877046.448303:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788877046.448307:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788877046.448310:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788877046.448312:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877046.760860:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532515328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788877046.760931:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.761002:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515328 00000100:00100000:1.0:1788877046.761008:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515328 00000100:00100000:1.0:1788877046.761053:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788877046.761061:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532515328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788877046.761093:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788877046.761133:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532515328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.761140:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788877046.761184:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532515328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788877046.761197:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788877046.761203:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532515456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877046.761226:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877046.761252:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515456 00000100:00100000:1.0:1788877046.761255:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515456 00000100:00100000:1.0:1788877046.761281:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1788877046.761289:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532515456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788877046.761301:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788877046.761333:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532515456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877046.761339:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1788877046.761368:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532515456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877046.761536:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532515584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788877046.761561:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877046.761662:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515584 00000100:00100000:0.0:1788877046.761667:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515584 00000100:00100000:0.0:1788877046.761699:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:0.0:1788877046.761706:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532515584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788877046.761717:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:0.0:1788877046.761748:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532515584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877046.761754:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1788877046.761849:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532515584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788877047.080756:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788877047.403353:0:55800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 11: create open write rename |X| create-old-name read ========================================================== 10:17:26 (1788877046) 00000100:00100000:1.0:1788877047.482827:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877047.494947:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320704 00000100:00100000:2.0:1788877047.494963:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320704 00000100:00100000:2.0:1788877047.495043:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2766 00000100:00100000:2.0:1788877047.495053:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:42856:x1875771511320704:12345-192.168.203.11@tcp:101:mcreate.0 00010000:00010000:2.0:1788877047.495072:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877047.495094:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a77 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495153:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495166:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495179:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877047.495217:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788877047.495222:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877047.495243:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495265:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a77 expref: 8 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495280:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a77 expref: 7 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.495288:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad600) 00010000:00010000:2.0:1788877047.495291:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788877047.495294:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40a00, rc 0) 00000100:00100000:2.0:1788877047.495369:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42856:x1875771511320704:12345-192.168.203.11@tcp:101:mcreate.0 Request processed in 317us (12551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877047.495380:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2766 00000100:00100000:2.0:1788877047.509042:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.511838:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511320960 00000100:00100000:3.0:1788877047.511852:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511320960 00000100:00100000:3.0:1788877047.511920:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2767 00000100:00100000:3.0:1788877047.511930:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42856:x1875771511320960:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:3.0:1788877047.511981:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788877047.512004:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0967 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a77 expref: 7 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512019:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad600) 00010000:00010000:3.0:1788877047.512030:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788877047.512091:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512104:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512118:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512129:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512136:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512143:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512476:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512484:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512491:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512497:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877047.512502:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512510:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512519:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.512522:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877047.512526:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512533:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b096e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877047.512546:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a910ab1b reply state 0000000007e5dcfa transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512556:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.512562:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:3.0:1788877047.512565:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877047.512567:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788877047.512689:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42856:x1875771511320960:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 760us (3655us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1788877047.512696:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2767 00000100:00100000:1.0:1788877047.518931:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.519005:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321088 00000100:00100000:3.0:1788877047.519015:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321088 00000100:00100000:3.0:1788877047.519064:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2768 00000100:00100000:3.0:1788877047.519074:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42718:x1875771511321088:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1788877047.519097:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877047.519117:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b097c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a7e expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519177:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519192:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519208:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788877047.519245:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:3.0:1788877047.519249:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788877047.519283:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519307:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b097c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a7e expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519323:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a7e expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.519332:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:3.0:1788877047.519335:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788877047.519339:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872e00, rc 0) 00000100:00100000:3.0:1788877047.519396:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511321088:12345-192.168.203.11@tcp:101:bash.0 Request processed in 324us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877047.519404:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2768 00000100:00100000:1.0:1788877047.528913:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877047.528985:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321344 00000100:00100000:2.0:1788877047.528994:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321344 00000100:00100000:2.0:1788877047.529051:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2769 00000100:00100000:2.0:1788877047.529062:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511321344:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1788877047.529081:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877047.529084:0:51736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788877047.529108:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872e00/0xf5bf0f7e313b0983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a7e expref: 9 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529124:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0b000) 00010000:00010000:2.0:1788877047.529134:0:51736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788877047.529148:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b098a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a85 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529270:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529283:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529293:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529302:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529310:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529318:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529371:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529380:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529387:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877047.529396:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x115:0x0]: returning size 0 00000004:00080000:2.0:1788877047.529498:0:51736:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x230:0x0], count =210 00000004:00080000:2.0:1788877047.529506:0:51736:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x230:0x0]+210 in llog 00000004:00080000:2.0:1788877047.529565:0:51736:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x302:0x0], index 1: 0 00010000:00010000:2.0:1788877047.529689:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529697:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529705:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529711:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877047.529716:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529723:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529737:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fa4ad500) 00010000:00010000:2.0:1788877047.529739:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788877047.529743:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529748:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b099f lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529763:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529770:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529776:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529781:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877047.529784:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529789:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529796:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:2.0:1788877047.529799:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.529801:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529807:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529819:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529824:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529830:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529835:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877047.529838:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529844:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529850:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:2.0:1788877047.529852:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.529855:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529860:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0998 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529893:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b098a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a85 expref: 10 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529902:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad000) 00010000:00010000:2.0:1788877047.529904:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.529909:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b098a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a85 expref: 10 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.529920:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40400, rc 0) 00000100:00100000:2.0:1788877047.529969:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511321344:12345-192.168.203.11@tcp:101:bash.0 Request processed in 909us (1064us total) trans 94489280515 rc 301/301 00000100:00100000:2.0:1788877047.529977:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2769 00000100:00100000:2.0:1788877047.541263:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.541327:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321472 00000100:00100000:3.0:1788877047.541336:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321472 00000100:00100000:3.0:1788877047.541387:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2770 00000100:00100000:3.0:1788877047.541396:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511321472:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1788877047.541419:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877047.541439:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b09ad lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a8c expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541477:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541490:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541502:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541598:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873200/0xf5bf0f7e313b09ad lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 11 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541649:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 10 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.541658:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.541661:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788877047.541665:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873600, rc 0) 00000100:00100000:3.0:1788877047.541718:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42718:x1875771511321472:12345-192.168.203.11@tcp:101:bash.0 Request processed in 323us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877047.541725:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2770 00000100:00100000:1.0:1788877047.546837:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.548681:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321728 00000100:00100000:3.0:1788877047.548694:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321728 00000100:00100000:3.0:1788877047.548750:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2771 00000100:00100000:3.0:1788877047.548760:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42718:x1875771511321728:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1788877047.548972:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.548993:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.549005:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788877047.549046:0:8722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 94489280516 00000004:00010000:3.0:1788877047.549068:0:8722:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000275fb910 reply state 00000000aa5fee20 transno 94489280517 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.549081:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.549089:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.549092:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877047.549095:0:8722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788877047.549179:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+13:42718:x1875771511321728:12345-192.168.203.11@tcp:36:bash.0 Request processed in 421us (2351us total) trans 94489280517 rc 0/0 00000100:00100000:3.0:1788877047.549186:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2771 00000020:00080000:3.0:1788877047.549190:0:8722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788877047.554430:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877047.554500:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321856 00000100:00100000:1.0:1788877047.554509:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321856 00000100:00100000:1.0:1788877047.554560:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2772 00000100:00100000:1.0:1788877047.554571:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+13:42718:x1875771511321856:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1788877047.554671:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877047.554693:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313b09c2 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a93 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.554753:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313b09c2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a93 expref: 14 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.554767:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313b09c2 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a93 expref: 14 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.554786:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:1.0:1788877047.554789:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788877047.554793:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34400, rc 0) 00000100:00100000:1.0:1788877047.554840:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+14:42718:x1875771511321856:12345-192.168.203.11@tcp:101:bash.0 Request processed in 272us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877047.554847:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2772 00000100:00100000:1.0:1788877047.565876:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.565950:0:43959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511321984 00000100:00100000:3.0:1788877047.565959:0:43959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511321984 00000100:00100000:3.0:1788877047.566012:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 875 00000100:00100000:3.0:1788877047.566021:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42718:x1875771511321984:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1788877047.566037:0:43959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877047.566056:0:43959:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313b09c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048a9a expref: -99 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788877047.566082:0:43959:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877047.566101:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=2035s v=(0 0) 00010000:00010000:3.0:1788877047.566106:0:43959:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877047.566114:0:43959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313b09c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a9a expref: 9 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.566132:0:43959:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afc4c290/0xf5bf0f7e313b09c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a9a expref: 9 pid: 43959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.566144:0:43959:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873200, rc 0) 00000100:00100000:3.0:1788877047.566192:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511321984:12345-192.168.203.11@tcp:101:bash.0 Request processed in 172us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877047.566199:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 875 00000100:00100000:3.0:1788877047.568829:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877047.572931:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511322112 00000100:00100000:1.0:1788877047.572943:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511322112 00002000:00010000:1.0:1788877047.572983:0:8460:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/770 (0->18446744073709551615) 00002000:00100000:1.0:1788877047.572988:0:8460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13f0786a00 with x1875771511322112 ext(0->18446744073709551615) 00002000:00010000:1.0:1788877047.573001:0:8460:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a13f0786a00. 00000100:00100000:1.0:1788877047.573050:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 470 00000100:00100000:1.0:1788877047.573061:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511322112:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:1.0:1788877047.573220:0:8460:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788877047.573224:0:8460:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb mtime from disk: 0 -> 1788877048 00002000:00010000:1.0:1788877047.573227:0:8460:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788877047.573229:0:8460:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb ctime from disk: 0 -> 1788877048 00002000:00010000:1.0:1788877047.573232:0:8460:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x302:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788877047.573292:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+10:2395:x1875771511322112:12345-192.168.203.11@tcp:10:bash.0 Request processed in 232us (4469us total) trans 4294967571 rc 0/0 00000100:00100000:1.0:1788877047.573300:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 470 00002000:00010000:1.0:1788877047.573304:0:8460:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/770 (0->18446744073709551615) 00002000:00100000:1.0:1788877047.573307:0:8460:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13f0786a00 with x1875771511322112 ext(0->18446744073709551615) 00002000:00010000:1.0:1788877047.573311:0:8460:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a13f0786a00. 00000100:00100000:1.0:1788877047.578226:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877047.578392:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511322368 00000100:00100000:2.0:1788877047.578402:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511322368 00000100:00100000:2.0:1788877047.578445:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 743 00000100:00100000:2.0:1788877047.578455:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+14:42718:x1875771511322368:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1788877047.578754:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+15:42718:x1875771511322368:12345-192.168.203.11@tcp:35:bash.0 Request processed in 300us (536us total) trans 94489280518 rc 0/0 00000100:00100000:2.0:1788877047.578762:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 743 00000100:00100000:1.0:1788877047.603931:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877047.603970:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511322496 00000100:00100000:1.0:1788877047.603979:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511322496 00000100:00100000:1.0:1788877047.604037:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2773 00000100:00100000:1.0:1788877047.604047:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+15:42863:x1875771511322496:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:1.0:1788877047.604070:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877047.604093:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313b09d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048aa1 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604156:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604170:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604181:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788877047.604227:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:1.0:1788877047.604231:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788877047.604252:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604280:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34e00/0xf5bf0f7e313b09d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa1 expref: 17 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604299:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa1 expref: 16 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877047.604308:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:1.0:1788877047.604311:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788877047.604315:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae35600, rc 0) 00000100:00100000:1.0:1788877047.604377:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+16:42863:x1875771511322496:12345-192.168.203.11@tcp:101:mv.0 Request processed in 331us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877047.604384:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2773 00000100:00100000:3.0:1788877047.613177:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.613217:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511322624 00000100:00100000:3.0:1788877047.613226:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511322624 00000100:00100000:3.0:1788877047.613283:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2774 00000100:00100000:3.0:1788877047.613293:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+16:42863:x1875771511322624:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:3.0:1788877047.613312:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877047.613330:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b09de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048aa8 expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613405:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613420:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613436:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613447:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613455:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613463:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613550:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613560:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613568:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788877047.613640:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x115:0x0]: returning size 4 00000004:00200000:3.0:1788877047.613644:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788877047.613665:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613677:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613845:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613858:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613865:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613871:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877047.613876:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613884:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613897:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:3.0:1788877047.613901:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877047.613905:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613912:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872a00/0xf5bf0f7e313b09e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613924:0:8722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613930:0:8722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613937:0:8722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613943:0:8722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877047.613946:0:8722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613953:0:8722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613960:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:3.0:1788877047.613962:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877047.613966:0:8722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613972:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b09ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.613998:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b09de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa8 expref: 18 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.614012:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa8 expref: 17 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.614020:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.614022:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788877047.614025:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873c00, rc 0) 00000100:00100000:3.0:1788877047.614084:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+17:42863:x1875771511322624:12345-192.168.203.11@tcp:101:mv.0 Request processed in 792us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877047.614092:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2774 00000100:00100000:1.0:1788877047.626792:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877047.627047:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511322752 00000100:00100000:2.0:1788877047.627056:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511322752 00000100:00100000:2.0:1788877047.627113:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2775 00000100:00100000:2.0:1788877047.627122:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+17:42863:x1875771511322752:12345-192.168.203.11@tcp:101:mv.0 00010000:00010000:2.0:1788877047.627141:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877047.627160:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b09fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048aaf expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627216:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627229:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627242:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627255:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627263:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627270:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627321:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627329:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627347:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627354:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef40600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877047.627359:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627367:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627380:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:2.0:1788877047.627384:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.627388:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627396:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627406:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627413:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627419:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627424:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877047.627427:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627432:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627439:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0e48189 (ffff8a13fa4ad000) 00010000:00010000:2.0:1788877047.627441:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.627444:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627451:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41000/0xf5bf0f7e313b0a08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627479:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b09fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aaf expref: 18 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627495:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:2.0:1788877047.627498:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877047.627502:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b09fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aaf expref: 18 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877047.627511:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40400, rc 0) 00000100:00100000:2.0:1788877047.627569:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+17:42863:x1875771511322752:12345-192.168.203.11@tcp:101:mv.0 Request processed in 447us (784us total) trans 0 rc 301/301 00000100:00100000:2.0:1788877047.627577:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2775 00000100:00100000:3.0:1788877047.632924:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877047.632964:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323008 00000100:00100000:3.0:1788877047.632974:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323008 00000100:00100000:3.0:1788877047.633034:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1788877047.633046:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+17:42863:x1875771511323008:12345-192.168.203.11@tcp:36:mv.0 00010000:00010000:3.0:1788877047.633102:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788877047.633129:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b09f3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa8 expref: 17 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633145:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.633155:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35600/0xf5bf0f7e313b09d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aa1 expref: 16 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633165:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962e00) 00010000:00010000:3.0:1788877047.633174:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788877047.633199:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633211:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633221:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633232:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633239:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633246:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633258:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633266:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633273:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633379:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633390:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 15 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633398:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633432:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 15 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.633448:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 15 pid: 6541 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877047.633460:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6552:1875771532515712:192.168.203.11@tcp:104: 00000100:00100000:3.0:1788877047.633536:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c4b3ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877047.639227:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6552:1875771532515712:192.168.203.11@tcp:104: 00010000:00010000:2.0:1788877047.639255:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877047.639419:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877047.645169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323136 00000100:00100000:0.0:1788877047.645181:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323136 00010000:00010000:0.0:1788877047.645217:0:6525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 16 pid: 6541 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877047.645262:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:0.0:1788877047.645271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+16:2397:x1875771511323136:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788877047.645289:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788877047.645297:0:6525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 16 pid: 6541 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645309:0:6525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 16 pid: 6541 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645330:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873600/0xf5bf0f7e313b09b4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a8c expref: 16 pid: 6541 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645343:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:0.0:1788877047.645348:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645358:0:6525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645366:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877047.645397:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788877047.645450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+15:2397:x1875771511323136:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 179us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877047.645458:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 307 00010000:00010000:3.0:1788877047.645641:0:6552:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645651:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877047.645914:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0b8ec2f reply state 00000000ffa1356e transno 94489280519 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645928:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645935:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:3.0:1788877047.645937:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1788877047.645939:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:3.0:1788877047.645945:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0b8ec2f reply state 00000000ffa1356e transno 94489280519 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645953:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645958:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0e48189 (ffff8a13fae0b600) 00010000:00010000:3.0:1788877047.645961:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877047.645962:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1788877047.645967:0:6552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645973:0:6552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645980:0:6552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.645985:0:6552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877047.645990:0:6552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.646001:0:6552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.646010:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fae0be00) 00010000:00010000:3.0:1788877047.646013:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877047.646016:0:6552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.646022:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877047.646036:0:6552:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0b8ec2f reply state 00000000ffa1356e transno 94489280519 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.646045:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877047.646050:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:3.0:1788877047.646052:0:6552:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877047.646054:0:6552:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1788877047.646102:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+16:42863:x1875771511323008:12345-192.168.203.11@tcp:36:mv.0 Request processed in 13058us (13187us total) trans 94489280519 rc 0/0 00000100:00100000:3.0:1788877047.646109:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00010000:00010000:0.0:1788877048.104983:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788877048.540878:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:0.0:1788877048.540912:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540925:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540933:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540940:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877048.540945:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540954:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540972:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:0.0:1788877048.540976:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877048.540981:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.540988:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872400/0xf5bf0f7e313b0a16 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541001:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541007:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541011:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541016:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872200 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877048.541018:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541028:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541035:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0e48189 (ffff8a13fae0b600) 00010000:00010000:0.0:1788877048.541037:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877048.541040:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541045:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872200/0xf5bf0f7e313b0a1d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541061:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541066:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541072:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541076:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873e00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877048.541079:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541083:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541090:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:0.0:1788877048.541092:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788877048.541095:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.541102:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873e00/0xf5bf0f7e313b0a24 lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6552 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541161:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541169:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541175:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541180:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873800 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877048.541183:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541189:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541200:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13fae0b100) 00010000:00010000:1.0:1788877048.541202:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788877048.541205:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541211:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873800/0xf5bf0f7e313b0975 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541225:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,1 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541231:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 2/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541237:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541242:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873000 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877048.541245:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 3/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541251:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 4/0,0 mode: TXN/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541257:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:1.0:1788877048.541260:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788877048.541263:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 2/0,0 mode: --/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.541269:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873000/0xf5bf0f7e313b09bb lrc: 0/0,0 mode: --/TXN res: [0x200001b71:0x115:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788877048.541535:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967571 is committed 00000100:00100000:1.0:1788877048.627386:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877048.627461:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323264 00000100:00100000:0.0:1788877048.627470:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323264 00000100:00100000:0.0:1788877048.627538:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2776 00000100:00100000:0.0:1788877048.627548:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42872:x1875771511323264:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1788877048.627570:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877048.627591:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ab6 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627686:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627700:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627711:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788877048.627755:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:0.0:1788877048.627758:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788877048.627778:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627802:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ab6 expref: 9 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627817:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ab6 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877048.627825:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d364b500) 00010000:00010000:0.0:1788877048.627828:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788877048.627832:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe800, rc 0) 00000100:00100000:0.0:1788877048.627888:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42872:x1875771511323264:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 341us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877048.627895:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2776 00000100:00080000:1.0:1788877048.628047:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788877048.633738:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877048.633810:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323392 00000100:00100000:3.0:1788877048.633820:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323392 00000100:00100000:3.0:1788877048.633880:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2777 00000100:00100000:3.0:1788877048.633890:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42872:x1875771511323392:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:3.0:1788877048.633925:0:8722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788877048.633999:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42872:x1875771511323392:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 110us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877048.634006:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2777 00000100:00100000:0.0:1788877048.644758:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877048.648995:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323520 00000100:00100000:2.0:1788877048.649009:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323520 00000100:00100000:2.0:1788877048.649084:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2778 00000100:00100000:2.0:1788877048.649094:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:42872:x1875771511323520:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1788877048.649128:0:51736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:2.0:1788877048.649189:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:42872:x1875771511323520:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 98us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877048.649197:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2778 00000100:00080000:0.0:1788877048.649754:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877048.653256:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877048.653790:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323648 00000100:00100000:2.0:1788877048.653800:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323648 00000100:00100000:2.0:1788877048.659788:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1214 00000100:00100000:2.0:1788877048.659804:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42872:x1875771511323648:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:2.0:1788877048.659838:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:2.0:1788877048.659917:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42872:x1875771511323648:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 117us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877048.659925:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1214 00000100:00080000:0.0:1788877048.663732:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877048.665717:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877048.665895:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511323776 00000100:00100000:3.0:1788877048.665905:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511323776 00000100:00100000:3.0:1788877048.665972:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1215 00000100:00100000:3.0:1788877048.665983:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42872:x1875771511323776:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1788877048.666012:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877048.666071:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42872:x1875771511323776:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877048.666079:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1215 00000100:00080000:0.0:1788877048.666314:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877048.719017:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877048.719100:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324032 00000100:00100000:1.0:1788877048.719110:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324032 00000100:00100000:1.0:1788877048.719166:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2779 00000100:00100000:1.0:1788877048.719176:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42879:x1875771511324032:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00010000:1.0:1788877048.719230:0:6541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877048.719254:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ab6 expref: 8 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719271:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d364b500) 00010000:00010000:1.0:1788877048.719281:0:6541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788877048.719350:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719364:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719374:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719387:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719393:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719399:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719801:0:6541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719810:0:6541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719816:0:6541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719823:0:6541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35a00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:1.0:1788877048.719827:0:6541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719835:0:6541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719844:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13e7962c00) 00010000:00010000:1.0:1788877048.719846:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788877048.719850:0:6541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719856:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35a00/0xf5bf0f7e313b0a39 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788877048.719870:0:6541:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdbca56e reply state 00000000b74ab80a transno 94489280520 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719880:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877048.719886:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7962700) 00010000:00010000:1.0:1788877048.719889:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788877048.719892:0:6541:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788877048.719964:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42879:x1875771511324032:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 788us (955us total) trans 94489280520 rc 0/0 00000100:00100000:1.0:1788877048.719972:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2779 00000100:00100000:3.0:1788877048.757247:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877048.757726:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324160 00000100:00100000:2.0:1788877048.758442:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324160 00000100:00100000:2.0:1788877048.758503:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2780 00000100:00100000:2.0:1788877048.758512:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42882:x1875771511324160:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788877048.758533:0:8722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877048.758554:0:8722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048abd expref: -99 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758663:0:8722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758675:0:8722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758686:0:8722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877048.758723:0:8722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788877048.758727:0:8722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877048.758743:0:8722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758764:0:8722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40a00/0xf5bf0f7e313b0a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048abd expref: 11 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758782:0:8722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048abd expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.758790:0:8722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:2.0:1788877048.758792:0:8722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788877048.758796:0:8722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40c00, rc 0) 00000100:00100000:2.0:1788877048.758848:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42882:x1875771511324160:12345-192.168.203.11@tcp:101:rm.0 Request processed in 336us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877048.758855:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2780 00000100:00100000:0.0:1788877048.771342:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877048.771772:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324288 00000100:00100000:2.0:1788877048.771784:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324288 00000100:00100000:2.0:1788877048.771837:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2781 00000100:00100000:2.0:1788877048.771846:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42882:x1875771511324288:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:2.0:1788877048.771865:0:51736:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877048.771883:0:51736:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ac4 expref: -99 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771943:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771957:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771968:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771979:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771987:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.771993:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772076:0:51736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772085:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772092:0:51736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877048.772134:0:51736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x117:0x0]: returning size 0 00000004:00200000:2.0:1788877048.772138:0:51736:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877048.772156:0:51736:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772169:0:51736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772179:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772184:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772191:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772200:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877048.772204:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772212:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772224:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:2.0:1788877048.772227:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877048.772232:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772238:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41c00/0xf5bf0f7e313b0a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772247:0:51736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772253:0:51736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772259:0:51736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772264:0:51736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef41600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:2.0:1788877048.772267:0:51736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772272:0:51736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772284:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7962700) 00010000:00010000:2.0:1788877048.772286:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788877048.772290:0:51736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772296:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41600/0xf5bf0f7e313b0a63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 51736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772322:0:51736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40000/0xf5bf0f7e313b0a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ac4 expref: 12 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772337:0:51736:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ac4 expref: 11 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.772345:0:51736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x117:0x0].0x0 (ffff8a13fa4ad900) 00010000:00010000:2.0:1788877048.772347:0:51736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788877048.772350:0:51736:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41a00, rc 0) 00000100:00100000:2.0:1788877048.772407:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:42882:x1875771511324288:12345-192.168.203.11@tcp:101:rm.0 Request processed in 561us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877048.772414:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2781 00000100:00100000:2.0:1788877048.784313:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877048.784349:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324544 00000100:00100000:2.0:1788877048.784358:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324544 00000100:00100000:3.0:1788877048.791529:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2782 00000100:00100000:3.0:1788877048.791549:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+11:42882:x1875771511324544:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1788877048.791682:0:6540:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788877048.791708:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41a00/0xf5bf0f7e313b0a6a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x117:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ac4 expref: 11 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791725:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x117:0x0].0x0 (ffff8a13fa4ad900) 00010000:00010000:3.0:1788877048.791741:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40c00/0xf5bf0f7e313b0a4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048abd expref: 10 pid: 8722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791750:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ada00) 00010000:00010000:3.0:1788877048.791755:0:6540:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788877048.791778:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791790:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791800:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791811:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791819:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791826:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791909:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791917:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.791924:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792097:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792105:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792112:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792124:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792130:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792136:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792152:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788877048.792168:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792174:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792179:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792184:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877048.792188:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792194:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792202:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x117:0x0].0x0 (ffff8a13d355c400) 00010000:00010000:3.0:1788877048.792205:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788877048.792208:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792218:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0a7f lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x117:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792230:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792237:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792243:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792247:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877048.792250:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792255:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792260:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d355cf00) 00010000:00010000:3.0:1788877048.792263:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877048.792265:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792270:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0a71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877048.792282:0:6540:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b00e45b reply state 0000000083179fad transno 94489280521 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792291:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877048.792297:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7962700) 00010000:00010000:3.0:1788877048.792299:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877048.792301:0:6540:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788877048.794661:0:6527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788877048.794674:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.794684:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:2.0:1788877048.794689:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.794698:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.794713:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x117:0x0].0x0 (ffff8a13d355c400) 00010000:00010000:2.0:1788877048.794716:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788877048.794721:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.794727:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872000/0xf5bf0f7e313b0a86 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x117:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877048.794760:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877048.794762:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877048.794763:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877048.796212:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+11:42882:x1875771511324544:12345-192.168.203.11@tcp:36:rm.0 Request processed in 825us (8061us total) trans 94489280521 rc 0/0 00000100:00100000:3.0:1788877048.796225:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2782 00010000:00010000:2.0:1788877049.130833:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877050.154807:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877050.344780:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532515840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877050.344850:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877050.345065:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515840 00000100:00100000:2.0:1788877050.345073:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515840 00000100:00100000:2.0:1788877050.345139:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788877050.345149:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532515840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788877050.345176:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788877050.345328:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877050.357083:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532515840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11929us (12225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877050.357097:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1788877050.358361:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532515840:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788877051.178827:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877051.369749:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788877051.369771:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532515968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788877051.369835:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877051.369893:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532515968 00000100:00100000:1.0:1788877051.369899:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532515968 00000100:00100000:1.0:1788877051.369940:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1788877051.369948:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532515968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788877051.369978:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877051.370021:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532515968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.370029:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1788877051.370070:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532515968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788877051.370463:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788877051.370475:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532516096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877051.370554:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.370655:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516096 00000100:00100000:3.0:1788877051.370661:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516096 00000100:00100000:3.0:1788877051.370701:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1788877051.370711:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532516096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877051.370737:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877051.370779:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532516096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.370789:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1788877051.370803:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532516224:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.370817:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532516608:0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.370845:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.370858:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877051.370873:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532516736:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.370887:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532517120:0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.370902:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.370925:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516608 00000100:00100000:3.0:1788877051.370930:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516608 00000100:00100000:2.0:1788877051.370936:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532517248:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.370960:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516736 00000100:00100000:2.0:1788877051.370966:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.370966:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516736 00000100:00100000:2.0:1788877051.370993:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788877051.370994:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1788877051.371003:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532516352:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371007:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532516608:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788877051.371025:0:8722:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0787100 x1875771532516608/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877051.371035:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877051.371053:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532516864:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371076:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1875771532516608:12345-0@lo:400:kworker.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.371085:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.371089:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:3.0:1788877051.371105:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1788877051.371111:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532517376:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371115:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532516736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.371140:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.371155:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532516736:12345-0@lo:400:kworker.0 Request processed in 42us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.371164:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1788877051.371174:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532516736:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371186:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877051.371207:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516224 00000100:00100000:3.0:1788877051.371220:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1875771532516608:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371230:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788877051.371236:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532516480:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371257:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.371277:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532516992:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371298:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.371312:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532517504:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371349:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.371369:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517120 00000100:00100000:3.0:1788877051.371372:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517120 00000100:00100000:3.0:1788877051.371393:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516480 00000100:00100000:3.0:1788877051.371396:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516480 00000100:00100000:3.0:1788877051.371405:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516992 00000100:00100000:3.0:1788877051.371408:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516992 00000100:00100000:3.0:1788877051.371419:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517504 00000100:00100000:3.0:1788877051.371421:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517504 00000100:00100000:3.0:1788877051.371432:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1788877051.371438:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532517120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371484:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1875771532517120:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.371490:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1788877051.371503:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1788877051.371509:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532516480:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788877051.371520:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0786680 x1875771532516480/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877051.371531:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516224 00000100:00100000:3.0:1788877051.371547:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532516480:12345-0@lo:400:kworker.0 Request processed in 39us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.371554:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1788877051.371568:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788877051.371573:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1788877051.371580:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f4248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532516224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.371586:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532516992:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788877051.371633:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0784a80 x1875771532516992/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877051.371662:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f4248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532516224:12345-0@lo:400:kworker.0 Request processed in 83us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.371672:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788877051.371672:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532516992:12345-0@lo:400:kworker.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.371684:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:3.0:1788877051.371699:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:3.0:1788877051.371705:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532517504:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788877051.371715:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0785c00 x1875771532517504/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877051.371739:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532517504:12345-0@lo:400:kworker.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.371748:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:3.0:1788877051.371775:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517248 00000100:00100000:2.0:1788877051.371777:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516864 00000100:00100000:3.0:1788877051.371779:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517248 00000100:00100000:2.0:1788877051.371783:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516864 00000100:00100000:3.0:1788877051.371811:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517376 00000100:00100000:3.0:1788877051.371816:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517376 00000100:00100000:1.0:1788877051.371856:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532516352 00000100:00100000:1.0:1788877051.371862:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532516352 00000100:00100000:1.0:1788877051.371887:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1788877051.371894:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532516352:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788877051.371912:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fa48e680 x1875771532516352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788877051.371935:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788877051.371943:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788877051.371946:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788877051.371949:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877051.371955:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532516352:12345-0@lo:400:kworker.0 Request processed in 60us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.371962:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788877051.377964:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532516352:0@lo:400:kworker.0 00000100:00100000:0.0:1788877051.377983:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532516224:0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.380836:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:2.0:1788877051.380856:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532517248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.380946:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532517248:12345-0@lo:400:kworker.0 Request processed in 99us (9980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.380954:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:2.0:1788877051.380974:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1788877051.380981:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532516864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.381009:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fa48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532516864:12345-0@lo:400:kworker.0 Request processed in 29us (9927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.381015:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1788877051.381027:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:2.0:1788877051.381033:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532517376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.381058:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532517376:12345-0@lo:400:kworker.0 Request processed in 26us (9920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.381064:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:2.0:1788877051.381108:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532516864:0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.381120:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532517376:0@lo:400:kworker.0 00000100:00100000:2.0:1788877051.381130:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532517248:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.384948:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532516480:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.384965:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532516992:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.384976:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13efecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532517504:0@lo:400:kworker.0 00000100:00100000:3.0:1788877051.384987:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1875771532517120:0@lo:400:kworker.0 00000100:00100000:0.0:1788877051.385551:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532516096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877051.567082:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877051.567120:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877051.567148:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877051.567166:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877051.567186:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877051.567212:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325056 00000100:00100000:1.0:1788877051.567221:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325056 00000100:00100000:1.0:1788877051.567269:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325184 00000100:00100000:1.0:1788877051.567272:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325184 00000100:00100000:1.0:1788877051.567293:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1547 00000100:00100000:1.0:1788877051.567302:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511325056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877051.567364:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+8:2396:x1875771511325056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 62us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.567371:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1547 00000100:00100000:1.0:1788877051.567386:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1548 00000100:00100000:1.0:1788877051.567392:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511325184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877051.567414:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511325184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.567421:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1548 00000100:00100000:1.0:1788877051.567436:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324672 00000100:00100000:1.0:1788877051.567439:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324672 00000100:00100000:1.0:1788877051.567461:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788877051.567467:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511324672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877051.567489:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2396:x1875771511324672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.567495:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:1.0:1788877051.567518:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324800 00000100:00100000:1.0:1788877051.567521:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324800 00000100:00100000:1.0:1788877051.567546:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324928 00000100:00100000:1.0:1788877051.567548:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324928 00000100:00100000:1.0:1788877051.567567:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2014 00000100:00100000:1.0:1788877051.567573:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511324800:12345-192.168.203.11@tcp:400:kworker.0 00010000:00000080:1.0:1788877051.567629:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac23480 x1875771511324800/t0(0) o400->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:447/0 lens 224/224 e 0 to 0 dl 1788877062 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788877051.567654:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511324800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.567661:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2014 00000100:00100000:1.0:1788877051.567673:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2015 00000100:00100000:1.0:1788877051.567679:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511324928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877051.567701:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511324928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877051.567706:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2015 00000100:00080000:1.0:1788877051.567724:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788877051.567727:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788877051.567730:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788877051.567732:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877051.884505:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532517632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788877051.884576:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.884657:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517632 00000100:00100000:3.0:1788877051.884665:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517632 00000100:00100000:3.0:1788877051.884751:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1788877051.884759:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532517632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788877051.884781:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788877051.884823:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532517632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.884830:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1788877051.884887:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532517632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788877051.886434:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788877051.886449:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788877051.886494:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877051.888188:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517760 00000100:00100000:3.0:1788877051.888198:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517760 00000100:00100000:3.0:1788877051.888258:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1788877051.888268:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532517760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788877051.888293:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:3.0:1788877051.888362:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1875771532517760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877051.888369:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1788877051.888415:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788877051.891052:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788877051.894723:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532517888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788877051.894797:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877051.899752:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532517888 00000100:00100000:2.0:1788877051.899767:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532517888 00000100:00100000:2.0:1788877051.899828:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1788877051.899838:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532517888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788877051.899872:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:2.0:1788877051.899888:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13c79a9180 x1875771532517888/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:447/0 lens 224/368 e 0 to 0 dl 1788877062 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877051.899961:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1875771532517888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877051.899970:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788877051.904460:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532517888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788877052.205747:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877052.590993:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877052.591029:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877052.591086:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325440 00000100:00100000:1.0:1788877052.591095:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325440 00000100:00100000:1.0:1788877052.591149:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 876 00000100:00100000:1.0:1788877052.591159:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511325440:12345-192.168.203.11@tcp:16:kworker.0 00000100:00100000:1.0:1788877052.591247:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511325440:12345-192.168.203.11@tcp:16:kworker.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877052.591254:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 876 00000100:00100000:2.0:1788877052.591568:0:42778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325312 00000100:00100000:2.0:1788877052.591572:0:42778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325312 00002000:00100000:2.0:1788877052.591629:0:42778:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x302:0x0] (0->3) req@ffff8a13f0787480 x1875771511325312/t0(0) o4->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:448/0 lens 496/0 e 0 to 0 dl 1788877063 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788877052.591641:0:42778:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13f0787480 with x1875771511325312 ext(0->3) 00002000:00010000:2.0:1788877052.591647:0:42778:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a13f0787480 00000100:00100000:2.0:1788877052.591665:0:42778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 471 00000100:00100000:2.0:1788877052.591673:0:42778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511325312:12345-192.168.203.11@tcp:4:bash.0 00000100:00100000:2.0:1788877052.592487:0:42778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2396:x1875771511325312:12345-192.168.203.11@tcp:4:bash.0 Request processed in 811us (1500us total) trans 4294967572 rc 0/0 00000100:00100000:2.0:1788877052.592496:0:42778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 471 00002000:00100000:2.0:1788877052.592502:0:42778:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x302:0x0] (0->3) req@ffff8a13f0787480 x1875771511325312/t4294967572(0) o4->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:448/0 lens 496/448 e 0 to 0 dl 1788877063 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788877052.592511:0:42778:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13f0787480 with x1875771511325312 ext(0->3) 00002000:00010000:2.0:1788877052.592515:0:42778:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a13f0787480 00010000:00010000:2.0:1788877053.227524:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877054.248708:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788877054.936910:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280521 is committed 00010000:00010000:3.0:1788877054.938414:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938431:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938440:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938446:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35400 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877054.938451:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938459:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938476:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7962700) 00010000:00010000:3.0:1788877054.938479:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877054.938484:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938491:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae35400/0xf5bf0f7e313b0a40 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938510:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938516:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938521:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938527:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7873c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877054.938530:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938535:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938543:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24ffe991 (ffff8a13e7962700) 00010000:00010000:3.0:1788877054.938545:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877054.938559:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877054.938567:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a78 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24ffe991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877055.283411:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877055.466150:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788877055.466174:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532518016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788877055.466259:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877055.466435:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518016 00000100:00100000:3.0:1788877055.466447:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518016 00000100:00080000:2.0:1788877055.466525:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877055.468666:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1788877055.468684:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532518016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877055.468726:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788877055.468805:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532518016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877055.468813:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1788877055.476046:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532518016:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788877056.003905:0:56195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1788877056.086295:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877056.086366:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325568 00000100:00100000:2.0:1788877056.086375:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325568 00000100:00100000:2.0:1788877056.086447:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2783 00000100:00100000:2.0:1788877056.086457:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+7:42718:x1875771511325568:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1788877056.086476:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877056.086498:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048acb expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086560:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086573:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086626:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877056.086671:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788877056.086675:0:15659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877056.086694:0:15659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086718:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048acb expref: 9 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086732:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048acb expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.086740:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:2.0:1788877056.086743:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788877056.086746:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41400, rc 0) 00010000:00000080:2.0:1788877056.086755:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13c79a9c00 x1875771511325568/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 576/688 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788877056.086811:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42718:x1875771511325568:12345-192.168.203.11@tcp:101:bash.0 Request processed in 357us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877056.086819:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2783 00000100:00080000:3.0:1788877056.088741:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788877056.093935:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877056.093968:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325824 00000100:00100000:3.0:1788877056.093978:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325824 00000100:00100000:3.0:1788877056.094028:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2784 00000100:00100000:3.0:1788877056.094037:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1400589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42718:x1875771511325824:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1788877056.094056:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877056.094059:0:6539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788877056.094084:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef41400/0xf5bf0f7e313b0a94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048acb expref: 8 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094099:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4adc00) 00010000:00010000:3.0:1788877056.094110:0:6539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788877056.094124:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ad2 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094228:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094241:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094251:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094263:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094275:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094281:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788877056.094558:0:6539:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x230:0x0], count =210 00000004:00080000:3.0:1788877056.094565:0:6539:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x230:0x0]+210 in llog 00000004:00080000:3.0:1788877056.094575:0:6539:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x302:0x0], index 0: 0 00010000:00010000:3.0:1788877056.094745:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0ab0 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x118:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094755:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094763:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0ab0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094794:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094801:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094809:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094816:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:3.0:1788877056.094820:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094832:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094841:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13d355cc00) 00010000:00010000:3.0:1788877056.094844:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788877056.094847:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094853:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872600/0xf5bf0f7e313b0aa2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788877056.094863:0:6539:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc17bf65 reply state 000000001f215c57 transno 94489280522 ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094874:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094880:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13d355c800) 00010000:00010000:3.0:1788877056.094883:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788877056.094885:0:6539:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788877056.094906:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873c00/0xf5bf0f7e313b0a9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ad2 expref: 10 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094925:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0ab0 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ad2 expref: 9 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.094933:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x118:0x0].0x0 (ffff8a13d355cf00) 00010000:00010000:3.0:1788877056.094935:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788877056.094938:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873400, rc 0) 00010000:00000080:3.0:1788877056.094945:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a1400589c50 x1875771511325824/t94489280522(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 664/664 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788877056.095001:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1400589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42718:x1875771511325824:12345-192.168.203.11@tcp:101:bash.0 Request processed in 965us (1076us total) trans 94489280522 rc 0/0 00000100:00100000:3.0:1788877056.095009:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2784 00000100:00100000:2.0:1788877056.109794:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877056.109883:0:43958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511325952 00000100:00100000:3.0:1788877056.109892:0:43958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511325952 00000100:00100000:3.0:1788877056.109960:0:43958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 877 00000100:00100000:3.0:1788877056.109971:0:43958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+8:42718:x1875771511325952:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1788877056.109987:0:43958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877056.110007:0:43958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0abe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ad9 expref: -99 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788877056.110030:0:43958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788877056.110051:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=2044s v=(0 0) 00010000:00010000:3.0:1788877056.110055:0:43958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x302:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788877056.110065:0:43958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ad9 expref: 9 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.110083:0:43958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e6a91f2/0xf5bf0f7e313b0abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ad9 expref: 9 pid: 43958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877056.110094:0:43958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872a00, rc 0) 00000100:00100000:3.0:1788877056.110147:0:43958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f0204769-56bd-4f5c-ab97-74c450c9e072+9:42718:x1875771511325952:12345-192.168.203.11@tcp:101:bash.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877056.110154:0:43958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 877 00000100:00080000:2.0:1788877056.110329:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877056.114106:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877056.114755:0:43649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511326208 00000100:00100000:2.0:1788877056.114765:0:43649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511326208 00000100:00100000:2.0:1788877056.114823:0:43649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 744 00000100:00100000:2.0:1788877056.114833:0:43649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+10:42718:x1875771511326208:12345-192.168.203.11@tcp:35:bash.0 00010000:00000080:2.0:1788877056.115063:0:43649:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0787b80 x1875771511326208/t94489280523(0) o35->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 392/456 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788877056.115134:0:43649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:42718:x1875771511326208:12345-192.168.203.11@tcp:35:bash.0 Request processed in 302us (1036us total) trans 94489280523 rc 0/0 00000100:00100000:2.0:1788877056.115142:0:43649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 744 00000100:00100000:0.0:1788877056.129883:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877056.130097:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511326336 00000100:00100000:2.0:1788877056.130108:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511326336 00000100:00100000:2.0:1788877056.130173:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2785 00000100:00100000:2.0:1788877056.130183:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+11:42950:x1875771511326336:12345-192.168.203.11@tcp:101:grep.0 00010000:00010000:2.0:1788877056.130205:0:6541:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877056.130227:0:6541:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ae0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.130289:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.130323:0:6541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.130337:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788877056.130377:0:6541:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 20480 00000004:00200000:2.0:1788877056.130381:0:6541:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788877056.130417:0:6541:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6541 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.130559:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40600/0xf5bf0f7e313b0ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae0 expref: 13 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.136439:0:6541:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae0 expref: 12 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877056.136455:0:6541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:2.0:1788877056.136458:0:6541:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788877056.136462:0:6541:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40400, rc 0) 00010000:00000080:2.0:1788877056.136470:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13c79a9f80 x1875771511326336/t0(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 576/688 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'grep.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788877056.136545:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+12:42950:x1875771511326336:12345-192.168.203.11@tcp:101:grep.0 Request processed in 6363us (6671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877056.136554:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2785 00000100:00100000:3.0:1788877056.144041:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877056.144120:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511326592 00000100:00100000:0.0:1788877056.144129:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511326592 00000100:00100000:0.0:1788877056.144185:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2786 00000100:00100000:0.0:1788877056.144195:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+12:42950:x1875771511326592:12345-192.168.203.11@tcp:101:grep.0 00010000:00010000:0.0:1788877056.144214:0:15659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877056.144233:0:15659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0ad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048ae7 expref: -99 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.144349:0:15659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefea00/0xf5bf0f7e313b0ada lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x118:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.144363:0:15659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefea00/0xf5bf0f7e313b0ada lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x118:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.144376:0:15659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefea00/0xf5bf0f7e313b0ada lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x118:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788877056.144387:0:15659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x118:0x0]: returning size 4 00010000:00010000:0.0:1788877056.144501:0:15659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae7 expref: 15 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.144521:0:15659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefea00/0xf5bf0f7e313b0ada lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x118:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae7 expref: 14 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.144528:0:15659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x118:0x0].0x0 (ffff8a13d355cf00) 00010000:00010000:0.0:1788877056.144531:0:15659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788877056.144535:0:15659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefea00, rc 0) 00010000:00000080:0.0:1788877056.144542:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13f0785500 x1875771511326592/t94489280524(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 648/664 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'grep.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788877056.144634:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f0204769-56bd-4f5c-ab97-74c450c9e072+14:42950:x1875771511326592:12345-192.168.203.11@tcp:101:grep.0 Request processed in 440us (602us total) trans 94489280524 rc 0/0 00000100:00100000:0.0:1788877056.144641:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2786 00000100:00100000:0.0:1788877056.175792:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877056.175826:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511326848 00000100:00100000:0.0:1788877056.175835:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511326848 00000100:00100000:0.0:1788877056.175884:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2787 00000100:00100000:0.0:1788877056.175893:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+14:42951:x1875771511326848:12345-192.168.203.11@tcp:101:grep.0 00010000:00010000:0.0:1788877056.175914:0:6539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877056.175932:0:6539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048aee expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.175999:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176013:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176030:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176045:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176053:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176060:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176179:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313b0afd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176189:0:6539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313b0afd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176197:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313b0afd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788877056.176207:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x115:0x0]: returning size 4 00010000:00010000:0.0:1788877056.176275:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176284:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176291:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176297:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeffa00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877056.176302:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176310:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176322:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a13fa4ad300) 00010000:00010000:0.0:1788877056.176325:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877056.176330:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176337:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeffa00/0xf5bf0f7e313b0aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176347:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176354:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176360:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176365:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff600 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877056.176369:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176375:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176382:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0e48189 (ffff8a13d5606400) 00010000:00010000:0.0:1788877056.176384:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877056.176387:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.176393:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff600/0xf5bf0f7e313b0af6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0e48189 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.177757:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefe800/0xf5bf0f7e313b0ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aee expref: 17 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.177774:0:6539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313b0afd lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aee expref: 16 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877056.177784:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x115:0x0].0x0 (ffff8a13fae0b900) 00010000:00010000:0.0:1788877056.177786:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788877056.177789:0:6539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff000, rc 0) 00010000:00000080:0.0:1788877056.177797:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13c79ab800 x1875771511326848/t94489280525(0) o101->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 664/664 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'grep.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788877056.177869:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+16:42951:x1875771511326848:12345-192.168.203.11@tcp:101:grep.0 Request processed in 1976us (2083us total) trans 94489280525 rc 0/0 00000100:00100000:0.0:1788877056.177877:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2787 00000100:00100000:1.0:1788877056.184029:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877056.184113:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327104 00000100:00100000:2.0:1788877056.184123:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327104 00000100:00100000:2.0:1788877056.184168:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 745 00000100:00100000:2.0:1788877056.184178:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+16:42951:x1875771511327104:12345-192.168.203.11@tcp:35:grep.0 00010000:00000080:2.0:1788877056.184408:0:6543:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac21180 x1875771511327104/t94489280526(0) o35->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:452/0 lens 392/456 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/600/0 rc 0/0 job:'grep.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788877056.184480:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f0204769-56bd-4f5c-ab97-74c450c9e072+17:42951:x1875771511327104:12345-192.168.203.11@tcp:35:grep.0 Request processed in 302us (458us total) trans 94489280526 rc 0/0 00000100:00100000:2.0:1788877056.184487:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 745 00010000:00010000:3.0:1788877056.299949:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877056.488876:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532518144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788877056.488943:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.489108:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518144 00000100:00100000:1.0:1788877056.489116:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518144 00000100:00100000:1.0:1788877056.489165:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1788877056.489175:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532518144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788877056.489206:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:1.0:1788877056.489253:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1875771532518144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.489261:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1788877056.489318:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1875771532518144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788877056.497737:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788877056.497760:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532518272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877056.497831:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.497899:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518272 00000100:00100000:1.0:1788877056.497905:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518272 00000100:00100000:1.0:1788877056.497960:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1788877056.497968:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532518272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788877056.498008:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877056.498054:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532518272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.498061:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00080000:1.0:1788877056.498081:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877056.498118:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532518272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877056.512096:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532518528:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512164:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.512238:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532518656:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512264:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.512315:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518656 00000100:00100000:1.0:1788877056.512323:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518656 00000100:00100000:1.0:1788877056.512365:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1788877056.512373:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532518656:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788877056.512395:0:51736:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac20e00 x1875771532518656/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:452/0 lens 224/224 e 0 to 0 dl 1788877067 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788877056.512433:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1875771532518656:12345-0@lo:400:kworker.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.512441:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1788877056.512484:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1875771532518656:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512528:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532519040:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512552:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.512580:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519040 00000100:00100000:1.0:1788877056.512595:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519040 00000100:00100000:1.0:1788877056.512641:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1788877056.512648:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512685:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532519040:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.512691:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1788877056.512716:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532519040:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512747:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532519168:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512769:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.512796:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519168 00000100:00100000:1.0:1788877056.512800:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519168 00000100:00100000:1.0:1788877056.512832:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:1.0:1788877056.512838:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532519168:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788877056.512850:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac21c00 x1875771532519168/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:452/0 lens 224/224 e 0 to 0 dl 1788877067 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788877056.512880:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1875771532519168:12345-0@lo:400:kworker.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.512886:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00080000:1.0:1788877056.512901:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788877056.512922:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1875771532519168:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512965:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532519552:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.512987:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513026:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532519680:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513046:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513069:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519680 00000100:00100000:1.0:1788877056.513072:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519680 00000100:00100000:1.0:1788877056.513094:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1788877056.513100:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532519680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788877056.513111:0:6539:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7875500 x1875771532519680/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:452/0 lens 224/224 e 0 to 0 dl 1788877067 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788877056.513140:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1875771532519680:12345-0@lo:400:kworker.0 Request processed in 40us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.513147:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1788877056.513177:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1875771532519680:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513209:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532518784:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513233:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513249:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532519296:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513268:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513283:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788877056.513289:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532518400:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513315:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513338:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532518912:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513358:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513372:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532519424:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513393:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877056.513417:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518784 00000100:00100000:1.0:1788877056.513420:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518784 00000100:00100000:1.0:1788877056.513446:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519296 00000100:00100000:1.0:1788877056.513449:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519296 00000100:00100000:1.0:1788877056.513465:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518912 00000100:00100000:1.0:1788877056.513468:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518912 00000100:00100000:1.0:1788877056.513481:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:1.0:1788877056.513487:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532518784:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1788877056.513499:0:6541:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7875180 x1875771532518784/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:452/0 lens 224/224 e 0 to 0 dl 1788877067 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788877056.513529:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1875771532518784:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.513538:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:1.0:1788877056.513551:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1788877056.513557:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532519296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513594:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532519296:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.513622:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1788877056.513635:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1788877056.513641:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513668:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532518912:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.513675:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:1.0:1788877056.513693:0:54983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518400 00000100:00100000:1.0:1788877056.513697:0:54983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518400 00000100:00100000:1.0:1788877056.513723:0:54983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788877056.513729:0:54983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532518400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513756:0:54983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3664:x1875771532518400:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.513762:0:54983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788877056.513784:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788877056.513787:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788877056.513813:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532518400:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513823:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532518912:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513830:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532518784:0@lo:400:kworker.0 00000100:00100000:1.0:1788877056.513838:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532519296:0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.514192:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532518528 00000100:00100000:3.0:1788877056.514197:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532518528 00000100:00100000:3.0:1788877056.514234:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1788877056.514242:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532518528:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1788877056.514256:0:6544:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13fac22a00 x1875771532518528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:452/0 lens 224/224 e 0 to 0 dl 1788877067 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877056.514311:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1875771532518528:12345-0@lo:400:kworker.0 Request processed in 71us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877056.514318:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1788877056.514337:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519552 00000100:00100000:3.0:1788877056.514341:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519552 00000100:00100000:3.0:1788877056.514365:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519424 00000100:00100000:3.0:1788877056.514368:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519424 00000100:00100000:3.0:1788877056.514388:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1788877056.514393:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532519552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.514422:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532519552:12345-0@lo:400:kworker.0 Request processed in 29us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877056.514428:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1788877056.514439:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1788877056.514444:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532519424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.514474:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532519424:12345-0@lo:400:kworker.0 Request processed in 30us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877056.514484:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00080000:3.0:1788877056.514510:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877056.514513:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877056.514531:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532519552:0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.514542:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532518528:0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.514568:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532519424:0@lo:400:kworker.0 00000100:00100000:3.0:1788877056.685094:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877056.685138:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877056.685171:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877056.685292:0:54979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327232 00000100:00100000:2.0:1788877056.685308:0:54979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327232 00000100:00100000:2.0:1788877056.685361:0:54979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1788877056.685371:0:54979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511327232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877056.685440:0:54979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb00b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:2398:x1875771511327232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 61us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877056.685448:0:54979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:2.0:1788877056.685480:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327488 00000100:00100000:2.0:1788877056.685483:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327488 00000100:00100000:2.0:1788877056.685517:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1552 00000100:00100000:2.0:1788877056.685523:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511327488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877056.685549:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f0204769-56bd-4f5c-ab97-74c450c9e072+11:2398:x1875771511327488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877056.685555:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1552 00000100:00100000:1.0:1788877056.685799:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327360 00000100:00100000:1.0:1788877056.685804:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327360 00000100:00100000:1.0:1788877056.685847:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2022 00000100:00100000:1.0:1788877056.685855:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511327360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877056.685892:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511327360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877056.685899:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2022 00000100:00080000:3.0:1788877056.687180:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877056.687187:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788877057.005900:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532519808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788877057.005999:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877057.006196:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519808 00000100:00100000:1.0:1788877057.006207:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519808 00000100:00100000:1.0:1788877057.006289:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1788877057.006300:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532519808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788877057.006333:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491644224 pending 0 free 3923492864 avail 3691970560 00000100:00100000:1.0:1788877057.006392:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1875771532519808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877057.006399:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1788877057.006465:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532519808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788877057.009561:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532519936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788877057.011385:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877057.011559:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532520064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877057.011621:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877057.011671:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520064 00000100:00100000:1.0:1788877057.011683:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520064 00000100:00100000:1.0:1788877057.011749:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788877057.011760:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532520064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788877057.011790:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491899584 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788877057.011842:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875771532520064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877057.011849:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788877057.011902:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532520064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788877057.014288:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532519936 00000100:00100000:3.0:1788877057.014308:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532519936 00000100:00100000:3.0:1788877057.014415:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1788877057.014427:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532519936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788877057.014520:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1446260736 avail 1300021248 00010000:00000080:3.0:1788877057.014536:0:13623:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13e7874e00 x1875771532519936/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:453/0 lens 224/368 e 0 to 0 dl 1788877068 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877057.015906:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1875771532519936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1476us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877057.015917:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1788877057.016830:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532519936:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788877057.321733:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877057.710269:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877057.710324:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877057.710365:0:42779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327616 00000100:00100000:0.0:1788877057.710378:0:42779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327616 00002000:00100000:0.0:1788877057.710439:0:42779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x302:0x0] (0->3) req@ffff8a13c79aaa00 x1875771511327616/t0(0) o4->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:453/0 lens 496/0 e 0 to 0 dl 1788877068 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788877057.710451:0:42779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13c79aaa00 with x1875771511327616 ext(0->3) 00002000:00010000:0.0:1788877057.710459:0:42779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a13c79aaa00 00000100:00100000:0.0:1788877057.710492:0:42779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 472 00000100:00100000:0.0:1788877057.710502:0:42779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511327616:12345-192.168.203.11@tcp:4:grep.0 00000100:00100000:3.0:1788877057.712684:0:43964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511327744 00000100:00100000:3.0:1788877057.712699:0:43964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511327744 00000100:00100000:3.0:1788877057.712786:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 878 00000100:00100000:3.0:1788877057.712797:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+12:2397:x1875771511327744:12345-192.168.203.11@tcp:16:kworker.0 00000100:00100000:3.0:1788877057.713550:0:42779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f0204769-56bd-4f5c-ab97-74c450c9e072+12:2397:x1875771511327616:12345-192.168.203.11@tcp:4:grep.0 Request processed in 3039us (3214us total) trans 8589934863 rc 0/0 00000100:00100000:3.0:1788877057.713564:0:42779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 472 00002000:00100000:3.0:1788877057.713592:0:42779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x302:0x0] (0->3) req@ffff8a13c79aaa00 x1875771511327616/t8589934863(0) o4->f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp:453/0 lens 496/448 e 0 to 0 dl 1788877068 ref 1 fl Complete:/600/0 rc 0/0 job:'grep.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788877057.713750:0:42779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a13c79aaa00 with x1875771511327616 ext(0->3) 00002000:00010000:3.0:1788877057.713757:0:42779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a13c79aaa00 00000001:00080000:3.0:1788877057.715739:0:16216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934863 is committed 00000100:00100000:2.0:1788877057.717007:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511327744:12345-192.168.203.11@tcp:16:kworker.0 Request processed in 4200us (6740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877057.717022:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 878 00000001:00080000:0.0:1788877058.030460:0:9533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967572 is committed 00010000:00010000:0.0:1788877058.346882:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788877058.650633:0:56292:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788877058.650707:0:56292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.650726:0:56292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.650735:0:56292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.650743:0:56292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.650764:0:56292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788877058.650770:0:56292:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788877058.650801:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788877058.650807:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788877058.650814:0:56292:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788877058.650847:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788877058.650889:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532520192:0@lo:39:umount.0 00000100:00100000:0.0:1788877058.650976:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877058.651094:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520192 00000100:00100000:0.0:1788877058.651104:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520192 00000100:00100000:0.0:1788877058.651164:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1788877058.651175:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875771532520192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788877058.651208:0:15659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b06ff 00000100:00080000:0.0:1788877058.651229:0:15659:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e67800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1788877058.651262:0:15659:0:(ldlm_lib.c:3330:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8a13c79aa300 x1875771532520192/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:454/0 lens 224/224 e 0 to 0 dl 1788877069 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788877058.651311:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3661:x1875771532520192:12345-0@lo:39:umount.0 Request processed in 137us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877058.651318:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000020:00000080:0.0:1788877058.651329:0:15659:0:(genops.c:885:class_export_put()) final put ffff8a13d0e62000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788877058.651377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e62000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788877058.651425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e67800 for lustre-MDT0000 00000100:00080000:0.0:1788877058.651463:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ff363000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788877058.651473:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532520192:0@lo:39:umount.0 00000100:00080000:0.0:1788877058.651494:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788877058.651497:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788877058.651500:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788877058.652462:0:56292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652481:0:56292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652490:0:56292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652497:0:56292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652533:0:56292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788877058.652541:0:56292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652547:0:56292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652553:0:56292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652558:0:56292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652565:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788877058.652568:0:56292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788877058.652583:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652586:0:56292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652592:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef72800 already unused, calling callback (ffffffffc12efc20) 00010000:00010000:0.0:1788877058.652593:0:56292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877058.652597:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652625:0:56292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652632:0:56292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652635:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652641:0:56292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:00010000:1.0:1788877058.652642:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652646:0:56292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.652648:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788877058.652651:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1788877058.652654:0:56292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.652654:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788877058.652660:0:56292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652665:0:56292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.652671:0:56292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788877058.652674:0:56292:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788877058.652693:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652699:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1788877058.652704:0:56292:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788877058.652710:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1788877058.652714:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1788877058.652720:0:56292:0:(obd_config.c:933:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1788877058.652723:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652733:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72800/0xf5bf0f7e313b05e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05e7 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652747:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788877058.652749:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652754:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefee00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877058.652757:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652763:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877058.652769:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.652774:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788877058.652776:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788877058.652778:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788877058.652790:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652796:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877058.652811:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652817:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefee00/0xf5bf0f7e313b0507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b050e expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652829:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788877058.652832:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652837:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13eef73a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877058.652839:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652845:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877058.652850:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.652855:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788877058.652857:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788877058.652858:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788877058.652869:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652875:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877058.652880:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652886:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73a00/0xf5bf0f7e313b060a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0611 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652908:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788877058.652911:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652919:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1487a00 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877058.652921:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652928:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877058.652935:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.652942:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788877058.652944:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788877058.652946:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788877058.652958:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.652965:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877058.652979:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653108:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487a00/0xf5bf0f7e313b05d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b05d9 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653119:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788877058.653122:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653128:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13c1486000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877058.653131:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653139:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877058.653146:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877058.653152:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788877058.653154:0:10419:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788877058.653155:0:10419:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788877058.653169:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653175:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877058.653180:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653187:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1486000/0xf5bf0f7e313b04f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5bf0f7e313b0500 expref: -99 pid: 54972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.653198:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877058.653200:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877058.653202:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877058.653224:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.653301:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877058.653366:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.653390:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877058.653424:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788877058.653430:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.653455:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788877058.653490:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788877058.653499:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877058.653799:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532520448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.653827:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877058.653848:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788877058.653853:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532520576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.653872:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877058.654075:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520320 00000100:00100000:1.0:1788877058.654083:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520320 00000100:00100000:1.0:1788877058.654128:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520832 00000100:00100000:1.0:1788877058.654131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520832 00000100:00100000:1.0:1788877058.654143:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520704 00000100:00100000:1.0:1788877058.654145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520704 00000100:00100000:1.0:1788877058.654155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520448 00000100:00100000:1.0:1788877058.654157:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520448 00000100:00100000:1.0:1788877058.654166:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520576 00000100:00100000:1.0:1788877058.654168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520576 00000100:00100000:1.0:1788877058.654185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788877058.654194:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+28:3663:x1875771532520320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877058.654209:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877058.654228:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72e00/0xf5bf0f7e313b05e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b05e0 expref: 28 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.654242:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877058.654282:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+27:3663:x1875771532520320:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877058.654289:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788877058.654307:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788877058.654325:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+26:3663:x1875771532520832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877058.654336:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877058.654346:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73e00/0xf5bf0f7e313b0500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b04f9 expref: 26 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.654355:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877058.654376:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+25:3663:x1875771532520832:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877058.654382:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788877058.654393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788877058.654399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:3663:x1875771532520704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877058.654406:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877058.654426:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca8200/0xf5bf0f7e313b05d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b05d2 expref: 24 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.654436:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877058.654456:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:3663:x1875771532520704:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877058.654462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788877058.654722:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788877058.654730:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:3664:x1875771532520448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877058.654738:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877058.654747:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9800/0xf5bf0f7e313b050e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0507 expref: 22 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.654757:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877058.654786:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:3664:x1875771532520448:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877058.654796:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788877058.654808:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788877058.654814:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:3664:x1875771532520576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877058.654822:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788877058.654832:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b060a expref: 20 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.654840:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788877058.654860:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:3664:x1875771532520576:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877058.654865:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788877058.655099:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532520576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.655108:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532520448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.655143:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.655151:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788877058.655157:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532520832:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1788877058.658384:0:56292:0:(mdt_handler.c:8179:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1788877058.659836:0:54973:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280526 is committed 00000020:00000080:1.0:1788877058.659992:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1788877058.660004:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13d0e61800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788877058.660011:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13fa7ab000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788877058.660015:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a13fa7ad800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788877058.660023:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a12c6617000 f0204769-56bd-4f5c-ab97-74c450c9e072 192.168.203.11@tcp 11 (0 0 5) 0 0 0 1: ffff8a13e7854000 94489280526 stale:0 00000020:00080000:1.0:1788877058.660027:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a12c6614000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788877058.660033:0:56292:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a13eefc0000) has exports, disconnecting them 00000020:00080000:1.0:1788877058.660039:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13d0e61800), last request at 1788877056 00000020:00000080:1.0:1788877058.660047:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b06f8 00000100:00080000:1.0:1788877058.660058:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e64800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788877058.660092:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13d0e61800): rc 0 00000020:00000080:1.0:1788877058.660094:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13d0e61800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788877058.660111:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13fa7ab000), last request at 1788877056 00000020:00000080:1.0:1788877058.660114:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b06f1 00000100:00080000:1.0:1788877058.660118:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13fbfcb800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788877058.660128:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13fa7ab000): rc 0 00000020:00000080:1.0:1788877058.660130:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13fa7ab000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788877058.660135:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a13fa7ad800), last request at 1788877025 00000020:00000080:1.0:1788877058.660137:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b06ea 00000100:00080000:1.0:1788877058.660140:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7ac800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788877058.660150:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13fa7ad800): rc 0 00000020:00000080:1.0:1788877058.660152:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13fa7ad800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788877058.660156:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.11@tcp (ffff8a12c6617000), last request at 1788877056 00010000:00010000:3.0:1788877058.660160:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788877058.660167:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0554 00000020:00000080:3.0:1788877058.660173:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e61800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00010000:1.0:1788877058.660182:0:56292:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a12c6617000: total 3 00000100:00080000:1.0:1788877058.660185:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13c486a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788877058.660230:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7ab000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:1.0:1788877058.660249:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a12c6617000): rc 0 00000020:00080000:1.0:1788877058.660253:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a12c6614000), last request at 1788877020 00000020:00000080:1.0:1788877058.660255:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b054d 00000020:00000080:3.0:1788877058.660255:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13fa7ad800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1788877058.660261:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13eefde800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788877058.660265:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c6614000): rc 0 00000020:00000080:1.0:1788877058.660267:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a12c6614000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788877058.660272:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e64800 for lustre-MDT0000 00000004:00000080:1.0:1788877058.660274:0:56292:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa620819b7ae0 00000020:00000080:3.0:1788877058.660276:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fbfcb800 for lustre-MDT0000 00000020:00000080:3.0:1788877058.660279:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13fa7ac800 for lustre-MDT0000 00000020:00000080:3.0:1788877058.660282:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c6614000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:1.0:1788877058.660296:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788877058.660301:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:3.0:1788877058.660315:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13eefde800 for lustre-MDT0000 00000020:00010000:3.0:1788877058.660329:0:6527:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a12c6617000: total 0 00010000:00010000:3.0:1788877058.660407:0:6527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a12c6617000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1788877058.660447:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efefea00/0xf5bf0f7e313b0ada lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x118:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae7 expref: 7 pid: 15659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877058.660467:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13fae34400/0xf5bf0f7e313b09c2 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x115:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a93 expref: 6 pid: 51736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877058.660488:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7873400/0xf5bf0f7e313b0ab0 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x118:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ad2 expref: 5 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877058.660507:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13eef40400/0xf5bf0f7e313b0acc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048ae0 expref: 4 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877058.660524:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13efeff000/0xf5bf0f7e313b0afd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x115:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048aee expref: 3 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877058.660538:0:6527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a12c6617000, canceled 5 locks, left on hash table 0. 00000100:00080000:1.0:1788877058.661682:0:56292:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788877058.661722:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd60000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788877058.661784:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532520960:0@lo:39:umount.0 00000100:00100000:1.0:1788877058.661876:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877058.661963:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532520960 00000100:00100000:1.0:1788877058.661971:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532520960 00000100:00100000:1.0:1788877058.662028:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1788877058.662038:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532520960:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788877058.662071:0:6545:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0585 00000100:00080000:1.0:1788877058.662080:0:6545:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd61000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788877058.662098:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967328 00000100:00100000:1.0:1788877058.662259:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3661:x1875771532520960:12345-0@lo:39:umount.0 Request processed in 222us (382us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788877058.662286:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00080000:1.0:1788877058.662339:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd60000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788877058.662348:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532520960:0@lo:39:umount.0 00010000:00010000:2.0:1788877058.663488:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877058.663671:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788877058.663720:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788877058.663725:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934862 gen 3 00000004:00080000:1.0:1788877058.663750:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788877058.663811:0:56292:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788877058.663854:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788877058.663872:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788877058.663874:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967570 gen 3 00000004:00080000:1.0:1788877058.663882:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788877058.664204:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532521088:0@lo:9:umount.0 00000100:00100000:1.0:1788877058.664283:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788877058.664365:0:56292:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788877058.664382:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13c3002800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788877058.664401:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532521216:0@lo:9:umount.0 00000100:00100000:2.0:1788877058.664561:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521088 00000100:00100000:2.0:1788877058.664570:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521088 00000100:00100000:2.0:1788877058.664663:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1788877058.664675:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532521088:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788877058.664703:0:43956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b05a1 00000100:00080000:2.0:1788877058.664713:0:43956:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd63000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788877058.664787:0:43956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934863 00000100:00100000:2.0:1788877058.664962:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532521088:12345-0@lo:9:umount.0 Request processed in 290us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877058.665160:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00010000:00010000:2.0:1788877058.665197:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877058.665285:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788877058.665338:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef173800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788877058.665348:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788877058.665351:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788877058.665355:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532521088:0@lo:9:umount.0 00010000:00010000:0.0:1788877058.665549:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665564:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665580:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665588:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13e7872c00 already unused, calling callback (ffffffffc19004f0) 00010000:00010000:0.0:1788877058.665594:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665622:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665643:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6262c7d7 (ffff8a13d355c800) 00010000:00010000:0.0:1788877058.665646:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788877058.665652:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877058.665659:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a13e7872c00/0xf5bf0f7e313b0aa9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6262c7d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788877058.667156:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a13eefc0000) has no exports 00000100:00100000:2.0:1788877058.667285:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521216 00000100:00100000:2.0:1788877058.667297:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521216 00000100:00100000:2.0:1788877058.667374:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1788877058.667388:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875771532521216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788877058.667437:0:8456:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b05bd 00000100:00080000:2.0:1788877058.667448:0:8456:0:(import.c:65:import_set_state_nolock()) ffff8a12c1af4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788877058.667518:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967572 00000100:00100000:2.0:1788877058.667760:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3661:x1875771532521216:12345-0@lo:9:umount.0 Request processed in 376us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877058.667769:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00010000:00010000:2.0:1788877058.667803:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788877058.667845:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c3002800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788877058.667858:0:3661:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788877058.667861:0:3661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788877058.667864:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532521216:0@lo:9:umount.0 00000100:00080000:0.0:1788877058.668663:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788877058.668671:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1788877058.671800:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a13eefc0000) has no exports 00000020:00000080:3.0:1788877058.709925:0:6527:0:(genops.c:885:class_export_put()) final put ffff8a12c6617000/f0204769-56bd-4f5c-ab97-74c450c9e072 00000020:00000080:0.0:1788877058.714322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c6617000/f0204769-56bd-4f5c-ab97-74c450c9e072 for lustre-MDT0000 00000020:00000080:0.0:1788877058.714427:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c486a000 for lustre-MDT0000 00010000:00010000:0.0:1788877058.714445:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877058.714449:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788877058.714452:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788877058.808544:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0569 00000020:00000080:2.0:1788877058.808565:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13c4ebd800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788877058.808869:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788877058.809711:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788877058.809740:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788877058.809747:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a12c3f60000) has no exports 00000020:00000080:1.0:1788877058.810547:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0562 00000020:00000080:1.0:1788877058.810560:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a12c22f3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788877058.814123:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c4ebd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788877058.821434:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c22f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788877058.824008:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788877058.824030:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788877058.824038:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a12c6611800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788877058.824044:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c6611800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788877058.824059:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788877058.824273:0:56292:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13c86a4cc0 - data ffff8a13ee849000/ffff8a12c35bcc00 00000020:01000000:1.0:1788877058.824449:0:56292:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c3ffa2a0 - data ffff8a13ee903948/ffff8a13f464c000 00000100:00080000:3.0:1788877058.910440:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788877058.910452:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788877058.910470:0:56292:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a13eb104000 x1875771532520960/t4294967329(4294967329) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788877068 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788877058.910506:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788877058.912547:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788877058.912554:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934862 gen 4 00000004:00080000:3.0:1788877058.912655:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788877058.912658:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788877058.913401:0:54991:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788877058.913407:0:54991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 1 count 1 00000040:00080000:0.0:1788877058.913421:0:54991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:1.0:1788877058.919351:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788877058.919361:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967570 gen 4 00000004:00080000:1.0:1788877058.919387:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788877058.919390:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788877058.920148:0:54993:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788877058.920155:0:54993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 1 count 1 00000040:00080000:3.0:1788877058.920169:0:54993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:3.0:1788877058.923762:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0523 00000020:00000080:3.0:1788877058.923780:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07a8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788877058.924176:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788877058.925419:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0538 00000020:00000080:3.0:1788877058.925436:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07aa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788877058.925560:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788877058.925567:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788877058.925588:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788877058.925594:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a13c79c4d40) has no exports 00000004:01000000:3.0:1788877058.926198:0:56292:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788877058.926213:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b05b6 00000020:00000080:3.0:1788877058.926222:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ff3dc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877058.927274:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07aa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788877058.927412:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788877058.927420:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788877058.927437:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788877058.927442:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a12c45e8000) has no exports 00000020:00000080:3.0:1788877058.927452:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b05af 00000020:00000080:3.0:1788877058.927461:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13c3005800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788877058.927918:0:56292:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788877058.927924:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788877058.927930:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967570 gen 5 00000004:00080000:3.0:1788877058.927937:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788877058.927940:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788877058.928207:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788877058.928218:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788877058.928229:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b059a 00000020:00000080:3.0:1788877058.928236:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ff3de800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788877058.928249:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788877058.928255:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788877058.928259:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788877058.928262:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a12c5e399c0) has no exports 00000020:00000080:3.0:1788877058.928267:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0593 00000020:00000080:3.0:1788877058.928271:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ef172000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788877058.928799:0:56292:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788877058.928803:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788877058.928807:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934862 gen 5 00000004:00080000:3.0:1788877058.928811:0:56292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788877058.928813:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788877058.928845:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788877058.928851:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788877058.928866:0:56292:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788877058.928873:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b057e 00000020:00000080:3.0:1788877058.928878:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ff3df000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788877058.928883:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788877058.928887:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788877058.928890:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788877058.928893:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8a12c3f64d40) has no exports 00000020:00000080:3.0:1788877058.928897:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0577 00000020:00000080:3.0:1788877058.928900:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13c4c38000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788877058.929346:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3dc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788877058.929358:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c3005800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788877058.929365:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13c3002800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788877058.929373:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13ff3d9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877058.929376:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3d9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788877058.929381:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788877058.929500:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3de800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788877058.929507:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef172000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788877058.929513:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ef173800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788877058.929517:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13ff3db800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877058.929519:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3db800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788877058.929522:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788877058.929555:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788877058.929563:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13c4c38000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788877058.939797:0:56292:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788877058.939809:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788877058.939815:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788877058.939825:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788877058.939918:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788877058.939935:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788877058.939976:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788877058.939990:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788877058.939998:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07af000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877058.940004:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07af000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788877058.940017:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788877058.940155:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b053f 00000020:00000080:0.0:1788877058.940164:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07ac000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788877058.940170:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788877058.940175:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788877058.940180:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788877058.940185:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a12c45eb380) has no exports 00000020:00000080:0.0:1788877058.940208:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788877058.940212:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788877058.940217:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0546 00000020:00000080:0.0:1788877058.940222:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07ab000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788877058.940230:0:56292:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13d0608800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788877058.940234:0:56292:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608800 3 00000020:00000080:1.0:1788877058.940332:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13cfd60000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788877058.940343:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13ff3da800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788877058.940345:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff3da800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788877058.940353:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788877058.940422:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ac000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788877058.940426:0:24072:0:(genops.c:885:class_export_put()) final put ffff8a13f07a9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788877058.940428:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07a9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788877058.940431:0:24072:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788877058.940468:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788877058.940675:0:56292:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13d0608800 from lustre-MDT0000 00000020:00000080:0.0:1788877058.940699:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788877058.940704:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788877058.940707:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f07ad800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788877058.940710:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f07ad800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788877058.940717:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788877058.940758:0:56292:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788877058.940762:0:56292:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788877058.940766:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788877058.940770:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788877058.940773:0:56292:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788877058.940783:0:56292:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a13d0e65000 a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 192.168.203.11@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788877058.940789:0:56292:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a12c5f37000 1f425f51-afcc-4e8f-8e95-ef22cb326ef4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788877058.940793:0:56292:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a12c4e30000) has exports, disconnecting them 00000020:00080000:0.0:1788877058.940798:0:56292:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.11@tcp (ffff8a13d0e65000), last request at 1788877020 00000020:00000080:0.0:1788877058.940825:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b0603 00000020:00010000:0.0:1788877058.940830:0:56292:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a13d0e65000: total 0 00000100:00080000:0.0:1788877058.940835:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a13d0e65800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788877058.940929:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 192.168.203.11@tcp (ffff8a13d0e65000): rc 0 00000020:00080000:0.0:1788877058.940933:0:56292:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a12c5f37000), last request at 1788877020 00000020:00000080:0.0:1788877058.940995:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b04e4 00000020:00010000:0.0:1788877058.941001:0:56292:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a12c5f37000: total 0 00000100:00080000:0.0:1788877058.941004:0:56292:0:(import.c:65:import_set_state_nolock()) ffff8a12c5f36800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788877058.941071:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a13d0e65000: total 0 00010000:00010000:1.0:1788877058.941077:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877058.941104:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a13d0e65000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1788877058.941139:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeffe00/0xf5bf0f7e313b06e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a5b expref: 5 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941156:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487200/0xf5bf0f7e313b06dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a54 expref: 4 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941169:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef73000/0xf5bf0f7e313b06ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a46 expref: 3 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941181:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72c00/0xf5bf0f7e313b06d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048a4d expref: 2 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941189:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a13d0e65000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1788877058.941209:0:10419:0:(genops.c:885:class_export_put()) final put ffff8a13d0e65000/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 00000020:00010000:1.0:1788877058.941220:0:10419:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a12c5f37000: total 1 00010000:00010000:1.0:1788877058.941236:0:10419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a12c5f37000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788877058.941337:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487000/0xf5bf0f7e313b063b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0634 expref: 16 pid: 54979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941348:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9c00/0xf5bf0f7e313b06b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b06b2 expref: 15 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941364:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486e00/0xf5bf0f7e313b0649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0642 expref: 14 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941375:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72600/0xf5bf0f7e313b06c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b06c0 expref: 13 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941385:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9200/0xf5bf0f7e313b0657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0650 expref: 12 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941394:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca8c00/0xf5bf0f7e313b0665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b065e expref: 11 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941410:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9a00/0xf5bf0f7e313b0681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b067a expref: 10 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941422:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff200/0xf5bf0f7e313b068f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0688 expref: 9 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941433:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b066c expref: 8 pid: 54983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941444:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca9600/0xf5bf0f7e313b06ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b06a4 expref: 7 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941456:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b061f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0618 expref: 6 pid: 54980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941467:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efca8800/0xf5bf0f7e313b069d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0696 expref: 5 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941553:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13eef72200/0xf5bf0f7e313b062d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5bf0f7e313b0626 expref: 4 pid: 54977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877058.941563:0:10419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a12c5f37000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788877058.941624:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877058.941627:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877058.941629:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788877058.941638:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0e65000/a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1 for MGS 00000020:00000080:1.0:1788877058.941671:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13d0e65800 for MGS 00000020:00080000:0.0:1788877058.946529:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a12c5f37000): rc 0 00000020:00000080:0.0:1788877058.946538:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a12c5f37000/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 00000020:00080000:0.0:1788877058.946557:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a12c4e30000) has no exports 00010000:00010000:1.0:1788877058.946748:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877058.946822:0:54983:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff8a13e7c61a00:54983] 3 exiting: rc = 0 00000100:00100000:1.0:1788877058.946972:0:54980:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a13effe3e00:54980] 2 exiting: rc = 0 00000020:00000080:1.0:1788877058.947029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a12c5f37000/1f425f51-afcc-4e8f-8e95-ef22cb326ef4 for MGS 00000020:00000080:1.0:1788877058.947073:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c5f36800 for MGS 00000100:00100000:3.0:1788877058.947253:0:54977:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a13d1a10600:54977] 0 exiting: rc = 1 00000100:00100000:2.0:1788877058.947923:0:54979:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a12c33a6a00:54979] 1 exiting: rc = 0 00000100:00100000:0.0:1788877058.948672:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948682:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948706:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948714:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948721:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948728:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948735:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948743:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948752:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948758:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948766:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948772:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948779:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948786:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948793:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948798:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948804:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948811:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948818:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948825:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948832:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948838:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948844:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948850:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948858:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948864:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948871:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948878:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948884:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948890:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948896:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948903:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948911:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948917:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948924:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948930:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948936:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948942:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948948:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948955:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948963:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948970:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.948977:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949133:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949139:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949145:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949152:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949158:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949164:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949172:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949178:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949184:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949190:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949196:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949202:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949208:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949214:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949220:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949225:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949231:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949248:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949257:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949264:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788877058.949270:0:56292:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788877058.952014:0:56292:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a13f41e6240 - data ffff8a12c1e9cca8/ffff8a13c79a5c00 00000020:01000000:0.0:1788877058.952153:0:56292:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a12c3ffa420 - data ffff8a13ee9075e8/ffff8a13effc0800 00000020:00000080:1.0:1788877058.953076:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b04dd 00000020:00000080:1.0:1788877058.953088:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13d0b33000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788877058.953115:0:56292:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13d0608800 from MGS, refs=2 00000020:01000004:1.0:1788877058.953119:0:56292:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608800 2 00000020:01000004:1.0:1788877058.953123:0:56292:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a13d0608800 from MGS 00000020:00000080:1.0:1788877058.953150:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788877058.953158:0:56292:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788877058.953162:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13d15b9800/MGS 00000020:00000080:1.0:1788877058.953165:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d15b9800/MGS for MGS 00000020:01000000:1.0:1788877058.953172:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788877058.953273:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788877058.953278:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788877058.953291:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788877058.953299:0:56292:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a13ff37b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788877058.953306:0:56292:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8a12c4e34d40) has exports, disconnecting them 00000020:00080000:1.0:1788877058.953322:0:56292:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a13ff37b800), last request at 1788877020 00000020:00000080:1.0:1788877058.953326:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b05f5 00000020:00080000:1.0:1788877058.953340:0:56292:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a13ff37b800): rc 0 00000020:00000080:1.0:1788877058.953344:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ff37b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788877058.954199:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13d0b33000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788877058.954213:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ff37b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788877058.984369:0:56292:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788877058.984381:0:56292:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788877058.984387:0:56292:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788877058.984397:0:56292:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788877058.985077:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13ff363000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788877058.985330:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788877058.985346:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788877058.985353:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13ef008000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788877058.985357:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef008000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788877058.985371:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788877058.985543:0:56292:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13d0608800 1 00000020:00000080:1.0:1788877058.985552:0:56292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf5bf0f7e313b04cf 00000020:00000080:1.0:1788877058.985559:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f4440800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788877058.985584:0:56292:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788877058.985589:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788877058.985593:0:56292:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788877058.985598:0:56292:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a12c4e319c0) has no exports 00000020:00000080:0.0:1788877058.988106:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f4440800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788877059.124789:0:56292:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788877059.124803:0:56292:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788877059.124809:0:56292:0:(genops.c:885:class_export_put()) final put ffff8a13f5236000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788877059.124815:0:56292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13f5236000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788877059.124828:0:56292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788877059.125200:0:56292:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a13d0608000 00000020:02000400:0.0:1788877059.125268:0:56292:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788877059.368824:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877060.397525:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877060.586013:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532521344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788877060.586106:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877060.586206:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521344 00000100:00100000:3.0:1788877060.586217:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521344 00000100:00100000:3.0:1788877060.586314:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1788877060.586325:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532521344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877060.586365:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788877060.586423:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532521344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877060.586430:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1788877060.586506:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532521344:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788877060.586815:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877061.417778:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877061.608759:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788877061.608780:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532521472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788877061.608847:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877061.608893:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532521856:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.608917:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877061.608955:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fbc58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532522368:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.608978:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877061.608998:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788877061.609004:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532521984:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.609025:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877061.609041:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fbc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532522496:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.609063:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877061.609093:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521472 00000100:00100000:3.0:1788877061.609093:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521856 00000100:00100000:1.0:1788877061.609100:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521472 00000100:00100000:3.0:1788877061.609100:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521856 00000100:00100000:3.0:1788877061.609132:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522368 00000100:00100000:3.0:1788877061.609135:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522368 00000100:00100000:1.0:1788877061.609136:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1788877061.609144:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532521472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877061.609148:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521984 00000100:00100000:3.0:1788877061.609149:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521984 00000100:00100000:3.0:1788877061.609156:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522496 00000100:00100000:3.0:1788877061.609159:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522496 00002000:00000024:1.0:1788877061.609171:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788877061.609172:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1788877061.609178:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532522496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877061.609212:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532522496:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877061.609218:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1788877061.609235:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:3.0:1788877061.609238:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3664:x1875771532521856:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788877061.609244:0:6539:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788877061.609255:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788877061.609261:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3664:x1875771532522368:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788877061.609265:0:6540:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788877061.609357:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532521472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877061.609364:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00080000:1.0:1788877061.609382:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788877061.609386:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877061.609395:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1788877061.609399:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3664:x1875771532521984:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788877061.609404:0:51736:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788877061.609428:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3664:x1875771532521984:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788877061.609433:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00080000:1.0:1788877061.609465:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788877061.609469:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788877061.609473:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788877061.615222:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3664:x1875771532521856:12345-0@lo:400:kworker.0 Request processed in 5973us (6295us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788877061.615236:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1788877061.615375:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3664:x1875771532522368:12345-0@lo:400:kworker.0 Request processed in 6111us (6394us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788877061.615383:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1788877061.615421:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532521728:0@lo:400:kworker.0 00000100:00100000:0.0:1788877061.615479:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877061.615523:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532522240:0@lo:400:kworker.0 00000100:00100000:0.0:1788877061.615548:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877061.615550:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532521728 00000100:00100000:3.0:1788877061.615568:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532521728 00000100:00100000:0.0:1788877061.615586:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788877061.615593:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532521600:0@lo:400:kworker.0 00000100:00100000:3.0:1788877061.615622:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000400:00000100:0.0:1788877061.615627:0:3663:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532521600 offset 0 length 224: 4 00000100:00100000:3.0:1788877061.615628:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3663:x1875771532521728:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788877061.615636:0:13623:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788877061.615655:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532522112:0@lo:400:kworker.0 00000100:00100000:3.0:1788877061.615669:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3663:x1875771532521728:12345-0@lo:400:kworker.0 Request processed in 40us (190us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788877061.615675:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788877061.615677:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788877061.615707:0:3663:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788877061.615712:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788877061.615716:0:3663:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788877061.615723:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788877061.615727:0:3663:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2013 00000100:00080000:0.0:1788877061.615734:0:3663:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877061.615734:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522240 00000100:00100000:2.0:1788877061.615738:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522240 00000100:00100000:0.0:1788877061.615759:0:3663:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13c79ab100 x1875771532522624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877061.615775:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:0.0:1788877061.615780:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532521728:0@lo:400:kworker.0 00000100:00100000:2.0:1788877061.615782:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532522240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877061.616030:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532522240:12345-0@lo:400:kworker.0 Request processed in 248us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877061.616038:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:2.0:1788877061.616057:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532522624:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788877061.616082:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877061.616131:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c5274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532522240:0@lo:400:kworker.0 00000100:00100000:3.0:1788877061.616178:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522624 00000100:00100000:3.0:1788877061.616183:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522624 00000100:00100000:3.0:1788877061.616211:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788877061.616216:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532522624:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1788877061.616233:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877061.616425:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532522624:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 207us (341us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877061.616433:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:2.0:1788877061.616486:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877061.616491:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877061.616494:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532522624:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788877061.617046:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522112 00000100:00100000:0.0:1788877061.617052:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522112 00000100:00100000:0.0:1788877061.617104:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1788877061.617110:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532522112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877061.617152:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532522112:12345-0@lo:400:kworker.0 Request processed in 42us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877061.617158:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1788877061.617189:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532522112:0@lo:400:kworker.0 00000100:00080000:3.0:1788877061.620040:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788877061.639135:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877061.639146:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2013 00000100:00080000:1.0:1788877061.639156:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877061.639193:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3357480 x1875771532522752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877061.639223:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1875771532521984:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.639257:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fbc59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532522496:0@lo:400:kworker.0 00000100:00100000:0.0:1788877061.639486:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532522752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788877061.639550:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877061.639616:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522752 00000100:00100000:3.0:1788877061.639624:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522752 00000100:00100000:3.0:1788877061.639668:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1788877061.639675:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532522752:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788877061.639696:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877061.639744:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532522752:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 68us (193us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877061.639751:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00080000:1.0:1788877061.639753:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788877061.639757:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788877061.639760:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788877061.639763:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877061.639766:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2013 00000100:00080000:1.0:1788877061.639771:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877061.639786:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3355880 x1875771532522880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877061.639799:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fbc58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1875771532522368:0@lo:400:kworker.0 00000100:00080000:1.0:1788877061.639813:0:3664:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788877061.639816:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788877061.639819:0:3664:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788877061.639822:0:3664:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877061.639825:0:3664:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2013 00000100:00080000:1.0:1788877061.639828:0:3664:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877061.639839:0:3664:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3355500 x1875771532523008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877061.639848:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1875771532521856:0@lo:400:kworker.0 00000100:00100000:1.0:1788877061.639870:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532521472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877061.639946:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532522880:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788877061.639973:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877061.640001:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532523008:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788877061.640021:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788877061.640052:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877061.640057:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877061.640059:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532522752:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788877061.640127:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532522880 00000100:00100000:3.0:1788877061.640131:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532522880 00000100:00100000:3.0:1788877061.640155:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523008 00000100:00100000:3.0:1788877061.640158:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523008 00000100:00100000:3.0:1788877061.640175:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788877061.640179:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532522880:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788877061.640190:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877061.640222:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532522880:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 41us (248us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877061.640228:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:3.0:1788877061.640239:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:3.0:1788877061.640243:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532523008:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788877061.640251:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877061.640372:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532523008:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 126us (348us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877061.640378:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00080000:3.0:1788877061.640406:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877061.640410:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877061.640413:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532522880:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1788877061.640421:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877061.640424:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877061.640427:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532523008:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:3.0:1788877061.809224:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511327872 offset 0 length 224: 4 00000100:00100000:3.0:1788877061.809260:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877061.809302:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877061.809324:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877061.809344:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877061.809367:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328384 00000100:00100000:3.0:1788877061.809376:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328384 00000100:00100000:3.0:1788877061.809421:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328256 00000100:00100000:3.0:1788877061.809424:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328256 00000100:00100000:3.0:1788877061.809444:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1554 00000100:00100000:3.0:1788877061.809453:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511328384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877061.809515:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511328384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877061.809523:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1554 00000100:00100000:3.0:1788877061.809540:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1555 00000100:00100000:3.0:1788877061.809546:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511328256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877061.809581:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511328256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877061.809587:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1555 00000100:00100000:3.0:1788877061.809635:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328128 00000100:00100000:3.0:1788877061.809639:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328128 00000100:00100000:3.0:1788877061.809666:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328000 00000100:00100000:3.0:1788877061.809669:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328000 00000100:00100000:3.0:1788877061.809685:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2025 00000100:00100000:3.0:1788877061.809691:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511328128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877061.809719:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511328128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877061.809725:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2025 00000100:00100000:3.0:1788877061.809738:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2795 00000100:00100000:3.0:1788877061.809742:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1875771511328000:12345-192.168.203.11@tcp:400:kworker.0 00000020:00080000:3.0:1788877061.809748:0:6541:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.11@tcp 00000100:00100000:3.0:1788877061.809770:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1875771511328000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788877061.809775:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2795 00000100:00080000:3.0:1788877061.809793:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877061.809797:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877061.809799:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877061.820593:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877061.820641:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328512 00000100:00100000:3.0:1788877061.820651:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328512 00000100:00100000:3.0:1788877061.820694:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2796 00000100:00100000:3.0:1788877061.820702:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511328512:12345-192.168.203.11@tcp:38:ptlrpcd_01_01.0 00010000:00020000:3.0:1788877061.820726:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877061.820783:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511328512:12345-192.168.203.11@tcp:38:ptlrpcd_01_01.0 Request processed in 80us (197us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877061.820789:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2796 00010000:00010000:2.0:1788877062.440794:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877063.467381:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788877064.172901:0:7472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788877064.172918:0:7472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967329 is committed 00000020:00000080:3.0:1788877064.172923:0:7472:0:(genops.c:885:class_export_put()) final put ffff8a13cfd62800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877064.172953:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13cfd62800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788877064.173025:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13cfd61000 for lustre-MDT0001 00000001:00100000:0.0:1788877064.174120:0:16216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877064.174124:0:16216:0:(genops.c:885:class_export_put()) final put ffff8a13cfd65800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788877064.174199:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13cfd65800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788877064.174240:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a13cfd63000 for lustre-OST0000 00000001:00100000:0.0:1788877064.177892:0:9533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788877064.177900:0:9533:0:(genops.c:885:class_export_put()) final put ffff8a13ef170000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788877064.177971:0:24072:0:(genops.c:844:class_export_destroy()) destroying export ffff8a13ef170000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788877064.185392:0:24072:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a12c1af4000 for lustre-OST0001 00010000:00010000:2.0:1788877064.490492:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877065.512938:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877065.704862:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788877065.705039:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532523136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788877065.705112:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877065.705314:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523136 00000100:00100000:3.0:1788877065.705322:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523136 00000100:00100000:3.0:1788877065.705386:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1788877065.705396:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532523136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877065.705423:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788877065.705477:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532523136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877065.705484:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1788877065.705683:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532523136:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788877065.706121:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877066.536893:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877066.730397:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532523264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877066.730495:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.730661:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523264 00000100:00100000:3.0:1788877066.730672:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523264 00000100:00100000:3.0:1788877066.730758:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1788877066.730771:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532523264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877066.730809:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788877066.730869:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532523264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877066.730877:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1788877066.730935:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532523264:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788877066.731286:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877066.731292:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877066.731296:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877066.731302:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2049 00000100:00080000:1.0:1788877066.731308:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788877066.731315:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877066.731337:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3356a00 x1875771532523520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877066.731353:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877066.731357:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877066.731358:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877066.731362:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2049 00000100:00080000:1.0:1788877066.731365:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788877066.731368:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877066.731380:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3355500 x1875771532523648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877066.731388:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877066.731391:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877066.731392:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877066.731396:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2049 00000100:00080000:1.0:1788877066.731398:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788877066.731402:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877066.731412:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c3355880 x1875771532523776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877066.731438:0:24072:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877066.731442:0:24072:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877066.731444:0:24072:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877066.731448:0:24072:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2049 00000100:00080000:1.0:1788877066.731450:0:24072:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788877066.731454:0:24072:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877066.731466:0:24072:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f800 x1875771532524160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877066.731564:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877066.732209:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532524032:0@lo:400:kworker.0 00000100:00100000:0.0:1788877066.732283:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732440:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532523392:0@lo:400:kworker.0 00000400:00000100:3.0:1788877066.732471:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532523392 offset 0 length 224: 4 00000100:00100000:3.0:1788877066.732520:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788877066.732528:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788877066.732570:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732647:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532523520:0@lo:38:kworker.0 00000100:00100000:3.0:1788877066.732681:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732703:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532523648:0@lo:38:kworker.0 00000100:00100000:3.0:1788877066.732725:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732742:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532523776:0@lo:38:kworker.0 00000100:00100000:3.0:1788877066.732762:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732786:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532524160:0@lo:38:kworker.0 00000100:00100000:3.0:1788877066.732809:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877066.732814:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788877066.732822:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532524288:0@lo:400:kworker.0 00000100:00100000:3.0:1788877066.732843:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523520 00000100:00100000:0.0:1788877066.732846:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877066.732850:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523520 00000100:00100000:0.0:1788877066.732877:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523904 00000100:00100000:0.0:1788877066.732881:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523904 00000100:00100000:3.0:1788877066.732889:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1788877066.732896:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532523520:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877066.732917:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877066.732922:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523648 00000100:00100000:0.0:1788877066.732925:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523648 00000100:00100000:0.0:1788877066.732935:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532523776 00000100:00100000:0.0:1788877066.732937:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532523776 00000100:00100000:0.0:1788877066.732944:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524160 00000100:00100000:0.0:1788877066.732946:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524160 00000100:00100000:0.0:1788877066.732953:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524288 00000100:00100000:0.0:1788877066.732956:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524288 00000100:00100000:3.0:1788877066.732961:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532523520:12345-0@lo:38:kworker.0 Request processed in 65us (280us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877066.732969:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1788877066.732971:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1788877066.732976:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532523904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877066.732993:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:3.0:1788877066.733000:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877066.733022:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1875771532523904:12345-0@lo:400:kworker.0 Request processed in 46us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877066.733029:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1788877066.733031:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532524288:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877066.733036:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1788877066.733044:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1788877066.733049:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532523648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877066.733058:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877066.733083:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532523648:12345-0@lo:38:kworker.0 Request processed in 33us (357us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877066.737006:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524032 00000100:00100000:2.0:1788877066.737027:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524032 00000100:00100000:2.0:1788877066.737277:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1788877066.737290:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532524032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877066.737402:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532524032:12345-0@lo:400:kworker.0 Request processed in 115us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877066.737410:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:3.0:1788877066.738926:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1788877066.738942:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532523776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877066.738978:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877066.739088:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532523776:12345-0@lo:38:kworker.0 Request processed in 148us (6324us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877066.739098:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1788877066.739143:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:3.0:1788877066.739149:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532524160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877066.739170:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877066.739205:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532524160:12345-0@lo:38:kworker.0 Request processed in 55us (6394us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877066.739211:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00080000:3.0:1788877066.739294:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877066.739301:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877066.739306:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532523520:0@lo:38:kworker.0 00000100:00080000:3.0:1788877066.739319:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877066.739322:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877066.739326:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532523648:0@lo:38:kworker.0 00000100:00080000:3.0:1788877066.739336:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877066.739339:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877066.739343:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532523776:0@lo:38:kworker.0 00000100:00080000:3.0:1788877066.739352:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877066.739356:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877066.739359:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532524160:0@lo:38:kworker.0 00000100:00080000:3.0:1788877066.739462:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788877066.739494:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1875771532523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788877066.739545:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532524288:0@lo:400:kworker.0 00000100:00100000:3.0:1788877066.739562:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532524032:0@lo:400:kworker.0 00000100:00100000:0.0:1788877066.739821:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1788877066.925705:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877066.925756:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877066.925796:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000400:00000100:0.0:1788877066.925820:0:3655:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511328640 offset 0 length 224: 4 00000100:00100000:0.0:1788877066.925848:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877066.925884:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329152 00000100:00100000:0.0:1788877066.925897:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329152 00000100:00100000:0.0:1788877066.925967:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329024 00000100:00100000:0.0:1788877066.925970:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329024 00000100:00100000:0.0:1788877066.925996:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1557 00000100:00100000:0.0:1788877066.926007:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511329152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877066.926099:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511329152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877066.926107:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1557 00000100:00100000:0.0:1788877066.926126:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1558 00000100:00100000:0.0:1788877066.926132:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877066.926158:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877066.926165:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1558 00000100:00100000:2.0:1788877066.926387:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328896 00000100:00100000:2.0:1788877066.926392:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328896 00000100:00100000:2.0:1788877066.926429:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511328768 00000100:00100000:2.0:1788877066.926432:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511328768 00000100:00100000:2.0:1788877066.926453:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2028 00000100:00100000:2.0:1788877066.926460:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511328896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877066.926493:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511328896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877066.926500:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2028 00000100:00100000:2.0:1788877066.926515:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2800 00000100:00100000:2.0:1788877066.926520:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f0786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511328768:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788877066.926559:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877066.926592:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f0786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511328768:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 70us (796us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877066.926598:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2800 00000100:00080000:3.0:1788877066.930988:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788877066.930997:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788877066.931001:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877067.560904:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877068.584993:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877069.608961:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877070.640384:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877070.825439:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788877070.825468:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c91f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532524416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877070.825583:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877070.825802:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524416 00000100:00100000:3.0:1788877070.825813:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524416 00000100:00100000:3.0:1788877070.825891:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1788877070.825902:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532524416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788877070.825940:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788877070.826006:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532524416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877070.826014:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00080000:1.0:1788877070.826074:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788877070.826103:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c91f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532524416:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788877071.657304:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788877071.848893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877071.848902:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877071.848906:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877071.848917:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2054 00000100:00080000:2.0:1788877071.848937:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877071.848946:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877071.848975:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1fb80 x1875771532524672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877071.848998:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877071.849003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877071.849004:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877071.849008:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2054 00000100:00080000:2.0:1788877071.849011:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877071.849014:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877071.849026:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1dc00 x1875771532524800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877071.849056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877071.849063:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877071.849065:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877071.849068:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2054 00000100:00080000:2.0:1788877071.849071:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877071.849075:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877071.849085:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1c380 x1875771532525056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877071.849106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877071.849109:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877071.849111:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877071.849114:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2054 00000100:00080000:2.0:1788877071.849117:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788877071.849120:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877071.849131:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1c700 x1875771532525440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877071.849183:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532524544:0@lo:400:kworker.0 00000400:00000100:0.0:1788877071.849247:0:3665:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532524544 offset 0 length 224: 4 00000100:00100000:0.0:1788877071.849302:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532525568:0@lo:400:kworker.0 00000100:00100000:0.0:1788877071.849337:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877071.849377:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788877071.849383:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532525312:0@lo:400:kworker.0 00000100:00100000:0.0:1788877071.849415:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877071.849423:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532524672:0@lo:38:kworker.0 00000100:00100000:0.0:1788877071.849466:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525312 00000100:00100000:1.0:1788877071.849468:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877071.849475:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525312 00000100:00100000:1.0:1788877071.849494:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532524800:0@lo:38:kworker.0 00000100:00100000:1.0:1788877071.849531:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877071.849551:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1788877071.849552:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532525056:0@lo:38:kworker.0 00000100:00100000:0.0:1788877071.849566:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532525312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877071.849579:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877071.849627:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532525440:0@lo:38:kworker.0 00000100:00100000:3.0:1788877071.849645:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532524928:0@lo:400:kworker.0 00000100:00100000:0.0:1788877071.849667:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532525312:12345-0@lo:400:kworker.0 Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877071.849667:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877071.849679:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1788877071.849692:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877071.849714:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525568 00000100:00100000:2.0:1788877071.849755:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524800 00000100:00100000:2.0:1788877071.849760:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524800 00000100:00100000:1.0:1788877071.849774:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525568 00000100:00100000:2.0:1788877071.849790:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525056 00000100:00100000:2.0:1788877071.849794:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525056 00000100:00100000:2.0:1788877071.849818:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525440 00000100:00100000:2.0:1788877071.849822:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525440 00000100:00100000:1.0:1788877071.849828:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1788877071.849838:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532525568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877071.849843:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:2.0:1788877071.849849:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532524800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877071.849871:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877071.849877:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532525568:12345-0@lo:400:kworker.0 Request processed in 41us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877071.849885:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1788877071.849902:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:1.0:1788877071.849908:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532525056:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788877071.849919:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877071.849931:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532524800:12345-0@lo:38:kworker.0 Request processed in 79us (398us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877071.849942:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1788877071.849948:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3661:x1875771532525056:12345-0@lo:38:kworker.0 Request processed in 37us (366us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877071.849956:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:2.0:1788877071.849962:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1788877071.849969:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532525440:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877071.849979:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788877071.849983:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877071.850012:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532525440:12345-0@lo:38:kworker.0 Request processed in 43us (349us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788877071.850014:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788877071.850022:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877071.850025:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:1.0:1788877071.850030:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532524800:0@lo:38:kworker.0 00000100:00080000:1.0:1788877071.850042:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788877071.850046:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788877071.850050:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532525056:0@lo:38:kworker.0 00000100:00080000:1.0:1788877071.850058:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788877071.850062:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788877071.850064:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532525440:0@lo:38:kworker.0 00000100:00100000:2.0:1788877071.850109:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524672 00000100:00100000:2.0:1788877071.850113:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524672 00000100:00100000:2.0:1788877071.850135:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788877071.850140:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532524672:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877071.850149:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877071.850183:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532524672:12345-0@lo:38:kworker.0 Request processed in 42us (716us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877071.850190:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788877071.850212:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532525184:0@lo:400:kworker.0 00000100:00100000:1.0:1788877071.850238:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532525312:0@lo:400:kworker.0 00000100:00100000:2.0:1788877071.850535:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877071.850575:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788877071.850587:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532525696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877071.850664:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877071.850687:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532525568:0@lo:400:kworker.0 00000100:00100000:2.0:1788877071.850702:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525184 00000100:00100000:2.0:1788877071.850707:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525184 00000100:00100000:0.0:1788877071.850822:0:43952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532524928 00000100:00100000:0.0:1788877071.850828:0:43952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532524928 00000100:00100000:3.0:1788877071.850880:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525696 00000100:00100000:3.0:1788877071.850890:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525696 00000100:00100000:3.0:1788877071.850945:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1788877071.850959:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532525696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877071.850996:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788877071.851055:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1875771532525696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877071.851061:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1788877071.851217:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532525696:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788877071.851284:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877071.851292:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877071.851298:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532524672:0@lo:38:kworker.0 00000100:00080000:1.0:1788877071.851435:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788877071.851442:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877071.851456:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:2.0:1788877071.851465:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532525184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877071.851507:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532525184:12345-0@lo:400:kworker.0 Request processed in 43us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877071.851526:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1788877071.851541:0:43952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1788877071.851552:0:43952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532524928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877071.851566:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532525184:0@lo:400:kworker.0 00000100:00100000:0.0:1788877071.851627:0:43952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532524928:12345-0@lo:400:kworker.0 Request processed in 54us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877071.851634:0:43952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:3.0:1788877071.851662:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532524928:0@lo:400:kworker.0 00000400:00000100:2.0:1788877072.046325:0:3657:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511329280 offset 0 length 224: 4 00000100:00100000:0.0:1788877072.052719:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877072.052767:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877072.052797:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877072.052832:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329536 00000100:00100000:2.0:1788877072.052844:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329536 00000100:00100000:2.0:1788877072.052925:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329408 00000100:00100000:2.0:1788877072.052929:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329408 00000100:00100000:2.0:1788877072.052952:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2031 00000100:00100000:0.0:1788877072.052958:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877072.052967:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511329536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1788877072.053015:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877072.053038:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2804 00000100:00100000:1.0:1788877072.053046:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511329408:12345-192.168.203.11@tcp:38:kworker.0 00000100:00100000:2.0:1788877072.053058:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2397:x1875771511329536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877072.053067:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2031 00010000:00020000:1.0:1788877072.053073:0:15659:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877072.053110:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2394:x1875771511329408:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 63us (341us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877072.053118:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2804 00000100:00100000:3.0:1788877072.056621:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329664 00000100:00100000:3.0:1788877072.056641:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329664 00000100:00080000:1.0:1788877072.056773:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788877072.056806:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511329792 00000100:00100000:2.0:1788877072.056813:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511329792 00000100:00080000:0.0:1788877072.056903:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877072.056982:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1561 00000100:00100000:3.0:1788877072.056995:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329664:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877072.057100:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329664:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 108us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877072.057108:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1561 00000100:00100000:3.0:1788877072.057219:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1562 00000100:00100000:3.0:1788877072.057226:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329792:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877072.057252:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2397:x1875771511329792:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877072.057258:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1562 00010000:00010000:2.0:1788877072.680826:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877073.705631:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877074.728986:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877075.752984:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877075.945994:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532525824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788877075.946087:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877075.946187:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532525824 00000100:00100000:1.0:1788877075.946196:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532525824 00000100:00100000:1.0:1788877075.946270:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1788877075.946280:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532525824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788877075.946315:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788877075.946662:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532525824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 382us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877075.946671:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00080000:1.0:1788877075.946699:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877075.946732:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532525824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788877076.776976:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788877076.968832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877076.968841:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877076.968845:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877076.968855:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2059 00000100:00080000:2.0:1788877076.968863:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877076.968871:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877076.968898:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1c000 x1875771532526080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877076.968921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877076.968925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877076.968927:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877076.968930:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2059 00000100:00080000:2.0:1788877076.968933:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877076.968936:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877076.968948:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1ea00 x1875771532526208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877076.968965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877076.968969:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877076.968970:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877076.968974:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2059 00000100:00080000:2.0:1788877076.968977:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877076.968980:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877076.968991:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1f100 x1875771532526464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788877076.969021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788877076.969024:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788877076.969026:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788877076.969029:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2059 00000100:00080000:2.0:1788877076.969032:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788877076.969035:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877076.969048:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fad1f800 x1875771532526848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877076.969089:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532526336:0@lo:400:kworker.0 00000100:00100000:0.0:1788877076.969231:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532525952:0@lo:400:kworker.0 00000400:00000100:0.0:1788877076.969271:0:3664:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532525952 offset 0 length 224: 4 00000100:00100000:0.0:1788877076.969325:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532526976:0@lo:400:kworker.0 00000100:00100000:0.0:1788877076.969361:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877076.969365:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532526720:0@lo:400:kworker.0 00000100:00100000:3.0:1788877076.969406:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.969447:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532526080:0@lo:38:kworker.0 00000100:00100000:2.0:1788877076.969484:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877076.969502:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788877076.969511:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532526592:0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.969523:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532526208:0@lo:38:kworker.0 00000100:00100000:3.0:1788877076.969542:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.969683:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526976 00000100:00100000:2.0:1788877076.969692:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526976 00000100:00100000:2.0:1788877076.969755:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526592 00000100:00100000:2.0:1788877076.969761:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526592 00000100:00100000:2.0:1788877076.969785:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1788877076.969795:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532526976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.969849:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532526976:12345-0@lo:400:kworker.0 Request processed in 55us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877076.969857:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1788877076.969874:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526720 00000100:00100000:2.0:1788877076.969879:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1788877076.969880:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526720 00000100:00100000:2.0:1788877076.969889:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532526592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.969923:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532526592:12345-0@lo:400:kworker.0 Request processed in 36us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877076.969928:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1788877076.969947:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526080 00000100:00100000:2.0:1788877076.969951:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526080 00000100:00100000:2.0:1788877076.969971:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1788877076.969976:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532526080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877076.969995:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877076.970025:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c5274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532526080:12345-0@lo:38:kworker.0 Request processed in 48us (541us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877076.970032:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1788877076.970054:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.970071:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532526464:0@lo:38:kworker.0 00000100:00100000:2.0:1788877076.970092:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.970108:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532526848:0@lo:38:kworker.0 00000100:00100000:2.0:1788877076.970126:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788877076.970229:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877076.970234:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877076.970239:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532526080:0@lo:38:kworker.0 00000100:00080000:2.0:1788877076.970266:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788877076.970279:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526208 00000100:00100000:2.0:1788877076.970283:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526208 00000100:00100000:2.0:1788877076.970302:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526464 00000100:00100000:2.0:1788877076.970305:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526464 00000100:00100000:2.0:1788877076.970312:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526848 00000100:00100000:2.0:1788877076.970314:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526848 00000100:00100000:2.0:1788877076.970323:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1788877076.970328:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877076.970338:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877076.970367:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526208:12345-0@lo:38:kworker.0 Request processed in 38us (313us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877076.970373:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1788877076.970388:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1788877076.970391:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877076.970399:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877076.970421:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526464:12345-0@lo:38:kworker.0 Request processed in 28us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877076.970426:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00100000:2.0:1788877076.970437:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1788877076.970440:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877076.970448:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877076.970469:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532526848:12345-0@lo:38:kworker.0 Request processed in 28us (342us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877076.970474:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00100000:2.0:1788877076.970534:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532526592:0@lo:400:kworker.0 00000100:00080000:2.0:1788877076.970557:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877076.970561:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877076.970564:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532526208:0@lo:38:kworker.0 00000100:00080000:2.0:1788877076.970573:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877076.970576:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877076.970579:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532526464:0@lo:38:kworker.0 00000100:00080000:2.0:1788877076.970586:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877076.970590:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877076.970592:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532526848:0@lo:38:kworker.0 00000100:00100000:2.0:1788877076.971253:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532526976:0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.971263:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788877076.971272:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532527104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877076.971304:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.971337:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527104 00000100:00100000:2.0:1788877076.971341:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527104 00000100:00100000:2.0:1788877076.971377:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1788877076.971384:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532527104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788877076.971407:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:2.0:1788877076.971444:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532527104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877076.971450:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00080000:2.0:1788877076.971468:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788877076.971508:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532527104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788877076.971530:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877076.971564:0:43954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532526336 00000100:00100000:2.0:1788877076.971567:0:43954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532526336 00000100:00100000:0.0:1788877076.973042:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1788877076.973052:0:43954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1788877076.973065:0:43954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532526336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877076.973168:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532526720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.973201:0:43954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532526336:12345-0@lo:400:kworker.0 Request processed in 139us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877076.973210:0:43954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1788877076.973235:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532526720:12345-0@lo:400:kworker.0 Request processed in 182us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877076.973245:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:2.0:1788877076.973270:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532526720:0@lo:400:kworker.0 00000100:00100000:2.0:1788877076.973310:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532526336:0@lo:400:kworker.0 00000400:00000100:2.0:1788877077.168234:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511329920 offset 0 length 224: 4 00000100:00100000:2.0:1788877077.168289:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877077.168693:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877077.168725:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877077.168796:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877077.168811:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330048 00000100:00100000:1.0:1788877077.168825:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330048 00000100:00100000:2.0:1788877077.168830:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330176 00000100:00100000:2.0:1788877077.168836:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330176 00000100:00100000:1.0:1788877077.168884:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2034 00000100:00100000:1.0:1788877077.168897:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511330176:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877077.168961:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2808 00000100:00100000:2.0:1788877077.168970:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511330048:12345-192.168.203.11@tcp:38:kworker.0 00000100:00100000:1.0:1788877077.168989:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511330176:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 94us (294us total) trans 0 rc 0/0 00010000:00020000:2.0:1788877077.168993:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788877077.169004:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2034 00000100:00100000:2.0:1788877077.169036:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875771511330048:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 65us (747us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877077.169116:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2808 00000100:00080000:1.0:1788877077.169137:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877077.169156:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330432 00000100:00100000:1.0:1788877077.169160:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330432 00000100:00100000:1.0:1788877077.169196:0:43961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330304 00000100:00100000:1.0:1788877077.169199:0:43961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330304 00000100:00100000:1.0:1788877077.169224:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1565 00000100:00100000:1.0:1788877077.169231:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511330432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877077.169266:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511330432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877077.169273:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1565 00000100:00100000:1.0:1788877077.169287:0:43961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1566 00000100:00100000:1.0:1788877077.169294:0:43961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511330304:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1788877077.169321:0:43961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511330304:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877077.169326:0:43961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1566 00000100:00080000:2.0:1788877077.169913:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788877077.169920:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788877077.801324:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788877077.996129:0:3663:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788877061/real 1788877061] req@ffff8a13f0786680 x1875771532521600/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877077.996166:0:3663:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a13f0786680 x1875771532521600/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788877077.996176:0:3663:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788877077.996180:0:3663:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788877077.996183:0:3663:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788877077.996185:0:3663:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788877077.996189:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13f0786680 x1875771532521600/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1788877077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877077.996198:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a12c3354700 x1875771532523392/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877082 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877077.996207:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fad1ca80 x1875771532524544/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788877077.996227:0:3663:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a13fad1dc00 x1875771532525952/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788877092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788877077.996237:0:3663:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788877077.996240:0:3663:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788877077.996243:0:3663:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788877077.996245:0:3663:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1788877077.996275:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532521600:0@lo:400:kworker.0 00000100:00100000:0.0:1788877077.996296:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532525952:0@lo:400:kworker.0 00000100:00080000:1.0:1788877077.996306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788877077.996312:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3664:1875771532523392:0@lo:400:kworker.0 00000100:00080000:1.0:1788877077.996314:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788877077.996320:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877077.996341:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 2008 00000100:00080000:1.0:1788877077.996352:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877077.996394:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f480 x1875771532527232/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877077.996421:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877077.996428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877077.996430:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877077.996433:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2064 00000100:00080000:1.0:1788877077.996436:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877077.996441:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877077.996460:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c700 x1875771532527360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877077.996470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877077.996474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877077.996476:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877077.996490:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2064 00000100:00080000:1.0:1788877077.996494:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877077.996498:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788877077.996512:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532524544:0@lo:400:kworker.0 00000100:00100000:1.0:1788877077.996514:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c380 x1875771532527488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788877077.996522:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532527232:0@lo:250:kworker.0 00000100:00080000:1.0:1788877077.996564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788877077.996569:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532527616:0@lo:400:kworker.0 00000100:00080000:1.0:1788877077.996570:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877077.996575:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877077.996581:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2064 00000100:00080000:1.0:1788877077.996586:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000400:00000100:2.0:1788877077.996586:0:3661:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875771532527232 offset 0 length 520: 4 00000100:00080000:1.0:1788877077.996592:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877077.996629:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c000 x1875771532527744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788877077.996642:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877077.996652:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532527360:0@lo:38:kworker.0 00000100:00080000:1.0:1788877077.996668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788877077.996671:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788877077.996675:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877077.996679:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788877077.996680:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788877077.996681:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788877077.996688:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2064 00000100:00080000:1.0:1788877077.996693:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877077.996699:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1788877077.996712:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532527488:0@lo:38:kworker.0 00000100:00100000:1.0:1788877077.996713:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606ca80 x1875771532528128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788877077.996718:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877077.996742:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877077.996751:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532528256:0@lo:400:kworker.0 00000100:00100000:2.0:1788877077.996760:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532527744:0@lo:38:kworker.0 00000100:00100000:3.0:1788877077.996775:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877077.996803:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788877077.996810:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532528000:0@lo:400:kworker.0 00000100:00100000:3.0:1788877077.996833:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877077.996860:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527872 00000100:00100000:2.0:1788877077.996863:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527616 00000100:00100000:1.0:1788877077.996870:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527872 00000100:00100000:2.0:1788877077.996871:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527616 00000100:00100000:3.0:1788877077.996890:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527488 00000100:00100000:3.0:1788877077.996893:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527488 00000100:00100000:3.0:1788877077.996939:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528256 00000100:00100000:3.0:1788877077.996942:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528256 00000100:00100000:3.0:1788877077.996973:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:2.0:1788877077.996977:0:43955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528000 00000100:00100000:2.0:1788877077.996980:0:43955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528000 00000100:00100000:1.0:1788877077.997008:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:2.0:1788877077.997019:0:43955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1788877077.997021:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532527872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877077.997031:0:43955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532527616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877077.997035:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532528256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877077.997079:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1875771532528256:12345-0@lo:400:kworker.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877077.997080:0:43955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532527616:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877077.997087:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1788877077.997105:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1788877077.997108:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532527488:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877077.997131:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877077.997158:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532527488:12345-0@lo:38:kworker.0 Request processed in 48us (417us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877077.997165:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:1.0:1788877077.997184:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875771532527872:12345-0@lo:400:kworker.0 Request processed in 166us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877077.997185:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527360 00000100:00100000:3.0:1788877077.997190:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527360 00000100:00100000:1.0:1788877077.997196:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1788877077.997219:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788877077.997225:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532527360:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788877077.997233:0:6544:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877077.997258:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532527360:12345-0@lo:38:kworker.0 Request processed in 33us (578us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877077.997263:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1788877077.997298:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1875771532528256:0@lo:400:kworker.0 00000100:00100000:0.0:1788877077.998076:0:43959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788877077.998101:0:43955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00080000:2.0:1788877077.998131:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877077.998172:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1875771532527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788877077.998185:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532527616:0@lo:400:kworker.0 00000100:00100000:0.0:1788877077.998247:0:43959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532528000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877077.998315:0:43959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532528000:12345-0@lo:400:kworker.0 Request processed in 76us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877077.998322:0:43959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788877077.998404:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532528000:0@lo:400:kworker.0 00000100:00100000:0.0:1788877077.998615:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788877077.998662:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877077.998668:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877077.998671:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532527360:0@lo:38:kworker.0 00000100:00100000:0.0:1788877077.998693:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532528128:0@lo:38:kworker.0 00000100:00100000:0.0:1788877077.998726:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788877077.998759:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877077.998764:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788877077.998767:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532527488:0@lo:38:kworker.0 00000100:00100000:0.0:1788877077.998793:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532527744 00000100:00100000:1.0:1788877077.998915:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528128 00000100:00100000:1.0:1788877077.998921:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528128 00000100:00100000:1.0:1788877077.998956:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:1.0:1788877077.998965:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532528128:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788877077.999042:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532527744 00000100:00100000:0.0:1788877077.999108:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:0.0:1788877077.999113:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532527744:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877077.999133:0:6540:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:1.0:1788877077.999153:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877077.999189:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1875771532527744:12345-0@lo:38:kworker.0 Request processed in 72us (584us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788877077.999197:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532528128:12345-0@lo:38:kworker.0 Request processed in 232us (468us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877077.999198:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:1.0:1788877077.999210:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00080000:2.0:1788877077.999264:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877077.999270:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877077.999274:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532528128:0@lo:38:kworker.0 00000100:00080000:2.0:1788877077.999283:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877077.999287:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877077.999290:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532527744:0@lo:38:kworker.0 00000400:00000100:2.0:1788877078.061990:0:3656:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.11@tcp portal 26 match 1875771511330560 offset 0 length 520: 4 00000100:00100000:2.0:1788877078.062456:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877078.063520:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877078.067048:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877078.067163:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877078.067199:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331072 00000100:00100000:2.0:1788877078.067210:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331072 00000100:00100000:2.0:1788877078.067270:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330944 00000100:00100000:2.0:1788877078.067273:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330944 00000100:00100000:2.0:1788877078.067300:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1569 00000100:00100000:3.0:1788877078.067405:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330688 00000100:00100000:3.0:1788877078.067411:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330688 00000100:00100000:3.0:1788877078.067444:0:8722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511330816 00000100:00100000:3.0:1788877078.067447:0:8722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511330816 00000100:00100000:3.0:1788877078.067472:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2037 00000100:00100000:3.0:1788877078.067493:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511330816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877078.067533:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511331072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877078.067627:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511331072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 97us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877078.067636:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1569 00000100:00100000:3.0:1788877078.067810:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2396:x1875771511330816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 330us (4294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877078.067818:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2037 00000100:00100000:3.0:1788877078.067839:0:8722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2812 00000100:00100000:3.0:1788877078.067844:0:8722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511330688:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:3.0:1788877078.067868:0:8722:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877078.067899:0:8722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875771511330688:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 53us (5445us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788877078.067905:0:8722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2812 00000100:00100000:3.0:1788877078.067934:0:43964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1570 00000100:00100000:3.0:1788877078.067942:0:43964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511330944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877078.067968:0:43964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511330944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877078.067975:0:43964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1570 00010000:00010000:2.0:1788877078.825780:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788877079.712906:0:56910:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788877079.712913:0:56910:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788877079.712915:0:56910:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788877079.713037:0:56910:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a13c5ffc800 00000020:01000004:1.0:1788877079.713056:0:56910:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788877079.713072:0:56910:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788877079.713090:0:56910:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a12c45eb380) 00000020:00000080:1.0:1788877079.713110:0:56910:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788877079.777303:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788877079.780497:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788877079.781795:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.782247:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.782425:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.782666:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.782896:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.783120:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.783334:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.783569:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.783891:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788877079.784087:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.784597:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.785003:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.785901:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.786282:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.786465:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.786763:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.786946:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.787130:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.787365:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.787563:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.787907:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.788132:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.788410:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.788640:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.788832:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.789015:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.789225:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.789411:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.789667:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.789879:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.790072:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.790264:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.790449:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.790756:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.790999:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.791230:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.791432:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.791675:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.791888:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.792091:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.792302:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.792515:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788877079.792816:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.793002:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.793262:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788877079.795416:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.795941:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.796178:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.796596:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.796909:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788877079.797105:0:56910:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:0.0:1788877079.798019:0:56910:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788877079.798299:0:56910:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788877079.798309:0:56910:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788877079.798323:0:56910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0b12 00000020:01000004:0.0:1788877079.798331:0:56910:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788877079.798346:0:56910:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788877079.798353:0:56910:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13c5ffc800 from MGS 00000020:01000004:0.0:1788877079.798357:0:56910:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788877079.798368:0:56910:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a12c4e319c0) 00000020:00000080:0.0:1788877079.798381:0:56910:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788877079.798461:0:56910:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c5ffc800 from MGS, refs=2 00080000:01000000:0.0:1788877079.798467:0:56910:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788877079.798482:0:56910:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0b20 00010000:00010000:0.0:1788877079.798727:0:56910:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1788877079.802898:0:56910:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788877079.803781:0:56914:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788877079.803840:0:56910:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788877079.803883:0:56910:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788877079.804500:0:56910:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788877079.804840:0:56910:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788877079.805008:0:56910:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788877079.805016:0:56910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788877079.805929:0:56910:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788877079.805938:0:56910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788877079.806345:0:56910:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788877079.806352:0:56910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788877079.807016:0:56910:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788877079.807042:0:56910:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1788877079.807045:0:56910:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1788877079.807049:0:56910:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1788877079.807055:0:56910:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 51, was 0): CONNECTING 00000100:00100000:0.0:1788877079.807062:0:56910:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:2.0:1788877079.851733:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877080.874760:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877081.067640:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532528384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788877081.067730:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877081.067866:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528384 00000100:00100000:1.0:1788877081.067886:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528384 00000100:00100000:1.0:1788877081.067952:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788877081.067963:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532528384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788877081.067998:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788877081.068051:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532528384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877081.068058:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:2.0:1788877081.068202:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877081.068244:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532528384:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788877081.897520:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877082.088905:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532528512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877082.089014:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877082.089522:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528512 00000100:00100000:3.0:1788877082.089533:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528512 00000100:00100000:3.0:1788877082.089649:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00080000:2.0:1788877082.089692:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877082.089725:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532528512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788877082.089763:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788877082.094065:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532528512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4393us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877082.094083:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1788877082.094084:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532528512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788877082.924091:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788877083.112737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877083.112750:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788877083.112754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877083.112759:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877083.112764:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877083.112775:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2065 00000100:00080000:1.0:1788877083.112782:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877083.112791:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877083.112846:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606ce00 x1875771532528640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877083.112876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877083.112880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877083.112881:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877083.112885:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2065 00000100:00080000:1.0:1788877083.112887:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877083.112891:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877083.112902:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f800 x1875771532528768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877083.112956:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877083.112960:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877083.112962:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877083.112966:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2065 00000100:00080000:1.0:1788877083.112968:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877083.112972:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877083.112983:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c000 x1875771532529024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788877083.113020:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877083.113023:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877083.113025:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877083.113028:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2065 00000100:00080000:1.0:1788877083.113031:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877083.113034:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877083.113044:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c700 x1875771532529408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788877083.113076:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532529280:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.113185:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877083.113269:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788877083.113275:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.113303:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877083.113371:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529280 00000100:00100000:2.0:1788877083.113377:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532528640:0@lo:38:kworker.0 00000100:00100000:1.0:1788877083.113382:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529280 00000100:00100000:2.0:1788877083.113421:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877083.113451:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1788877083.113468:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532528768:0@lo:38:kworker.0 00000100:00100000:1.0:1788877083.113475:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532529280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788877083.113499:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877083.113527:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532528896:0@lo:400:kworker.0 00000100:00100000:2.0:1788877083.113529:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532529024:0@lo:38:kworker.0 00000100:00100000:1.0:1788877083.113547:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875771532529280:12345-0@lo:400:kworker.0 Request processed in 75us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877083.113556:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1788877083.113570:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877083.113580:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877083.113595:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532529408:0@lo:38:kworker.0 00000100:00100000:3.0:1788877083.113664:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532529152:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.114269:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1875771532529280:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.114336:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529536 00000100:00100000:1.0:1788877083.114342:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529536 00000100:00100000:1.0:1788877083.114384:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528768 00000100:00100000:1.0:1788877083.114387:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528768 00000100:00100000:1.0:1788877083.114402:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529024 00000100:00100000:1.0:1788877083.114404:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529024 00000100:00100000:1.0:1788877083.114420:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1788877083.114428:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532529536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877083.116677:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1788877083.116692:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532528768:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877083.116721:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877083.116797:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532528768:12345-0@lo:38:kworker.0 Request processed in 106us (3297us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877083.116804:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1788877083.116831:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1788877083.116836:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532529024:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877083.116845:0:51736:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877083.116869:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3661:x1875771532529024:12345-0@lo:38:kworker.0 Request processed in 32us (3300us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877083.116875:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1788877083.116922:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528640 00000100:00100000:0.0:1788877083.116931:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528640 00000100:00100000:0.0:1788877083.116968:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1788877083.116973:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532528640:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877083.116985:0:13623:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877083.117014:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3661:x1875771532528640:12345-0@lo:38:kworker.0 Request processed in 41us (3594us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877083.117021:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:0.0:1788877083.117037:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788877083.117045:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788877083.117069:0:43966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532528896 00000100:00100000:0.0:1788877083.117073:0:43966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532528896 00000100:00100000:0.0:1788877083.117107:0:43966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1788877083.117114:0:43966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532528896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877083.117158:0:43966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532528896:12345-0@lo:400:kworker.0 Request processed in 45us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877083.117165:0:43966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1788877083.117208:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532528896:0@lo:400:kworker.0 00000100:00100000:3.0:1788877083.117533:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877083.117638:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877083.117969:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529152 00000100:00100000:3.0:1788877083.117975:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529152 00000100:00100000:3.0:1788877083.118022:0:15659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529408 00000100:00100000:3.0:1788877083.118025:0:15659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529408 00000100:00100000:3.0:1788877083.118043:0:15659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:3.0:1788877083.118051:0:15659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532529152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788877083.118097:0:15659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1875771532529152:12345-0@lo:400:kworker.0 Request processed in 48us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877083.118105:0:15659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00080000:2.0:1788877083.118180:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877083.118186:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877083.118190:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532528640:0@lo:38:kworker.0 00000100:00080000:2.0:1788877083.118204:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877083.118208:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877083.118211:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532528768:0@lo:38:kworker.0 00000100:00080000:2.0:1788877083.118221:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877083.118224:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877083.118227:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532529024:0@lo:38:kworker.0 00000100:00100000:2.0:1788877083.118275:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:2.0:1788877083.118281:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532529408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788877083.118298:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877083.118336:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3661:x1875771532529408:12345-0@lo:38:kworker.0 Request processed in 53us (699us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877083.118343:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:2.0:1788877083.118364:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788877083.118379:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788877083.118383:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788877083.118386:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532529408:0@lo:38:kworker.0 00000100:00100000:2.0:1788877083.118422:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1875771532529152:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.118550:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875771532529536:12345-0@lo:400:kworker.0 Request processed in 4120us (5244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877083.118583:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1875771532529536:0@lo:400:kworker.0 00000100:00100000:1.0:1788877083.118746:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1788877083.311735:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877083.311822:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877083.311857:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877083.311915:0:43962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331456 00000100:00100000:2.0:1788877083.311928:0:43962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331456 00000100:00100000:2.0:1788877083.312011:0:43962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1573 00000100:00100000:2.0:1788877083.312024:0:43962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511331456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877083.312112:0:43962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511331456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877083.312120:0:43962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1573 00000100:00080000:3.0:1788877083.312392:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788877083.312642:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877083.312709:0:43963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331584 00000100:00100000:3.0:1788877083.312714:0:43963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331584 00000100:00100000:3.0:1788877083.312773:0:43963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1574 00000100:00100000:3.0:1788877083.312782:0:43963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511331584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1788877083.312833:0:43963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2398:x1875771511331584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877083.312840:0:43963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1574 00000100:00100000:0.0:1788877083.312956:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331200 00000100:00100000:0.0:1788877083.312961:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331200 00000100:00080000:1.0:1788877083.313004:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877083.313083:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331328 00000100:00100000:2.0:1788877083.313088:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331328 00000100:00100000:2.0:1788877083.313166:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2040 00000100:00100000:2.0:1788877083.313174:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511331328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877083.313215:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2398:x1875771511331328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877083.313225:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2040 00000100:00100000:2.0:1788877083.313237:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2816 00000100:00100000:2.0:1788877083.313242:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511331200:12345-192.168.203.11@tcp:38:kworker.0 00010000:00020000:2.0:1788877083.313267:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.11@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788877083.313292:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c606c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875771511331200:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 48us (1574us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788877083.313298:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2816 00000100:00080000:1.0:1788877083.314249:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788877083.945157:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877084.968877:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788877085.995193:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788877086.186642:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532529664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788877086.186747:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877086.186805:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529664 00000100:00100000:2.0:1788877086.186816:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529664 00000100:00100000:2.0:1788877086.186886:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1788877086.186898:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532529664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788877086.186932:0:8458:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788877086.187019:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877086.194686:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532529664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7776us (7925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877086.194703:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1788877086.194984:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532529664:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788877087.016809:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877087.210186:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532529792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877087.210285:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.210461:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529792 00000100:00100000:2.0:1788877087.210476:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529792 00000100:00100000:0.0:1788877087.210494:0:3661:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788877077/real 1788877077] req@ffff8a12c606f480 x1875771532527232/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788877087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788877087.210525:0:3661:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a12c606f480 x1875771532527232/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788877087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788877087.210542:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877087.210561:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788877087.210569:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1788877087.210582:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c91f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532529792:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788877087.210586:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532527232:0@lo:250:kworker.0 10000000:01000000:0.0:1788877087.210639:0:56910:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00002000:00000024:2.0:1788877087.210652:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00010000:00010000:0.0:1788877087.210658:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210671:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210679:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788877087.210693:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210705:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca9000/0xf5bf0f7e313b06a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b06ab expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877087.210715:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c91f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1875771532529792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (434us total) trans 0 rc 0/0 00010000:00010000:0.0:1788877087.210726:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877087.210730:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 10000000:00010000:0.0:1788877087.210739:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210745:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877087.210749:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210755:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8400/0xf5bf0f7e313b0618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b061f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.210768:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210775:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210780:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877087.210790:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210795:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efefec00/0xf5bf0f7e313b0626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b062d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.210805:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210813:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210819:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877087.210836:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210841:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73c00/0xf5bf0f7e313b0642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0649 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.210851:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788877087.210855:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:00010000:0.0:1788877087.210861:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210868:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877087.210872:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210877:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72400/0xf5bf0f7e313b0650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0657 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.210886:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210893:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210904:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788877087.210907:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1875771532529792:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788877087.210910:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210916:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef72a00/0xf5bf0f7e313b066c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0673 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.210928:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210934:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.210934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1f425f51-afcc-4e8f-8e95-ef22cb326ef4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 10000000:01000000:0.0:1788877087.210940:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1788877087.210940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788877087.210943:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1788877087.210944:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210947:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8600/0xf5bf0f7e313b0688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b068f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.210949:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 2065 00000100:00080000:1.0:1788877087.210954:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00010000:00010000:0.0:1788877087.210957:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.210960:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.111@tcp: import ffff8a13c4869000 using connection 192.168.203.111@tcp/0@lo 10000000:00010000:0.0:1788877087.210964:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.210969:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788877087.210972:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.210975:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca9400/0xf5bf0f7e313b06c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b06c7 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877087.210981:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606c000 x1875771532529920/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788877087.210987:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.210998:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.211003:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:1.0:1788877087.211005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:0.0:1788877087.211007:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1788877087.211009:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:0.0:1788877087.211010:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13eef73200/0xf5bf0f7e313b067a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0681 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211010:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877087.211014:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2071 00000100:00080000:1.0:1788877087.211017:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877087.211021:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a13d1512800 using connection 192.168.203.111@tcp/0@lo 00010000:00010000:0.0:1788877087.211023:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.211028:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.211034:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:1.0:1788877087.211035:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606f800 x1875771532530048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788877087.211037:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.211041:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8a00/0xf5bf0f7e313b0696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b069d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877087.211048:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877087.211050:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1788877087.211052:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211053:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2071 00000100:00080000:1.0:1788877087.211055:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877087.211058:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a13d1582000 using connection 192.168.203.111@tcp/0@lo 10000000:00010000:0.0:1788877087.211059:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.211064:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877087.211068:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1788877087.211069:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606ce00 x1875771532530176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788877087.211072:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca8000/0xf5bf0f7e313b0634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b063b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211079:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877087.211083:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877087.211084:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:0.0:1788877087.211086:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211087:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2071 00000100:00080000:1.0:1788877087.211090:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 10000000:00010000:0.0:1788877087.211093:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211094:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a13f5232000 using connection 192.168.203.111@tcp/0@lo 10000000:01000000:0.0:1788877087.211099:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877087.211102:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1788877087.211103:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c606df80 x1875771532530304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788877087.211104:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b065e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b0665 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.211114:0:56910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788877087.211121:0:56910:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.211125:0:56910:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788877087.211129:0:56910:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1788877087.211132:0:56910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13efca9e00/0xf5bf0f7e313b06b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xf5bf0f7e313b06b9 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788877087.211134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788877087.211138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788877087.211140:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788877087.211143:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2071 00000100:00080000:1.0:1788877087.211145:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788877087.211148:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a13f5398000 using connection 192.168.203.111@tcp/0@lo 00000100:00080000:0.0:1788877087.211149:0:56910:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a13c4869000 already not connected (conn 52, was 0): CONNECTING 00000100:00080000:0.0:1788877087.211153:0:56910:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1788877087.211159:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c261d500 x1875771532530688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877087.211180:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532530560:0@lo:400:kworker.0 00000100:00100000:0.0:1788877087.211215:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.211245:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788877087.211251:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532530432:0@lo:400:kworker.0 00000100:00100000:1.0:1788877087.211258:0:10319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530560 00000100:00100000:1.0:1788877087.211262:0:10319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530560 00000100:00100000:0.0:1788877087.211278:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.211292:0:10319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788877087.211298:0:10319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532530560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877087.211307:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530432 00000100:00100000:0.0:1788877087.211310:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530432 00000100:00100000:1.0:1788877087.211339:0:10319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532530560:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.211342:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1788877087.211346:0:10319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:0.0:1788877087.211349:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532530432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788877087.211366:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788877087.211380:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1875771532530432:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.211386:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1788877087.211389:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.211467:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532529920:0@lo:250:kworker.0 00000100:00100000:2.0:1788877087.211468:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1875771532530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788877087.211478:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532530560:0@lo:400:kworker.0 00000100:00100000:3.0:1788877087.211494:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.211519:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532530048:0@lo:38:kworker.0 00000100:00100000:3.0:1788877087.211545:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.211562:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532530176:0@lo:38:kworker.0 00000100:00100000:3.0:1788877087.211583:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.211639:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530816 00000100:00100000:0.0:1788877087.211644:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530816 00000100:00100000:0.0:1788877087.211667:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1788877087.211673:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532530816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788877087.211705:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1875771532530816:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.211711:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1788877087.211753:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1875771532530816:0@lo:400:kworker.0 00000100:00100000:0.0:1788877087.211780:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530048 00000100:00100000:0.0:1788877087.211785:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530048 00000100:00100000:0.0:1788877087.211804:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1788877087.211809:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532530048:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877087.211829:0:6545:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877087.211858:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3661:x1875771532530048:12345-0@lo:38:kworker.0 Request processed in 47us (312us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877087.211864:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:0.0:1788877087.211892:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788877087.211914:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532529920 00000100:00100000:0.0:1788877087.211918:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532529920 00000100:00100000:0.0:1788877087.211936:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788877087.211940:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3661:x1875771532529920:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1788877087.211956:0:56915:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1f425f51-afcc-4e8f-8e95-ef22cb326ef4@0@lo t0 exp 0000000000000000 cur 2075 last 0 00000020:00000080:0.0:1788877087.211987:0:56915:0:(genops.c:1385:class_connect()) connect: client 1f425f51-afcc-4e8f-8e95-ef22cb326ef4, cookie 0xf5bf0f7e313b0b27 00000100:00080000:0.0:1788877087.212183:0:56915:0:(import.c:65:import_set_state_nolock()) ffff8a13f07ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788877087.212216:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+5:3661:x1875771532529920:12345-0@lo:250:kworker.0 Request processed in 274us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.212223:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788877087.214718:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530176 00000100:00100000:3.0:1788877087.214728:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532530304:0@lo:38:kworker.0 00000100:00100000:0.0:1788877087.214734:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530176 00000100:00100000:3.0:1788877087.214792:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.214798:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:0.0:1788877087.214807:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530176:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788877087.214824:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532530688:0@lo:38:kworker.0 00010000:00020000:0.0:1788877087.214833:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788877087.214850:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.214882:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530176:12345-0@lo:38:kworker.0 Request processed in 74us (3297us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877087.214890:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00080000:3.0:1788877087.214900:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00100000:0.0:1788877087.214905:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530304 00000100:00100000:0.0:1788877087.214910:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530304 10000000:01000000:3.0:1788877087.214914:0:3661:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:3.0:1788877087.214919:0:3661:0:(import.c:1328:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xf5bf0f7e313b0b27 00000100:00100000:0.0:1788877087.214924:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530688 00000100:00100000:0.0:1788877087.214928:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530688 00000100:00100000:0.0:1788877087.214941:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788877087.214946:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877087.214955:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877087.214977:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530304:12345-0@lo:38:kworker.0 Request processed in 30us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877087.214982:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1788877087.214994:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1788877087.214997:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788877087.215005:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788877087.215028:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532530688:12345-0@lo:38:kworker.0 Request processed in 29us (178us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788877087.215033:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00080000:3.0:1788877087.219023:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:3.0:1788877087.219039:0:3661:0:(import.c:1718:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:3.0:1788877087.221787:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3661:1875771532529920:0@lo:250:kworker.0 00000100:00080000:0.0:1788877087.221808:0:56920:0:(import.c:1642:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.111@tcp to MGS@0@lo 00000100:00100000:0.0:1788877087.221815:0:56920:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788877087.221820:0:56920:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1788877087.221836:0:56920:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:3.0:1788877087.221842:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1512800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788877087.221843:0:56920:0:(import.c:65:import_set_state_nolock()) ffff8a13c4869000 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1788877087.221845:0:56920:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788877087.221875:0:56920:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1788877087.221878:0:56920:0:(import.c:1787:ptlrpc_import_recovery_state_machine()) MGC192.168.203.111@tcp: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1788877087.221945:0:56910:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1788877087.221977:0:56910:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:0.0:1788877087.222011:0:8:0:(tgt_mount.c:1629:tgt_import_update()) NID #0: 192.168.203.111@tcp 10000000:01000000:0.0:1788877087.222030:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1788877087.222034:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1788877087.222036:0:56910:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788877087.222037:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788877087.222040:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.222043:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 10000000:01000000:1.0:1788877087.222044:0:56910:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:0.0:1788877087.222045:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.222048:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.222051:0:8:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788877087.222053:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.222054:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788877087.222101:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788877087.222111:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1788877087.222113:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788877087.222114:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788877087.222115:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.222117:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877087.222118:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.222119:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.222121:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788877087.222123:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.222124:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788877087.222143:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1788877087.222148:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1788877087.222151:0:8:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1788877087.222153:0:8:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788877087.222154:0:8:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.222155:0:8:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877087.222157:0:8:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.222158:0:8:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.222159:0:8:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788877087.222160:0:8:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.222161:0:8:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1788877087.222176:0:8:0:(tgt_mount.c:1640:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000040:01000000:1.0:1788877087.222202:0:56910:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000100:00100000:0.0:1788877087.222211:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532530944:0@lo:253:kworker.0 00000020:01000004:1.0:1788877087.222238:0:56910:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788877087.222243:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788877087.222245:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877087.222246:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877087.222247:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877087.222248:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877087.222250:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877087.222251:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877087.222253:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877087.222254:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877087.222256:0:56910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788877087.222259:0:56910:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788877087.222262:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788877087.222263:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877087.222264:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877087.222265:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877087.222266:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877087.222267:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877087.222269:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877087.222270:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877087.222275:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877087.222276:0:56910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788877087.222295:0:56910:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788877087.222311:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531328:0@lo:253:mount.lustre.0 00000100:00080000:3.0:1788877087.222356:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877087.222364:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3661:1875771532530048:0@lo:38:kworker.0 00000100:00100000:2.0:1788877087.222371:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532531072:0@lo:253:kworker.0 00000100:00100000:0.0:1788877087.222410:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.222766:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.222803:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f4240f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788877087.222920:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532530944 00000100:00100000:1.0:1788877087.222928:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532530944 00000100:00100000:1.0:1788877087.222974:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531328 00000100:00100000:1.0:1788877087.222978:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531328 00000100:00100000:1.0:1788877087.222996:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788877087.223005:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:3665:x1875771532530944:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788877087.223039:0:56915:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1788877087.223080:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788877087.223088:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+6:56910:x1875771532531328:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788877087.223138:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532531200:0@lo:253:kworker.0 00000100:00100000:1.0:1788877087.223178:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.223212:0:56917:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1788877087.223221:0:56917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1788877087.223346:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531200 00000100:00100000:1.0:1788877087.223350:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531200 00000100:00100000:1.0:1788877087.223429:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788877087.224003:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d1582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877087.224010:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877087.224018:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875771532530176:0@lo:38:kworker.0 00000100:00080000:3.0:1788877087.224034:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5232000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877087.224037:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877087.224040:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c606df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3661:1875771532530304:0@lo:38:kworker.0 00000100:00080000:3.0:1788877087.224055:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f5398000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877087.224059:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788877087.224062:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3661:1875771532530688:0@lo:38:kworker.0 00000100:00100000:2.0:1788877087.224258:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.224300:0:56917:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 4 min 3 max 32 00000100:00100000:0.0:1788877087.224309:0:56917:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0004' 10000000:01000000:0.0:1788877087.224335:0:56921:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788877087.224453:0:56915:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 91 00000100:00100000:1.0:1788877087.225111:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+7:3663:x1875771532531200:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1788877087.225143:0:56922:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1788877087.226639:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531072 00000100:00100000:1.0:1788877087.226650:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531072 00000100:00100000:0.0:1788877087.226813:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788877087.226922:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3662:x1875771532531072:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1788877087.226950:0:56923:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788877087.228405:0:56924:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788877087.228413:0:56924:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788877087.228416:0:56924:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788877087.228419:0:56924:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788877087.228814:0:56924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788877087.229202:0:56915:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788877087.229231:0:56915:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788877087.229417:0:56916:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788877087.229447:0:56916:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788877087.229453:0:56916:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1788877087.229463:0:56916:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788877087.236900:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:56910:x1875771532531328:12345-0@lo:253:mount.lustre.0 Request processed in 13799us (14121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.236918:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788877087.237097:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788877087.237116:0:56910:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788877087.237120:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788877087.237122:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788877087.237123:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877087.237125:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877087.237126:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877087.237127:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877087.237129:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877087.237131:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788877087.237133:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877087.237134:0:56910:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788877087.237172:0:56910:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a13c5ffc800 from lustre-MDT0000 10000000:01000000:1.0:1788877087.237207:0:56910:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788877087.237211:0:56910:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788877087.237220:0:56910:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a13c5ffc800 10000000:01000000:1.0:1788877087.237225:0:56910:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788877087.237231:0:56910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a13c5ffc800 10000000:01000000:1.0:1788877087.237235:0:56910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788877087.237238:0:56910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5ffc800 from 1 10000000:01000000:1.0:1788877087.237242:0:56910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788877087.237285:0:56910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.237298:0:56910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.237309:0:56910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877087.237330:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788877087.237372:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.237418:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.237532:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531456 00000100:00100000:0.0:1788877087.237539:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531456 00000100:00100000:0.0:1788877087.237589:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788877087.237598:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:56910:x1875771532531456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877087.237637:0:56917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877087.237665:0:56917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefec00/0xf5bf0f7e313b0b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0b2e expref: -99 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.237694:0:56917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefec00/0xf5bf0f7e313b0b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0b2e expref: 9 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.237706:0:56917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefec00/0xf5bf0f7e313b0b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0b2e expref: 9 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.237717:0:56917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefec00, rc 0) 00000100:00100000:0.0:1788877087.237747:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532531456:12345-0@lo:101:mount.lustre.0 Request processed in 150us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.237753:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788877087.237877:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877087.237891:0:56910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b35 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.237901:0:56910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0b35 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877087.237916:0:56910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788877087.237935:0:56910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b35 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.237944:0:56910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34200/0xf5bf0f7e313b0b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b35 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877087.237952:0:56910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788877087.237956:0:56910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788877087.237960:0:56910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a13c5ffc800 10000000:01000000:2.0:1788877087.237962:0:56910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788877087.237965:0:56910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788877087.237967:0:56910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788877087.237983:0:56910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.237991:0:56910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.237999:0:56910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877087.238010:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788877087.238038:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.238056:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.238146:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531584 00000100:00100000:0.0:1788877087.238159:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531584 00000100:00100000:0.0:1788877087.238177:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788877087.238182:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532531584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877087.238189:0:56917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877087.238197:0:56917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313b0b43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0b3c expref: -99 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.238210:0:56917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313b0b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0b3c expref: 10 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.238219:0:56917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefea00/0xf5bf0f7e313b0b43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0b3c expref: 10 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.238225:0:56917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefea00, rc 0) 00000100:00100000:0.0:1788877087.238259:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532531584:12345-0@lo:101:mount.lustre.0 Request processed in 76us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.238266:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788877087.238367:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877087.238379:0:56910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b43 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.238386:0:56910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0b43 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877087.238451:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877087.238474:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.238494:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.238532:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531712 00000100:00100000:0.0:1788877087.238536:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531712 00000100:00100000:0.0:1788877087.238552:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788877087.238557:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532531712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877087.238734:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532531712:12345-0@lo:501:mount.lustre.0 Request processed in 176us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.238741:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788877087.238872:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877087.238898:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877087.238946:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.238961:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c12543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.239066:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531840 00000100:00100000:0.0:1788877087.239071:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531840 20000000:01000000:3.0:1788877087.239080:0:56915:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 00000100:00100000:0.0:1788877087.239091:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 20000000:01000000:3.0:1788877087.239096:0:56915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788877087.239099:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532531840:12345-0@lo:503:mount.lustre.0 20000000:01000000:0.0:1788877087.239293:0:56921:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788877087.239298:0:56921:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788877087.239312:0:56921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239323:0:56921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788877087.239331:0:56921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000033713s 00010000:00010000:0.0:1788877087.239336:0:56921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239343:0:56921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239351:0:56921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239360:0:56921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239367:0:56921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe600 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877087.239372:0:56921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239381:0:56921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239392:0:56921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239400:0:56921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.239407:0:56921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe600/0xf5bf0f7e313b0b4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788877087.239573:0:56923:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788877087.240029:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3665:x1875771532530944:12345-0@lo:253:kworker.0 Request processed in 17023us (17617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.240090:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1788877087.240208:0:3665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1788877087.240211:0:3665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788877087.240213:0:3665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788877087.240215:0:3665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788877087.240216:0:3665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788877087.240218:0:3665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788877087.240219:0:3665:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788877087.240264:0:3665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788877087.240267:0:3665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788877087.240271:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3665:1875771532530944:0@lo:253:kworker.0 00000100:00100000:0.0:1788877087.240365:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532531840:12345-0@lo:503:mount.lustre.0 Request processed in 1266us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.240375:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788877087.240397:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532531840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788877087.241764:0:56925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56925:1875771532531968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877087.241981:0:56925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.242021:0:56925:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c2159d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.242068:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532531968 00000100:00100000:0.0:1788877087.242074:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532531968 00000100:00100000:0.0:1788877087.242116:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788877087.242124:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56925:x1875771532531968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877087.242937:0:56925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56925:1875771532531968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788877087.242973:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788877087.242987:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877087.242990:0:56925:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788877087.242996:0:56925:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788877087.242999:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788877087.243017:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a12c5e399c0) 00000020:00000080:2.0:1788877087.243041:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788877087.243047:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788877087.243133:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788877087.243142:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0b58 00000020:00000080:2.0:1788877087.243401:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788877087.243406:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788877087.243410:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877087.243412:0:56925:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788877087.243414:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788877087.243418:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877087.243419:0:56925:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788877087.243423:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788877087.243431:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a12c5e3cd40) 00000020:00000080:2.0:1788877087.243454:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788877087.243459:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788877087.243461:0:56925:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788877087.243465:0:56925:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788877087.243471:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788877087.243519:0:56925:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c5ffc800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788877087.243533:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a12c5e38000) 00000020:00000080:2.0:1788877087.243544:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788877087.243642:0:56925:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788877087.243650:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0b6d 00000100:00100000:0.0:1788877087.243789:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56925:x1875771532531968:12345-0@lo:502:llog_process_th.0 Request processed in 1662us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.243805:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:3.0:1788877087.244491:0:56923:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788877087.244508:0:56923:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788877087.244633:0:56921:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788877087.244639:0:56921:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788877087.244728:0:56921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244749:0:56921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788877087.244760:0:56921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000123124s 00010000:00010000:0.0:1788877087.244766:0:56921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244773:0:56921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244781:0:56921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244787:0:56921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244794:0:56921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefee00 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877087.244799:0:56921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244808:0:56921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244822:0:56921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244836:0:56921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.244902:0:56921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefee00/0xf5bf0f7e313b0b74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788877087.244977:0:56922:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000080:2.0:1788877087.245345:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788877087.245354:0:56925:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788877087.245361:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5bf0f7e313b0b7b 00080000:01000000:2.0:1788877087.245367:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788877087.245372:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0b82 00000100:00100000:3.0:1788877087.245541:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:3662:x1875771532531072:12345-0@lo:253:kworker.0 Request processed in 18707us (21272us total) trans 0 rc 0/0 00000020:01000004:0.0:1788877087.245841:0:3662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1788877087.245961:0:3662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788877087.245963:0:3662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.245964:0:3662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877087.245966:0:3662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.245968:0:3662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.245969:0:3662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788877087.245971:0:3662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.245973:0:3662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788877087.245977:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb104700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3662:1875771532531072:0@lo:253:kworker.0 00000100:00100000:3.0:1788877087.246029:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:1.0:1788877087.249941:0:56922:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788877087.249959:0:56922:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788877087.250278:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:3663:x1875771532531200:12345-0@lo:253:kworker.0 Request processed in 26835us (27093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877087.250292:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:0.0:1788877087.250376:0:56921:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788877087.250382:0:56921:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788877087.250407:0:56921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250426:0:56921:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788877087.250448:0:56921:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000123124s 00010000:00010000:0.0:1788877087.250454:0:56921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250462:0:56921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250470:0:56921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250478:0:56921:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250485:0:56921:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efefe000 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877087.250490:0:56921:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250500:0:56921:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250514:0:56921:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250522:0:56921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.250528:0:56921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0b89 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788877087.250744:0:3663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1788877087.250751:0:3663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788877087.250754:0:3663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788877087.250757:0:3663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788877087.250759:0:3663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788877087.250762:0:3663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788877087.250763:0:3663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788877087.250765:0:3663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788877087.250767:0:3663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788877087.250774:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532531200:0@lo:253:kworker.0 00010000:00010000:3.0:1788877087.311991:0:56925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1788877087.312351:0:56925:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294967298 srv lr: 94489280512 lx: 0 gen 1 00000001:00080000:3.0:1788877087.312402:0:56925:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: f0204769-56bd-4f5c-ab97-74c450c9e072 idx: 1 lr: 90194313221 srv lr: 94489280512 lx: 0 gen 4 00000001:00000004:3.0:1788877087.312430:0:56925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:3.0:1788877087.312573:0:56925:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1788877087.312742:0:56925:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a12c2159240: xid 1875771511322368, transno 94489280518, client gen 4, slot idx 0 00000001:00080000:3.0:1788877087.312756:0:56925:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a12c21590c0: xid 1875771531470848, transno 4294967298, client gen 1, slot idx 1 00000001:00080000:3.0:1788877087.312761:0:56925:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a12c2159900: xid 1875771511323008, transno 94489280519, client gen 4, slot idx 2 00000001:00080000:3.0:1788877087.312767:0:56925:0:(tgt_lastrcvd.c:2284:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8a12c2159d80: xid 1875771511321728, transno 94489280517, client gen 4, slot idx 3 00000020:00000080:3.0:1788877087.313727:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a12c3f64d40) 00000020:00000080:3.0:1788877087.313755:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788877087.313860:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788877087.313870:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0ba5 00000020:00000080:0.0:1788877087.314528:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788877087.316878:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5bf0f7e313b0bac 00000020:00000080:0.0:1788877087.317312:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788877087.317324:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788877087.317331:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.317333:0:56925:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788877087.317336:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788877087.317339:0:56925:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788877087.317342:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788877087.317343:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788877087.317345:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788877087.317348:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.317350:0:56925:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788877087.317352:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788877087.317360:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.317361:0:56925:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788877087.317368:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788877087.317430:0:56925:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788877087.317458:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788877087.317462:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.317464:0:56925:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788877087.317467:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788877087.317471:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.317473:0:56925:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788877087.317477:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788877087.317481:0:56925:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:0.0:1788877087.317509:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788877087.317523:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a12c4e33380) 00000020:00000080:0.0:1788877087.317541:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788877087.317547:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788877087.317659:0:56925:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788877087.317664:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788877087.317674:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0bba 00010000:00080000:0.0:1788877087.317718:0:56925:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13ef008000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1788877087.320130:0:56925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1788877087.321690:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788877087.321706:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788877087.321750:0:56925:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788877087.321771:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0bc1 00000100:00080000:3.0:1788877087.321784:0:56925:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788877087.321792:0:56925:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a13ef008000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788877087.321836:0:56925:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac21f80 x1875771532532096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788877087.321867:0:56925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788877087.321936:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788877087.321940:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.321943:0:56925:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788877087.321946:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788877087.321949:0:56925:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788877087.321951:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877087.321952:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877087.321954:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788877087.321957:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.321958:0:56925:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788877087.321961:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788877087.321966:0:56925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788877087.321970:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.321971:0:56925:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788877087.321973:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788877087.321977:0:56925:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1788877087.322006:0:56925:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788877087.322010:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788877087.322024:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a12c3f60000) 00000020:00000080:3.0:1788877087.322046:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788877087.322051:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788877087.322116:0:56925:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788877087.322124:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788877087.322130:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0bcf 00010000:00080000:3.0:1788877087.322165:0:56925:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13d564f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1788877087.322369:0:56925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1788877087.322935:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788877087.323015:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.323087:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532096 00000100:00100000:0.0:1788877087.323095:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532096 00000100:00100000:0.0:1788877087.323129:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1788877087.323137:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875771532532096:12345-0@lo:38:llog_process_th.0 00000040:01000000:3.0:1788877087.323446:0:56925:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788877087.323475:0:56925:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00010000:00080000:0.0:1788877087.323733:0:6544:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2075 last 0 00000020:00000080:0.0:1788877087.323772:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0bd6 00000004:00100000:0.0:1788877087.323789:0:6544:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788877087.323892:0:6544:0:(import.c:65:import_set_state_nolock()) ffff8a13cfd65800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788877087.323967:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532532096:12345-0@lo:38:llog_process_th.0 Request processed in 829us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.323975:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000040:00080000:3.0:1788877087.324134:0:56925:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000100:00100000:1.0:1788877087.324254:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788877087.324265:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788877087.324272:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788877087.324279:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788877087.324282:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13ef008000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788877087.324299:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788877087.325671:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532532224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788877087.325727:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.325778:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532224 00000100:00100000:0.0:1788877087.325784:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532224 00000100:00100000:0.0:1788877087.325829:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1788877087.325839:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532532224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788877087.325873:0:13623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788877087.325918:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532532224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.325925:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1788877087.325964:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb105500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532532224:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788877087.326277:0:56925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788877087.326312:0:56925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:3.0:1788877087.326498:0:56925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000040:00080000:0.0:1788877087.329452:0:56931:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1788877087.329460:0:56931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788877087.329739:0:56931:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1788877087.329763:0:56931:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1788877087.329888:0:56931:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1788877087.329892:0:56931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788877087.332108:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788877087.332121:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788877087.332154:0:56925:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788877087.332174:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0bdd 00000100:00080000:3.0:1788877087.332184:0:56925:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788877087.332190:0:56925:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a13d564f000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788877087.332896:0:56925:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac21f80 x1875771532532352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788877087.332920:0:56925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788877087.332972:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532352:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788877087.333028:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788877087.333035:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.333037:0:56925:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788877087.333041:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788877087.333045:0:56925:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788877087.333046:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877087.333048:0:56925:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788877087.333049:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788877087.333052:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.333054:0:56925:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788877087.333057:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788877087.333062:0:56925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788877087.333066:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788877087.333067:0:56925:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788877087.333070:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788877087.333073:0:56925:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000100:00100000:1.0:1788877087.333096:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788877087.333097:0:56925:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788877087.333104:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788877087.333116:0:56925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a12c3f619c0) 00000020:00000080:3.0:1788877087.333135:0:56925:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788877087.333141:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788877087.333199:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532352 00000004:00080000:3.0:1788877087.333206:0:56925:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000100:00100000:1.0:1788877087.333210:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532352 00080000:01000000:3.0:1788877087.333213:0:56925:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788877087.333225:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5bf0f7e313b0beb 00000100:00100000:1.0:1788877087.333257:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00010000:00080000:3.0:1788877087.333260:0:56925:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13f443d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:1.0:1788877087.333269:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3661:x1875771532532352:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1788877087.333305:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2075 last 0 00000020:00000080:1.0:1788877087.333359:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0bf2 00002000:00100000:1.0:1788877087.333379:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a13ff367000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788877087.333385:0:8453:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788877087.333389:0:8453:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788877087.333499:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00010000:3.0:1788877087.333507:0:56925:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00080000:1.0:1788877087.333532:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a13ff365800 : changing import state from RECOVER to FULL 00000040:01000000:3.0:1788877087.333627:0:56925:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788877087.333643:0:56925:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788877087.335023:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532532352:12345-0@lo:8:llog_process_th.0 Request processed in 1743us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877087.335035:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000040:00080000:3.0:1788877087.335041:0:56925:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000100:00100000:0.0:1788877087.335344:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788877087.335356:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788877087.335366:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788877087.335373:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788877087.335377:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13d564f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788877087.335429:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788877087.335445:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532352:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1788877087.335477:0:56931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788877087.335542:0:56931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2075230939520ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788877087.335549:0:56931:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788877087.335667:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788877087.335679:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532532480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788877087.335716:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.335912:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532480 00000100:00100000:3.0:1788877087.335921:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532480 00000100:00100000:3.0:1788877087.335984:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1788877087.335995:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532532480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788877087.336018:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:3.0:1788877087.336094:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1875771532532480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.336101:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00080000:3.0:1788877087.336128:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788877087.336177:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1875771532532480:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788877087.336748:0:56925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788877087.336793:0:56925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:1.0:1788877087.336949:0:56925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000040:00080000:3.0:1788877087.338801:0:56933:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:3.0:1788877087.338809:0:56933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788877087.339048:0:56933:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:3.0:1788877087.339067:0:56933:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1788877087.339187:0:56933:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:3.0:1788877087.339191:0:56933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000004:00080000:0.0:1788877087.339505:0:56911:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1788877087.340075:0:56925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788877087.340093:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788877087.340142:0:56925:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788877087.340268:0:56925:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0bf9 00000100:00080000:1.0:1788877087.340281:0:56925:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788877087.340287:0:56925:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a13f443d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1788877087.340409:0:56925:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a12c261d500 x1875771532532608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788877087.340469:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532608:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788877087.340538:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788877087.340624:0:56925:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788877087.340636:0:43971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532608 00000100:00100000:2.0:1788877087.340645:0:43971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532608 00000100:00100000:2.0:1788877087.340690:0:43971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1788877087.340697:0:43971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:3661:x1875771532532608:12345-0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788877087.340708:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877087.340715:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877087.340718:0:56925:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788877087.340721:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877087.340727:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00080000:2.0:1788877087.340730:0:43971:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2075 last 0 00000020:00000080:1.0:1788877087.340731:0:56925:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788877087.340739:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788877087.340745:0:56925:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788877087.340750:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877087.340754:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877087.340755:0:56925:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:00000080:2.0:1788877087.340770:0:43971:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5bf0f7e313b0c00 00002000:00100000:2.0:1788877087.340785:0:43971:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a12c2590000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788877087.340789:0:43971:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788877087.340792:0:43971:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788877087.340841:0:43971:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788877087.340868:0:43971:0:(import.c:65:import_set_state_nolock()) ffff8a12c2593800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877087.340943:0:43971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:3661:x1875771532532608:12345-0@lo:8:llog_process_th.0 Request processed in 245us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.340950:0:43971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1788877087.340963:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788877087.340976:0:3661:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788877087.340985:0:3661:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788877087.340990:0:3661:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788877087.340994:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13f443d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788877087.341014:0:3661:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:1.0:1788877087.341073:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788877087.341080:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000004:00080000:2.0:1788877087.341080:0:56933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:00000080:1.0:1788877087.341085:0:56925:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788877087.341093:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:00080000:2.0:1788877087.341128:0:56933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2075236524104ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788877087.341135:0:56925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56925:1875771532532736:0@lo:502:llog_process_th.0 00080000:00080000:2.0:1788877087.341138:0:56933:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788877087.341267:0:56925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.341302:0:56925:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f4240f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.341324:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532736 00000100:00100000:2.0:1788877087.341330:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532736 00000100:00100000:0.0:1788877087.341366:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3661:1875771532532608:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788877087.341402:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788877087.341414:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:56925:x1875771532532736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877087.341541:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:56925:x1875771532532736:12345-0@lo:502:llog_process_th.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.341549:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788877087.341637:0:56925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56925:1875771532532736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788877087.341671:0:56925:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788877087.341676:0:56925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788877087.341677:0:56925:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788877087.341681:0:56925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788877087.341750:0:56910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788877087.342256:0:56910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788877087.342368:0:56910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b43 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.342380:0:56910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef40800/0xf5bf0f7e313b0b3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0b43 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877087.342390:0:56910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5ffc800 from 1 10000000:01000000:1.0:1788877087.342394:0:56910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788877087.342426:0:56910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.342434:0:56910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.342456:0:56910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877087.342471:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532532864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788877087.342507:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.342532:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.342797:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532864 00000100:00100000:0.0:1788877087.342804:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532864 00000100:00100000:0.0:1788877087.342846:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788877087.342855:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+8:56910:x1875771532532864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877087.342867:0:56916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877087.342882:0:56916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c07 expref: -99 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.342907:0:56916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 9 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.342923:0:56916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 9 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.342932:0:56916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe000, rc 0) 00000100:00100000:0.0:1788877087.342965:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532532864:12345-0@lo:101:mount.lustre.0 Request processed in 111us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.342972:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788877087.343003:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532532992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788877087.343132:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.343233:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532532992 00000100:00100000:0.0:1788877087.343238:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532532992 00000100:00100000:0.0:1788877087.343270:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1788877087.343276:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532532992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788877087.343291:0:10168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788877087.343392:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532532864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788877087.343406:0:56910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.343421:0:56910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788877087.343811:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788877087.343988:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533120:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788877087.344147:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb107480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875771532532992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 869us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.344169:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1788877087.344209:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1875771532532992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788877087.345296:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877087.345393:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4f9c780 going to sleep for 11 seconds 00000004:00080000:2.0:1788877087.345450:0:56911:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788877087.345455:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533120 00000100:00100000:3.0:1788877087.345463:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533120 00000100:00100000:3.0:1788877087.345555:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788877087.345566:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532533120:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788877087.345586:0:56922:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788877087.345626:0:56922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788877087.345632:0:56922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788877087.345635:0:56922:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788877087.345638:0:56922:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 94 00000100:00100000:3.0:1788877087.345747:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532533120:12345-0@lo:256:mount.lustre.0 Request processed in 182us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.345755:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788877087.345766:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533120:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788877087.346506:0:56910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788877087.346530:0:56910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.346540:0:56910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877087.346547:0:56910:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5ffc800 from 1 10000000:01000000:0.0:1788877087.346551:0:56910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788877087.346581:0:56910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.346590:0:56910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.346598:0:56910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.346637:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788877087.346688:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.346735:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788877087.346740:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533248 00000100:00100000:1.0:1788877087.346749:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533248 00000100:00100000:1.0:1788877087.346851:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788877087.346860:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+9:56910:x1875771532533248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788877087.346870:0:56916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788877087.346890:0:56916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313b0c1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c15 expref: -99 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.346913:0:56916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313b0c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c15 expref: 10 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.346925:0:56916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13fae34c00/0xf5bf0f7e313b0c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c15 expref: 10 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.346934:0:56916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13fae34c00, rc 0) 00000100:00100000:1.0:1788877087.347224:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533248:12345-0@lo:101:mount.lustre.0 Request processed in 364us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877087.347231:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788877087.348419:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877087.348450:0:56910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c1c expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.348460:0:56910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c1c expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.348516:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877087.348548:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.348662:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db300 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.348828:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533376 00000100:00100000:2.0:1788877087.348834:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533376 00000100:00100000:3.0:1788877087.348936:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788877087.348946:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788877087.349077:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533376:12345-0@lo:501:mount.lustre.0 Request processed in 133us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.349085:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788877087.349160:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877087.349187:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877087.349226:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.349253:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.349299:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533504 00000100:00100000:3.0:1788877087.349308:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533504 00000100:00100000:3.0:1788877087.349334:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788877087.349341:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788877087.349424:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533504:12345-0@lo:503:mount.lustre.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.349431:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788877087.349524:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877087.350001:0:56935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56935:1875771532533632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877087.350032:0:56935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.350144:0:56935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788877087.350194:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533632 00000100:00100000:1.0:1788877087.350199:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533632 00000100:00100000:1.0:1788877087.350254:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788877087.350261:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56935:x1875771532533632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788877087.350743:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56935:x1875771532533632:12345-0@lo:502:llog_process_th.0 Request processed in 481us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877087.350751:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788877087.350867:0:56935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56935:1875771532533632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788877087.350887:0:56935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788877087.350896:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.350899:0:56935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788877087.350905:0:56935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13c5ffc800 00000020:00000080:0.0:1788877087.350907:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788877087.350914:0:56935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788877087.350917:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.350918:0:56935:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788877087.350920:0:56935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788877087.350922:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788877087.350924:0:56935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788877087.350927:0:56935:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a13c5ffc800 00000020:00000080:0.0:1788877087.350929:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788877087.350997:0:56935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56935:1875771532533760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788877087.351028:0:56935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.351052:0:56935:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.351541:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533760 00000100:00100000:3.0:1788877087.351546:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533760 00000100:00100000:3.0:1788877087.351580:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788877087.351588:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6308c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56935:x1875771532533760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.351697:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6308c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56935:x1875771532533760:12345-0@lo:502:llog_process_th.0 Request processed in 110us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.351707:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788877087.351725:0:56935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56935:1875771532533760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788877087.351749:0:56935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788877087.351754:0:56935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788877087.351756:0:56935:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788877087.351759:0:56935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788877087.351822:0:56910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1788877087.351851:0:56910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788877087.351862:0:56910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c1c expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877087.351872:0:56910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefe600/0xf5bf0f7e313b0c15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c1c expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877087.351916:0:56910:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788877087.351919:0:56910:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a13c5ffc800 10000000:01000000:3.0:1788877087.351922:0:56910:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a13c5ffc800 10000000:01000000:3.0:1788877087.351927:0:56910:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788877087.351932:0:56910:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5ffc800 from 1 10000000:01000000:3.0:1788877087.351934:0:56910:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788877087.351956:0:56910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877087.352083:0:56910:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877087.352095:0:56910:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877087.352111:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788877087.352150:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.352220:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7203c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.352342:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532533888 00000100:00100000:2.0:1788877087.352346:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532533888 00000100:00100000:2.0:1788877087.352378:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788877087.352385:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:56910:x1875771532533888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788877087.352393:0:56922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877087.352405:0:56922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef40a00/0xf5bf0f7e313b0c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c23 expref: -99 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.352424:0:56922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef40a00/0xf5bf0f7e313b0c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c23 expref: 11 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.352435:0:56922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef40a00/0xf5bf0f7e313b0c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c23 expref: 11 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877087.352453:0:56922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef40a00, rc 0) 00000100:00100000:2.0:1788877087.352493:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532533888:12345-0@lo:101:mount.lustre.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.352499:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788877087.352726:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532533888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788877087.352739:0:56910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c2a expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.352746:0:56910:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c2a expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.352788:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877087.352811:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.352837:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.352878:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534016 00000100:00100000:2.0:1788877087.352883:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534016 00000100:00100000:2.0:1788877087.352911:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788877087.352917:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788877087.353003:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534016:12345-0@lo:501:mount.lustre.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.353010:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788877087.353079:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788877087.353102:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788877087.353138:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.353162:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.353206:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534144 00000100:00100000:2.0:1788877087.353210:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534144 00000100:00100000:2.0:1788877087.353240:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788877087.353246:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877087.353323:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534144:12345-0@lo:503:mount.lustre.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.353330:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788877087.353401:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788877087.353746:0:56936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877087.353780:0:56936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.353806:0:56936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13d5729e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.353825:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534272 00000100:00100000:3.0:1788877087.353831:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534272 00000100:00100000:3.0:1788877087.353866:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788877087.353874:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.353961:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534272:12345-0@lo:502:llog_process_th.0 Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.353969:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788877087.354226:0:56936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534272:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788877087.354272:0:56936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788877087.354284:0:56936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a12c5e3b380) 00000020:00000080:2.0:1788877087.354304:0:56936:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788877087.354374:0:56936:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a13c5ffc800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788877087.354378:0:56936:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a13c5ffc800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788877087.354381:0:56936:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a13c5ffc800 4 00010000:00080000:2.0:1788877087.354407:0:56936:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a13c5f99000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1788877087.362205:0:56936:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1788877087.363753:0:56936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788877087.363800:0:56936:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788877087.363812:0:56936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5bf0f7e313b0c38 00000100:00080000:3.0:1788877087.363822:0:56936:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788877087.363828:0:56936:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a13c5f99000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1788877087.363859:0:56936:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a13fac23480 x1875771532534400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788877087.363892:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532534400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788877087.363953:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788877087.364002:0:56936:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788877087.364165:0:56936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.364207:0:56936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.364230:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534528 00000100:00100000:3.0:1788877087.364236:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534528 00000100:00100000:3.0:1788877087.364268:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788877087.364276:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.364374:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534528:12345-0@lo:502:llog_process_th.0 Request processed in 97us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.364382:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788877087.364416:0:56936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c7f59e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.364433:0:56936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788877087.365509:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534400 00000100:00100000:2.0:1788877087.365514:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534400 00000100:00100000:2.0:1788877087.365539:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:2.0:1788877087.365544:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fac21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532534400:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788877087.365597:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fac21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3661:x1875771532534400:12345-0@lo:38:llog_process_th.0 Request processed in 52us (1644us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788877087.365620:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:3.0:1788877087.366407:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788877087.366414:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8a13c5f99000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788877087.366418:0:3661:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788877087.366421:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fac23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875771532534400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788877087.366463:0:56936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.366499:0:56936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877087.366520:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534656 00000100:00100000:3.0:1788877087.366524:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534656 00000100:00100000:3.0:1788877087.366546:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788877087.366552:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788877087.366632:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6309c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56936:x1875771532534656:12345-0@lo:502:llog_process_th.0 Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877087.366639:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788877087.366666:0:56936:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c48a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.366677:0:56936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56936:1875771532534656:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788877087.366695:0:56936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788877087.366858:0:56910:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788877087.366879:0:56910:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788877087.366899:0:56910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c2a expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.366910:0:56910:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7873400/0xf5bf0f7e313b0c23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c2a expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788877087.366956:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788877087.366958:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788877087.366960:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.366961:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877087.366963:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.366964:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.366965:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788877087.366967:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788877087.366968:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.366970:0:56910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788877087.366973:0:56910:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788877087.366976:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788877087.366977:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788877087.366978:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788877087.366979:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788877087.366980:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788877087.366982:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788877087.366983:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788877087.366985:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788877087.366986:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788877087.366987:0:56910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788877087.366999:0:56910:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788877087.367008:0:56910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788877087.367039:0:56910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.367052:0:56910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788877087.368956:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534784 00000100:00100000:3.0:1788877087.368964:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534784 00000100:00100000:3.0:1788877087.369002:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788877087.369010:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6308450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788877087.369032:0:56915:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788877087.369044:0:56915:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788877087.376470:0:56915:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788877087.376492:0:56915:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788877087.376520:0:56921:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788877087.376534:0:56921:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788877087.376570:0:56921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.376595:0:56921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.376868:0:56921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877087.376930:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6308450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:56910:x1875771532534784:12345-0@lo:253:mount.lustre.0 Request processed in 7914us (9883us total) trans 0 rc 0/0 00010000:00010000:0.0:1788877087.376931:0:56921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877087.376967:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788877087.376975:0:56921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.377001:0:56921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:56921:1875771532534912:0@lo:104: 00000100:00100000:0.0:1788877087.377077:0:56921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.377078:0:56910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13eb106d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:56910:1875771532534784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788877087.377093:0:56910:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788877087.377097:0:56910:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788877087.377098:0:56910:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788877087.377100:0:56910:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788877087.377101:0:56910:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788877087.377103:0:56910:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788877087.377104:0:56910:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788877087.377106:0:56910:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788877087.377108:0:56910:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788877087.377110:0:56910:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788877087.377112:0:56910:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788877087.377133:0:56910:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788877087.377145:0:56921:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788877087.377765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532534912 00000100:00100000:1.0:1788877087.377773:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532534912 00000100:00100000:1.0:1788877087.377816:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788877087.377825:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:56921:x1875771532534912:12345-0@lo:104: 00010000:00010000:1.0:1788877087.377840:0:6523:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.377904:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788877087.377912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+3:56921:x1875771532534912:12345-0@lo:104: Request processed in 87us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877087.377922:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788877087.377953:0:56921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c261d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:56921:1875771532534912:0@lo:104: 00010000:00010000:1.0:1788877087.377954:0:10419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788877087.377964:0:10419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.377974:0:10419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13fae35000 already unused, calling callback (ffffffffc12efc20) 10000000:00010000:1.0:1788877087.377978:0:10419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877087.377985:0:56921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.377997:0:10419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788877087.378008:0:10419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877087.378014:0:10419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788877087.378052:0:10419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.378059:0:10419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788877087.378082:0:10419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.378090:0:10419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff8a13fae35000/0xf5bf0f7e313b0c07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5bf0f7e313b0c0e expref: -99 pid: 56910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877087.378107:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532535040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877087.378108:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877087.378112:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788877087.378117:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877087.378228:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.378364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535040 00000100:00100000:0.0:1788877087.378371:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535040 00010000:00010000:0.0:1788877087.378396:0:6524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.378447:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788877087.378455:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f361ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:3663:x1875771532535040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788877087.378469:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788877087.378475:0:6524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.378486:0:6524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.378501:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0c0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5bf0f7e313b0c07 expref: 11 pid: 56916 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.378516:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.378525:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788877087.378538:0:6524:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002006048s 00010000:00010000:0.0:1788877087.379076:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379086:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379152:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379159:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379166:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a13efeff800 already unused, calling callback (ffffffffc0cf24f0) 00010000:00010000:0.0:1788877087.379170:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379179:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379203:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877087.379214:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788877087.379243:0:56921:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877087.379263:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f361ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:3663:x1875771532535040:12345-0@lo:103:ldlm_bl.0 Request processed in 807us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.379271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788877087.379310:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:3663:1875771532535040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788877087.379393:0:56921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877087.379402:0:56921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a13efeff800/0xf5bf0f7e313b0c3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788877087.389399:0:56910:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 30064771074 00000040:01000000:3.0:1788877087.389972:0:56910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788877087.389986:0:56943:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 30064771074 00000020:00080000:2.0:1788877087.389996:0:56943:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30064771074 00000040:01000000:3.0:1788877087.390282:0:56944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788877087.390389:0:56910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788877087.391007:0:56945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877087.391077:0:56945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877087.391108:0:56945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f360ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.391199:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535168 00000100:00100000:0.0:1788877087.391212:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535168 00000100:00100000:0.0:1788877087.391288:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1788877087.391302:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.391454:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 155us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.391463:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1788877087.391532:0:56945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535168:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788877087.391552:0:56910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788877087.391639:0:56910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788877087.391720:0:56945:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788877087.391770:0:56945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.391813:0:56945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.391840:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535296 00000100:00100000:0.0:1788877087.391844:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535296 00000100:00100000:0.0:1788877087.391868:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1788877087.391874:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.392010:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.392018:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1788877087.392042:0:56945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.392056:0:56945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e7877100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.392125:0:56945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.392147:0:56945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.392166:0:56945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788877087.392201:0:13623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535424 00000100:00100000:2.0:1788877087.392211:0:13623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535424 00000004:00000080:3.0:1788877087.392417:0:56910:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788877087.392428:0:56910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788877087.392478:0:56910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788877087.392910:0:13623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1788877087.392921:0:13623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535424:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788877087.393011:0:13623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535424:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877087.393019:0:13623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000040:00080000:3.0:1788877087.393695:0:56910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788877087.394262:0:56910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788877087.394294:0:56910:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788877087.394358:0:56910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788877087.394950:0:56945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535424:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.395030:0:56945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13c79a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535552:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.395090:0:56945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877087.395115:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535552 00000100:00100000:0.0:1788877087.395120:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535552 00000100:00100000:0.0:1788877087.395144:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788877087.395151:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788877087.395308:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:56945:x1875771532535552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 157us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877087.395315:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788877087.395334:0:56945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db300 going to sleep for 11 seconds 00000100:00100000:0.0:1788877087.395347:0:56945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13c79a8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:56945:1875771532535552:0@lo:1000:lod0000_rec0001.0 00080000:10000000:3.0:1788877087.395989:0:56910:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00000040:00080000:1.0:1788877087.398525:0:56944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788877087.398659:0:56944:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1788877087.399128:0:56910:0:(ldlm_lib.c:3079:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280519 00000040:00080000:0.0:1788877087.400793:0:56945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788877087.400918:0:56945:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788877087.400923:0:56945:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1788877087.402246:0:56946:0:(ldlm_lib.c:2879:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 56946 00010000:02000000:3.0:1788877087.402289:0:56946:0:(ldlm_lib.c:2361:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1788877087.402292:0:56946:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1788877087.402296:0:56946:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1788877087.402356:0:56910:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788877087.402370:0:56910:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788877087.402387:0:56910:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788877087.402401:0:56910:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788877087.407079:0:56910:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788877087.407406:0:56910:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788877088.041787:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788877088.430180:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877088.430231:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877088.430305:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331840 00000100:00100000:2.0:1788877088.430318:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331840 00000100:00100000:2.0:1788877088.430400:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2043 00000100:00100000:2.0:1788877088.430413:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511331840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877088.430519:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2395:x1875771511331840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.430528:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2043 00000100:00100000:0.0:1788877088.430723:0:43960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331968 00000100:00100000:0.0:1788877088.430729:0:43960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331968 00000100:00100000:0.0:1788877088.430777:0:43960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1576 00000100:00100000:0.0:1788877088.430786:0:43960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511331968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1788877088.430826:0:43960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2395:x1875771511331968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.430833:0:43960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1576 00000100:00080000:1.0:1788877088.430965:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788877088.430971:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788877088.432884:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877088.432950:0:43956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332096 00000100:00100000:2.0:1788877088.432958:0:43956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332096 00000100:00080000:0.0:1788877088.433045:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788877088.433133:0:43956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1577 00000100:00100000:2.0:1788877088.433166:0:43956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e78e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511332096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1788877088.433233:0:43956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e78e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f0204769-56bd-4f5c-ab97-74c450c9e072+9:2396:x1875771511332096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.433241:0:43956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1577 00000100:00100000:0.0:1788877088.439204:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877088.439267:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877088.439380:0:51736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511331712 00000100:00100000:1.0:1788877088.439390:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332224 00000100:00100000:2.0:1788877088.439394:0:51736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511331712 00000100:00100000:1.0:1788877088.439397:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332224 00000100:00100000:1.0:1788877088.439456:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1788877088.439462:0:51736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2821 00000100:00100000:1.0:1788877088.439469:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2394:x1875771511332224:12345-192.168.203.11@tcp:250:kworker.0 00000100:00100000:2.0:1788877088.439474:0:51736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2394:x1875771511331712:12345-192.168.203.11@tcp:38:kworker.0 00010000:00080000:2.0:1788877088.439506:0:51736:0:(ldlm_lib.c:936:target_handle_reconnect()) connect export for UUID 'f0204769-56bd-4f5c-ab97-74c450c9e072' at ffff8a13fa7bf000, cookie 0xf5bf0f7e313b0b97 00010000:00080000:1.0:1788877088.439507:0:56922:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1@192.168.203.11@tcp t0 exp 0000000000000000 cur 2076 last 0 00010000:00080000:2.0:1788877088.439515:0:51736:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f0204769-56bd-4f5c-ab97-74c450c9e072@192.168.203.11@tcp recovering/t94489280520 exp ffff8a13fa7bf000 cur 2076 last 1788877087 00010000:02000400:2.0:1788877088.439527:0:51736:0:(ldlm_lib.c:2062:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000020:00000080:1.0:1788877088.439556:0:56922:0:(genops.c:1385:class_connect()) connect: client a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1, cookie 0xf5bf0f7e313b0c46 00000100:00080000:1.0:1788877088.439749:0:56922:0:(import.c:65:import_set_state_nolock()) ffff8a13fa7b9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788877088.440156:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:2394:x1875771511332224:12345-192.168.203.11@tcp:250:kworker.0 Request processed in 689us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877088.440175:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00010000:00080000:2.0:1788877088.448803:0:51736:0:(ldlm_lib.c:2126:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1788877088.448857:0:51736:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788877088.449091:0:51736:0:(import.c:65:import_set_state_nolock()) ffff8a13c511b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788877088.451547:0:51736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c79a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511331712:12345-192.168.203.11@tcp:38:kworker.0 Request processed in 12067us (12349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.451561:0:51736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2821 00000100:00100000:0.0:1788877088.456917:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877088.459545:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511324032 00000100:00100000:3.0:1788877088.459562:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511324032 00000100:00100000:3.0:1788877088.459684:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2822 00000100:00100000:3.0:1788877088.459697:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511324032:12345-192.168.203.11@tcp:36:mcreate.0 00010000:00080000:3.0:1788877088.459724:0:6539:0:(ldlm_lib.c:3256:target_queue_recovery_request()) Next recovery transno: 94489280520, current: 94489280520, replaying 00000100:00100000:3.0:1788877088.459741:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f0204769-56bd-4f5c-ab97-74c450c9e072+6:2394:x1875771511324032:12345-192.168.203.11@tcp:36:mcreate.0 Request processed in 48us (2835us total) trans 0 rc 0/-999 00000100:00100000:3.0:1788877088.459751:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2822 00010000:00080000:3.0:1788877088.459771:0:56946:0:(ldlm_lib.c:2571:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:2.0:1788877088.937206:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788877088.937214:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5ffc800 from 95 10000000:01000000:2.0:1788877088.937219:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788877088.937266:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.937278:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.937289:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877088.937313:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.937383:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.937419:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535680 00000100:00100000:2.0:1788877088.937424:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.937532:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535680 00000100:00100000:3.0:1788877088.938414:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788877088.938425:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6308050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+10:6537:x1875771532535680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.938571:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.938590:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7872000/0xf5bf0f7e313b0c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c4d expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.938629:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7872000/0xf5bf0f7e313b0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c4d expref: 11 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.938641:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7872000/0xf5bf0f7e313b0c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c4d expref: 11 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.938651:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872000, rc 0) 00000100:00100000:3.0:1788877088.938691:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6308050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532535680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.938699:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788877088.938797:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.938812:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c54 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.938822:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c54 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.938873:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.938905:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.938930:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.938944:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535808 00000100:00100000:0.0:1788877088.938948:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535808 00000100:00100000:0.0:1788877088.938980:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788877088.938987:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6308850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532535808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788877088.938999:0:56915:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788877088.939014:0:56915:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788877088.939017:0:56915:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 95 00000100:00100000:0.0:1788877088.939085:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6308850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532535808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.939091:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788877088.939118:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788877088.939158:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788877088.939164:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c54 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.939172:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef41e00/0xf5bf0f7e313b0c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c54 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877088.939181:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788877088.939183:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c7974800 from 52 10000000:01000000:0.0:1788877088.939185:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788877088.939200:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.939207:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.939214:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.939225:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.939248:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.939335:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.939596:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532535936 00000100:00100000:3.0:1788877088.939615:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532535936 00000100:00100000:3.0:1788877088.939638:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788877088.939645:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c630a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+11:6537:x1875771532535936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.939651:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.939659:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7873c00/0xf5bf0f7e313b0c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c5b expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.939679:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7873c00/0xf5bf0f7e313b0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c5b expref: 12 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.939687:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7873c00/0xf5bf0f7e313b0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c5b expref: 12 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.939693:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873c00, rc 0) 00000100:00100000:3.0:1788877088.939721:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c630a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532535936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.939727:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788877088.939803:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532535936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.939814:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c62 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.939822:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c62 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.939867:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.939891:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.939907:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.939917:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536064 00000100:00100000:0.0:1788877088.939920:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536064 00000100:00100000:0.0:1788877088.939937:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788877088.939943:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6309850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532536064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.940109:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6309850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532536064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.940117:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788877088.940146:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.940171:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.940206:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.940302:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.940336:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536192 00000100:00100000:3.0:1788877088.940339:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536192 00000100:00100000:3.0:1788877088.940361:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788877088.940366:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c6309050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532536192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.940580:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.940810:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c6309050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532536192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 443us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.940818:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:3.0:1788877088.942384:0:57092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1788877088.942507:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1788877088.942531:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788877088.942540:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c62 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.942549:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efefe800/0xf5bf0f7e313b0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c62 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877088.942558:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788877088.942561:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1788877088.942563:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788877088.942585:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.942591:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.942599:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877088.942629:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.942667:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877088.942703:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.942711:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536320 00000100:00100000:3.0:1788877088.942717:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536320 00000100:00100000:3.0:1788877088.942752:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788877088.942760:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+12:6537:x1875771532536320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.942768:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.942778:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7872600/0xf5bf0f7e313b0c70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c69 expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.942796:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7872600/0xf5bf0f7e313b0c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c69 expref: 13 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.942804:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7872600/0xf5bf0f7e313b0c70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c69 expref: 13 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.942811:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872600, rc 0) 00000100:00100000:3.0:1788877088.942844:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.942851:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788877088.942868:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877088.942881:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c70 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.942890:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c70 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877088.942934:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.942960:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877088.942986:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.943326:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536448 00000100:00100000:0.0:1788877088.943331:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536448 00000100:00100000:0.0:1788877088.943387:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788877088.943395:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.943596:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.943620:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788877088.943621:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.943650:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.943687:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.947931:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536576 00000100:00100000:3.0:1788877088.947945:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536576 00000100:00100000:3.0:1788877088.947996:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788877088.948004:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.948870:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 866us (5181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.948878:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788877088.950235:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f450a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.950260:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788877088.951290:0:57093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1788877088.951478:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1788877088.951592:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788877088.951634:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c70 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.951645:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef40600/0xf5bf0f7e313b0c69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c70 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877088.951654:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788877088.951657:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c7974800 from 7 10000000:01000000:3.0:1788877088.951659:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788877088.951695:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.951706:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.951715:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.951735:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.951784:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.951816:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.951818:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536704 00000100:00100000:2.0:1788877088.951824:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536704 00000100:00100000:2.0:1788877088.951861:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788877088.951869:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+13:6537:x1875771532536704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877088.951879:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877088.951893:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef41400/0xf5bf0f7e313b0c7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c77 expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.951916:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef41400/0xf5bf0f7e313b0c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c77 expref: 14 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.951925:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef41400/0xf5bf0f7e313b0c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c77 expref: 14 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.951934:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41400, rc 0) 00000100:00100000:2.0:1788877088.951972:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532536704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.951978:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788877088.952129:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.952141:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c7e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.952150:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c7e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.952196:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.952221:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.952244:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.952335:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536832 00000100:00100000:2.0:1788877088.952340:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536832 00000100:00100000:2.0:1788877088.952369:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788877088.952376:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532536832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.953335:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532536832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 958us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.953343:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788877088.953371:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.953403:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.953455:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.953488:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13f47bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.953509:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532536960 00000100:00100000:2.0:1788877088.953514:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532536960 00000100:00100000:2.0:1788877088.953540:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788877088.953547:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532536960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.953637:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532536960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.953645:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788877088.953660:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532536960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877088.957223:0:57094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788877088.957412:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788877088.957446:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788877088.957454:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c7e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.957465:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7873e00/0xf5bf0f7e313b0c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c7e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788877088.957473:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788877088.957475:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13fbfc9800 from 52 10000000:01000000:2.0:1788877088.957477:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788877088.957515:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.957523:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.957537:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877088.957555:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.957599:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877088.957650:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4853240 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.957808:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537088 00000100:00100000:3.0:1788877088.957814:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537088 00000100:00100000:3.0:1788877088.957853:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788877088.957861:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+14:6537:x1875771532537088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.957870:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.957883:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7872200/0xf5bf0f7e313b0c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c85 expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.957903:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7872200/0xf5bf0f7e313b0c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c85 expref: 15 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.957912:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7872200/0xf5bf0f7e313b0c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c85 expref: 15 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.957921:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872200, rc 0) 00000100:00100000:3.0:1788877088.957951:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.957957:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788877088.958033:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877088.958046:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c8c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.958054:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c8c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788877088.958097:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.958119:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877088.958144:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4853240 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.958181:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537216 00000100:00100000:3.0:1788877088.958185:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537216 00000100:00100000:3.0:1788877088.958215:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788877088.958222:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.958321:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.958328:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788877088.958438:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.958461:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.958505:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788877088.958523:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13c4853240 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.958648:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537344 00000100:00100000:3.0:1788877088.958653:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537344 00000100:00100000:3.0:1788877088.958676:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788877088.958682:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.958746:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.958753:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788877088.958821:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13fad1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788877088.959742:0:57095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788877088.959857:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788877088.959876:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788877088.959883:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c8c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.959891:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13eef41000/0xf5bf0f7e313b0c85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c8c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877088.959899:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788877088.959901:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1788877088.959903:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788877088.959921:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.959928:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.959936:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.959948:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.959977:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.960003:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7da240 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.960040:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537472 00000100:00100000:2.0:1788877088.960044:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537472 00000100:00100000:2.0:1788877088.960112:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788877088.960121:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+15:6537:x1875771532537472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788877088.960129:0:56917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788877088.960140:0:56917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13eef41200/0xf5bf0f7e313b0c9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0c93 expref: -99 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.960156:0:56917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13eef41200/0xf5bf0f7e313b0c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c93 expref: 16 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.960166:0:56917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13eef41200/0xf5bf0f7e313b0c9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0c93 expref: 16 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788877088.960173:0:56917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13eef41200, rc 0) 00000100:00100000:2.0:1788877088.960203:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.960209:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788877088.960654:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.960664:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c9a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.960672:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0c9a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.960713:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.960740:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.960757:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7da240 going to sleep for 11 seconds 00000100:00100000:2.0:1788877088.962128:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537600 00000100:00100000:2.0:1788877088.962134:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537600 00000100:00100000:2.0:1788877088.962162:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788877088.962169:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877088.962559:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 389us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877088.962566:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788877088.962753:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3354700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.962785:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.962820:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.962969:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.963077:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537728 00000100:00100000:3.0:1788877088.963082:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537728 00000100:00100000:3.0:1788877088.963675:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788877088.963684:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.965027:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1339us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.965041:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788877088.965738:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788877088.970195:0:57096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1788877088.970318:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1788877088.970372:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788877088.970385:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c9a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.970397:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7872400/0xf5bf0f7e313b0c93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0c9a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877088.970407:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788877088.970410:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13fbfc9800 from 7 10000000:01000000:0.0:1788877088.970413:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788877088.970461:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.970470:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.970481:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.970504:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.970563:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.970635:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537856 00000100:00100000:0.0:1788877088.970642:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.970647:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537856 00000100:00100000:3.0:1788877088.970710:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788877088.970724:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+16:6537:x1875771532537856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.970744:0:56922:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.970765:0:56922:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7873000/0xf5bf0f7e313b0ca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0ca1 expref: -99 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.970801:0:56922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7873000/0xf5bf0f7e313b0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ca1 expref: 17 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.970814:0:56922:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7873000/0xf5bf0f7e313b0ca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ca1 expref: 17 pid: 56922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.970828:0:56922:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873000, rc 0) 00000100:00100000:3.0:1788877088.970904:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532537856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.970913:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788877088.970945:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.970965:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ca8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.970976:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0ca8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.971033:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.971062:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.971099:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788877088.971159:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532537984 00000100:00100000:1.0:1788877088.971166:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532537984 00000100:00100000:1.0:1788877088.971252:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788877088.971264:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c58bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532537984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.971385:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c58bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532537984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877088.971395:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788877088.971463:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532537984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.971489:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.971529:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.971549:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788877088.971577:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538112 00000100:00100000:1.0:1788877088.971581:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538112 00000100:00100000:1.0:1788877088.971694:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788877088.971701:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532538112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.971853:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.971887:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532538112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877088.971895:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:0.0:1788877088.972705:0:57100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788877088.972744:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788877088.972761:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788877088.972767:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ca8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.972775:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efeff600/0xf5bf0f7e313b0ca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ca8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788877088.972783:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788877088.972785:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a13c5fb1800 from 52 10000000:01000000:0.0:1788877088.972787:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788877088.972804:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.972815:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.972822:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.972834:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.972859:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.972874:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.973517:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538240 00000100:00100000:3.0:1788877088.973528:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538240 00000100:00100000:3.0:1788877088.973574:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788877088.973584:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+17:6537:x1875771532538240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.973597:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.973642:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7873800/0xf5bf0f7e313b0cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0caf expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.973671:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7873800/0xf5bf0f7e313b0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0caf expref: 18 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.973684:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7873800/0xf5bf0f7e313b0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0caf expref: 18 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.973693:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873800, rc 0) 00000100:00100000:3.0:1788877088.973748:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.973754:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788877088.973910:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.973923:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cb6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.973930:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0cb6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788877088.973970:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.973998:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.974026:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.974120:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538368 00000100:00100000:3.0:1788877088.974127:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538368 00000100:00100000:3.0:1788877088.974179:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788877088.974191:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.974330:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.974339:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788877088.977968:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.979550:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.979952:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877088.979996:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.980030:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538496 00000100:00100000:3.0:1788877088.980039:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538496 00000100:00100000:3.0:1788877088.980102:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788877088.980115:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.980256:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.980264:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788877088.980350:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788877088.981329:0:57101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1788877088.981468:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1788877088.981502:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788877088.981515:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cb6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.981528:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13efeffa00/0xf5bf0f7e313b0caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cb6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877088.981539:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788877088.981543:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a13c5fb1800 from 92 10000000:01000000:3.0:1788877088.981547:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788877088.981586:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.981595:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.981632:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.981651:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.981710:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.981752:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7dab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.981886:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538624 00000100:00100000:0.0:1788877088.981895:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538624 00000100:00100000:0.0:1788877088.981940:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788877088.981962:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+18:6537:x1875771532538624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.981978:0:56916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877088.981999:0:56916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeffc00/0xf5bf0f7e313b0cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0cbd expref: -99 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.982033:0:56916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeffc00/0xf5bf0f7e313b0cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cbd expref: 19 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.982049:0:56916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeffc00/0xf5bf0f7e313b0cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cbd expref: 19 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.982060:0:56916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeffc00, rc 0) 00000100:00100000:0.0:1788877088.982142:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532538624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.982151:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788877088.982177:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877088.982193:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cc4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.982203:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0cc4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.982253:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.982294:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.982320:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538752 00000100:00100000:3.0:1788877088.982326:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538752 00000100:00100000:1.0:1788877088.982327:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.982360:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788877088.982370:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532538752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788877088.982386:0:56917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788877088.982409:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788877088.982413:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1788877088.982416:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1788877088.982420:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1788877088.982423:0:56917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 95 00000100:00100000:3.0:1788877088.982531:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532538752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.982545:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788877088.982831:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788877088.982919:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788877088.982927:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cc4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.982936:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13e7873600/0xf5bf0f7e313b0cbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cc4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.982944:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788877088.982947:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1788877088.982949:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788877088.982969:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.982977:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.982984:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.982996:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.983025:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.983101:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.983144:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532538880 00000100:00100000:3.0:1788877088.983149:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532538880 00000100:00100000:3.0:1788877088.983215:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788877088.983224:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+19:6537:x1875771532538880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.983233:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.983244:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7872e00/0xf5bf0f7e313b0cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0ccb expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.983262:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7872e00/0xf5bf0f7e313b0cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ccb expref: 20 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.983272:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7872e00/0xf5bf0f7e313b0cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ccb expref: 20 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.983285:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872e00, rc 0) 00000100:00100000:3.0:1788877088.983318:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532538880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.983325:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788877088.984570:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532538880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877088.984583:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cd2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.984591:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0cd2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.984653:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.984685:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.984715:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.984727:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539008 00000100:00100000:0.0:1788877088.984737:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539008 00000100:00100000:0.0:1788877088.984805:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788877088.984820:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532539008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.985033:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532539008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.985043:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788877088.985084:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.985108:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.985145:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.985162:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.985198:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539136 00000100:00100000:3.0:1788877088.985202:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539136 00000100:00100000:3.0:1788877088.985224:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788877088.985229:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532539136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.987236:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532539136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1995us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.987251:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788877088.987256:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788877088.988547:0:57102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1788877088.989659:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1788877088.989688:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788877088.989702:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cd2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.989716:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35400/0xf5bf0f7e313b0ccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cd2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.989728:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1788877088.989731:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a13c5fb1800 from 1 10000000:01000000:1.0:1788877088.989734:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788877088.989774:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.989782:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.989793:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.989814:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.989882:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.989914:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.990679:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539264 00000100:00100000:3.0:1788877088.990689:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539264 00000100:00100000:3.0:1788877088.990749:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788877088.990760:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+20:6537:x1875771532539264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.990781:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.990799:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7873a00/0xf5bf0f7e313b0ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0cd9 expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.990829:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7873a00/0xf5bf0f7e313b0ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cd9 expref: 21 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.990841:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7873a00/0xf5bf0f7e313b0ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cd9 expref: 21 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.990850:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7873a00, rc 0) 00000100:00100000:3.0:1788877088.990905:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532539264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.990913:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788877088.990936:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877088.990955:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ce0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.990964:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0ce0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.990980:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788877088.990984:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ce0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.990988:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34e00/0xf5bf0f7e313b0cd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0ce0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.990994:0:6537:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788877088.990995:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a13c79c0000 from 1 10000000:01000000:1.0:1788877088.990996:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788877088.991014:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991018:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991024:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.991035:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.991068:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.991093:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.991102:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539392 00000100:00100000:0.0:1788877088.991107:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539392 00000100:00100000:0.0:1788877088.991138:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788877088.991145:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+21:6537:x1875771532539392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.991163:0:56915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877088.991175:0:56915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313b0cee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0ce7 expref: -99 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.991190:0:56915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313b0cee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ce7 expref: 22 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.991199:0:56915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe400/0xf5bf0f7e313b0cee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0ce7 expref: 22 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.991206:0:56915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe400, rc 0) 00000100:00100000:0.0:1788877088.991238:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532539392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.991245:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788877088.991268:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788877088.991279:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991291:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0cee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.991302:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788877088.991305:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991309:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae35e00/0xf5bf0f7e313b0ce7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cee expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788877088.991315:0:6537:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788877088.991317:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a13c5fb1800 from 7 10000000:01000000:1.0:1788877088.991319:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788877088.991332:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991339:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.991347:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.991360:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.991387:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.991411:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.991914:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539520 00000100:00100000:3.0:1788877088.991923:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539520 00000100:00100000:3.0:1788877088.991978:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788877088.991991:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+22:6537:x1875771532539520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.992003:0:56917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877088.992017:0:56917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13e7872c00/0xf5bf0f7e313b0cfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0cf5 expref: -99 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.992041:0:56917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13e7872c00/0xf5bf0f7e313b0cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cf5 expref: 23 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.992053:0:56917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13e7872c00/0xf5bf0f7e313b0cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0cf5 expref: 23 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.992062:0:56917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13e7872c00, rc 0) 00000100:00100000:3.0:1788877088.992124:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877088.992131:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.992137:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:1.0:1788877088.992147:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cfc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788877088.992173:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0cfc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788877088.992233:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.992266:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.992291:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788877088.992343:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539648 00000100:00100000:3.0:1788877088.992351:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539648 00000100:00100000:3.0:1788877088.992401:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788877088.992412:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.992579:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877088.992589:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788877088.992595:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.992651:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788877088.992699:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788877088.992720:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a12c3671300 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.992728:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539776 00000100:00100000:0.0:1788877088.992733:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539776 00000100:00100000:0.0:1788877088.992759:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788877088.992766:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13effc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.992858:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13effc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.992865:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788877088.992865:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788877088.993586:0:57103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788877088.994112:0:6537:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788877088.994140:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788877088.994151:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cfc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.994163:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13fae34600/0xf5bf0f7e313b0cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0cfc expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788877088.994174:0:6537:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788877088.994177:0:6537:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a13c79c0000 from 1 10000000:01000000:3.0:1788877088.994180:0:6537:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788877088.994216:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.994227:0:6537:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.994238:0:6537:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.994259:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.994321:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.994377:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.994493:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532539904 00000100:00100000:0.0:1788877088.994501:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532539904 00000100:00100000:0.0:1788877088.994578:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788877088.994592:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+23:6537:x1875771532539904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877088.994654:0:56917:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877088.994667:0:56917:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313b0d0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5bf0f7e313b0d03 expref: -99 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.994694:0:56917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313b0d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0d03 expref: 24 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.994705:0:56917:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe200/0xf5bf0f7e313b0d0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5bf0f7e313b0d03 expref: 24 pid: 56917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877088.994713:0:56917:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe200, rc 0) 00000100:00100000:0.0:1788877088.994752:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13e7d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532539904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877088.994759:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788877088.994834:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532539904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877088.994845:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0d0a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.994853:0:6537:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5bf0f7e313b0d0a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788877088.994906:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532540032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788877088.994932:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788877088.994960:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a13fa7da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788877088.995071:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532540032 00000100:00100000:0.0:1788877088.995077:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532540032 00000100:00100000:0.0:1788877088.995120:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788877088.995132:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532540032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788877088.995231:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb07f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:1f425f51-afcc-4e8f-8e95-ef22cb326ef4+24:6537:x1875771532540032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (296us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788877088.995241:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788877088.995379:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1f425f51-afcc-4e8f-8e95-ef22cb326ef4:6537:1875771532540032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788877088.995412:0:6537:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788877088.995421:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0d0a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877088.995443:0:6537:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff8a13c1487400/0xf5bf0f7e313b0d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5bf0f7e313b0d0a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877089.065391:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788877089.896980:0:57197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788877090.028371:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877090.028420:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332352 00000100:00100000:0.0:1788877090.028534:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332352 00000100:00100000:0.0:1788877090.028593:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1788877090.028621:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+5:15194:x1875771511332352:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877090.028637:0:56915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877090.028654:0:56915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313b0d11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048af5 expref: -99 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.028683:0:56915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313b0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048af5 expref: 6 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.028694:0:56915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efeff400/0xf5bf0f7e313b0d11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048af5 expref: 6 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.028705:0:56915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efeff400, rc 0) 00000100:00100000:0.0:1788877090.028763:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb07d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511332352:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 160us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877090.028772:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1788877090.032084:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877090.032342:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332480 00000100:00100000:0.0:1788877090.032348:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332480 00000100:00100000:0.0:1788877090.032390:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1788877090.032398:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13eb07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511332480:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788877090.032417:0:56917:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1788877090.033473:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788877090.033480:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1788877090.033484:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1788877090.033487:0:56917:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1788877090.033489:0:56917:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 95 00000100:00100000:0.0:1788877090.038174:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13eb07e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511332480:12345-192.168.203.11@tcp:256:ll_cfg_requeue.0 Request processed in 5769us (6088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877090.038187:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1788877090.040013:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877090.040172:0:56923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332608 00000100:00100000:3.0:1788877090.040181:0:56923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332608 00000100:00100000:3.0:1788877090.040233:0:56923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1788877090.040245:0:56923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13c32b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+6:15194:x1875771511332608:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877090.040259:0:56923:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877090.040276:0:56923:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b0d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048afc expref: -99 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.040303:0:56923:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048afc expref: 7 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.040314:0:56923:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1487800/0xf5bf0f7e313b0d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048afc expref: 7 pid: 56923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.040327:0:56923:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1487800, rc 0) 00000100:00100000:3.0:1788877090.040635:0:56923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13c32b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511332608:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 390us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877090.040644:0:56923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1788877090.041770:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1788877090.043760:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332736 00000100:00100000:1.0:1788877090.043768:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332736 00000100:00100000:1.0:1788877090.043820:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1788877090.043829:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+7:15194:x1875771511332736:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788877090.043967:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511332736:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 138us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788877090.043975:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1788877090.047271:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877090.047466:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332864 00000100:00100000:3.0:1788877090.047473:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332864 00000100:00100000:3.0:1788877090.047512:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1788877090.047625:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511332864:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877090.047718:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511332864:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 198us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877090.047736:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1788877090.051323:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1788877090.052100:0:56916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511332992 00000100:00100000:0.0:1788877090.052110:0:56916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511332992 00000100:00100000:0.0:1788877090.052156:0:56916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:0.0:1788877090.052166:0:56916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+8:15194:x1875771511332992:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788877090.052179:0:56916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788877090.052194:0:56916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048b03 expref: -99 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.052220:0:56916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048b03 expref: 9 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.052231:0:56916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13efefe000/0xf5bf0f7e313b0d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048b03 expref: 9 pid: 56916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788877090.052240:0:56916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13efefe000, rc 0) 00000100:00100000:0.0:1788877090.052286:0:56916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511332992:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 122us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877090.052294:0:56916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1788877090.056408:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877090.056573:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511333120 00000100:00100000:2.0:1788877090.056581:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511333120 00000100:00100000:2.0:1788877090.056696:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1788877090.056707:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511333120:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877090.056843:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511333120:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 138us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788877090.056852:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1788877090.059485:0:3655:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877090.059706:0:56917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511333248 00000100:00100000:3.0:1788877090.059713:0:56917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511333248 00000100:00100000:3.0:1788877090.059756:0:56917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:3.0:1788877090.059766:0:56917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511333248:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788877090.059889:0:56917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511333248:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 124us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877090.059898:0:56917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1788877090.070630:0:3657:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1788877090.070830:0:56915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511333376 00000100:00100000:3.0:1788877090.070839:0:56915:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511333376 00000100:00100000:3.0:1788877090.070898:0:56915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1788877090.070908:0:56915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+9:15194:x1875771511333376:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788877090.070927:0:56915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788877090.070943:0:56915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7d14dcdc37048b0a expref: -99 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.070970:0:56915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048b0a expref: 10 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.070981:0:56915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a13c1486a00/0xf5bf0f7e313b0d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0x7d14dcdc37048b0a expref: 10 pid: 56915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788877090.070989:0:56915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a13c1486a00, rc 0) 00000100:00100000:3.0:1788877090.071094:0:56915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13f464dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511333376:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 186us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788877090.071103:0:56915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1788877090.073366:0:3656:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1788877090.073502:0:56922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771511333504 00000100:00100000:2.0:1788877090.073509:0:56922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771511333504 00000100:00100000:2.0:1788877090.073551:0:56922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1788877090.073559:0:56922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13ff5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511333504:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788877090.073889:0:56922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13ff5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7c1cdf7-2492-4eca-92b8-e6fb71d0eec1+10:15194:x1875771511333504:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 329us (526us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788877090.073898:0:56922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:2.0:1788877090.089823:0:10419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788877090.427400:0:57249:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788877090.427748:0:57249:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788877090.953737:0:57299:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788877090.953975:0:57299:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788877091.113474:0:6528:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788877091.305435:0:3664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532540160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788877091.305509:0:3664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877091.305802:0:12587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532540160 00000100:00100000:0.0:1788877091.305810:0:12587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532540160 00000100:00100000:0.0:1788877091.305939:0:12587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1788877091.305948:0:12587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532540160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788877091.305974:0:12587:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491870912 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788877091.306143:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788877091.307681:0:3664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13e78e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1875771532540160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788877091.307796:0:12587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1875771532540160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1848us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877091.307804:0:12587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00010000:00010000:0.0:1788877092.137096:0:6527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788877092.328918:0:3665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532540288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788877092.329001:0:3665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877092.329082:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532540288 00000100:00100000:0.0:1788877092.329096:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532540288 00000100:00100000:0.0:1788877092.329257:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1788877092.329275:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532540288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788877092.329332:0:6545:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446445056 avail 1300205568 00000100:00100000:0.0:1788877092.329516:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a13fad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1875771532540288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 243us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877092.329528:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1788877092.329670:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788877092.329683:0:3663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532540416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788877092.329722:0:3663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788877092.329806:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875771532540416 00000100:00100000:0.0:1788877092.329815:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875771532540416 00000100:00100000:0.0:1788877092.329875:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1788877092.329887:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532540416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788877092.329915:0:8457:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 491615552 pending 0 free 3923488768 avail 3691966464 00000100:00100000:0.0:1788877092.329971:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a12c3356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1875771532540416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788877092.329979:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1788877092.330104:0:3665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a13f0784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1875771532540288:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788877092.330636:0:6535:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788877092.334238:0:3663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a12c3355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1875771532540416:0@lo:13:osp-pre-0-1.0 Debug log: 72489 lines, 72489 kept, 0 dropped, 0 bad.